-- Logs begin at Wed 2022-11-02 11:56:35 UTC, end at Wed 2022-11-02 13:19:00 UTC. -- Nov 02 12:37:32.995764 dv-cinder-863278-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Nov 02 12:37:33.005489 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 02 12:37:33.007535 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 12:37:33 2022] *** Nov 02 12:37:33.007535 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 12:37:33.007535 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 12:37:33.007535 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: nodename: dv-cinder-863278-1-iscsi Nov 02 12:37:33.007535 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: machine: x86_64 Nov 02 12:37:33.007535 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: clock source: unix Nov 02 12:37:33.007535 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: pcre jit disabled Nov 02 12:37:33.007535 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: detected number of CPU cores: 4 Nov 02 12:37:33.007535 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: current working directory: / Nov 02 12:37:33.007535 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: detected binary path: /usr/bin/uwsgi-core Nov 02 12:37:33.007535 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: your processes number limit is 47680 Nov 02 12:37:33.008383 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: your memory page size is 4096 bytes Nov 02 12:37:33.008383 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: detected max file descriptor number: 2048 Nov 02 12:37:33.008383 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: lock engine: pthread robust mutexes Nov 02 12:37:33.008383 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: thunder lock: enabled Nov 02 12:37:33.008383 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 02 12:37:33.008383 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 12:37:33.053070 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: Python main interpreter initialized at 0x56510fd8f9c0 Nov 02 12:37:33.053070 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: python threads support enabled Nov 02 12:37:33.053070 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: your server socket listen backlog is limited to 100 connections Nov 02 12:37:33.053070 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: your mercy for graceful operations on workers is 90 seconds Nov 02 12:37:33.053445 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 12:37:33.053445 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: *** Operational MODE: preforking *** Nov 02 12:37:33.053794 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: *** uWSGI is running in multiple interpreter mode *** Nov 02 12:37:33.053794 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: spawned uWSGI master process (pid: 86725) Nov 02 12:37:33.053991 dv-cinder-863278-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Nov 02 12:37:33.055716 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: spawned uWSGI worker 1 (pid: 86736, cores: 1) Nov 02 12:37:33.055716 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: spawned uWSGI worker 2 (pid: 86737, cores: 1) Nov 02 12:37:33.055716 dv-cinder-863278-1-iscsi devstack@keystone.service[86725]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 12:37:38.874355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:37:38.874355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: from cryptography.utils import int_from_bytes Nov 02 12:37:38.875133 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:37:38.875133 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: from cryptography.utils import int_from_bytes Nov 02 12:37:38.875550 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:37:38.875550 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: from cryptography.utils import int_from_bytes Nov 02 12:37:38.875659 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:37:38.875659 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: from cryptography.utils import int_from_bytes Nov 02 12:37:38.921061 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:37:38.921350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:37:38.921461 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] command line args: [] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:37:38.921700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:37:38.921878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ================================================================================ {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:37:38.922136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] admin_token = **** {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.922380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] config_dir = [] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.922472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:37:38.922628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.922716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:37:38.922783 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] config_source = [] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.922843 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] command line args: [] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:37:38.922900 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] debug = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.923077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:37:38.923162 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.923399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ================================================================================ {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:37:38.923399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] admin_token = **** {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.924458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] config_dir = [] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.924458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.924458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] config_source = [] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.924458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] debug = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.924458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.924872 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.924872 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.924993 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.925226 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.925310 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.925370 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.925570 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] list_limit = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.925714 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.925794 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] log_config_append = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.925928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.926126 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] log_dir = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.926215 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.926289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] log_file = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.926477 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.926560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] list_limit = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.926726 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.926826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] log_config_append = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.926972 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.927120 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.927203 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.927375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] log_dir = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.927555 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.927555 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.927686 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] log_file = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.927842 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.928034 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.928245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.928442 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.928552 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.928817 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.929044 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.929235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.929392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.929392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.929656 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.929718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.929785 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.929845 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.930054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.930186 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.930319 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.930465 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.930465 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.930465 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.930871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.90/identity {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.930871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] publish_errors = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.931130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.931268 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.931393 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.931524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.931650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.931786 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.931913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.932069 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.932069 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.932069 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] standard_threads = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.932479 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.90/identity {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.932479 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] publish_errors = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.932736 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.932879 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.933056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.933056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.933315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.933440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] use_journal = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.933571 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.933703 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] use_json = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.933845 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.933980 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] use_stderr = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.934113 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.934241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] use_syslog = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.934378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] standard_threads = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.934511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.934695 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.934861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.935000 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.935126 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.935253 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.935378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.935512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] use_journal = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.935512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] use_json = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.935794 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.935933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] use_stderr = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.936061 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.936192 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] use_syslog = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.936371 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.936503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:37:38.936628 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.936760 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.936897 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.937022 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.937156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.937283 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.937410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.937574 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.937707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.937846 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.937973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.938105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.938232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.938358 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.938484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.938621 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.938759 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.938891 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.939018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.939145 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.939271 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.939477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.939613 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.939741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.939866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.939993 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.940119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.940285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.940419 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.940557 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.940721 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.940854 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.940981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.941119 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.941246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.941378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.941512 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.941642 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.941772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.941907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.942033 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.942159 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.942299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.942437 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.942574 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.942713 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.942840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.942966 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.943099 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.943226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.943353 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.943487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.943622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.943748 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.943873 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.944008 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.944150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.944421 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.944555 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.944691 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.944824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.944950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.945085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.945219 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.945346 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.945478 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.945609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.945742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.945868 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.946077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.946211 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.946338 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.946463 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.946588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.946726 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.946854 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.946986 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.947111 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.947237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.947362 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.947496 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.947661 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.947795 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.947795 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.948322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.948452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.948588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.948715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.948916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.949108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.949297 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.949485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.949707 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.949910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.950078 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.950266 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.950465 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.950719 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.950922 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.951085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.951306 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.951547 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.951712 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.951900 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.952125 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.952468 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.952675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.952837 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.953025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.953213 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.953452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.953651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.953851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.954020 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.954184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.954315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.954315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.954315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.954315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.954868 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.955003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.955130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.955257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.955401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.955559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.955691 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.955835 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.955997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.956126 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.956285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.956417 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.956417 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.956666 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.956799 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.956958 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.957090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.957236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.957365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.957491 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.957717 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.957853 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.957981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.958122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.958251 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.958379 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.958506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.958638 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.958766 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.958900 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.959028 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.959166 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.959293 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.959421 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.959589 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.959760 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.959895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.960023 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.960150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.960312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.960442 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.960583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.960711 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.960838 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.960964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.961101 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.961306 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.961447 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.961575 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.961702 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.961829 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.961955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.962090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.962226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.962365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.962365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.962613 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.962744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.962888 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.963015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.963150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.963150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.963388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.963522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.963651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.963777 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.963912 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.964039 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.964165 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.964313 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.964441 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.964567 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.964720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] auth.external = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.964848 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.964975 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.965100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.965234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.965364 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.965498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.965626 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.965759 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] auth.password = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.965886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.966012 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] auth.token = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.966137 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.966275 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.966402 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.966538 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.966664 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.966826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.966962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.967127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.967255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.967391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.967525 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.967652 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.967819 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] auth.external = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.967960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.968089 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.968245 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] credential.caching = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.968391 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.968521 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.968649 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.968776 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.968916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] auth.password = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.969044 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.969180 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] auth.token = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.969314 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.969442 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.969577 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.969713 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.969841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.969968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.970095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.970240 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.970369 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.970507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.970636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.970764 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.970892 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.971019 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.971146 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.971282 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] credential.caching = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.971418 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.971546 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.971681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.971809 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.971954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.972091 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.972289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.972426 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.972560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] federation.caching = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.972697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.972825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.972960 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.973090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.973223 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.973351 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.973485 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.973615 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.973750 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.973890 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.974020 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.974147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.974274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.974401 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.974537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.974665 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.974791 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.974926 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.975053 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.975181 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.975315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.975444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.975581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] federation.caching = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.975708 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity.caching = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.975844 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.975972 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.976184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.976381 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.976512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.976640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.976777 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.976906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.977117 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.977250 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.977378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.977505 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.977643 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.977771 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.977949 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.978084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.978212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.978341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.978468 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.978596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.978596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.978849 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.978977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.979103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity.caching = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.979237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.979378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.979513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.979742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.979904 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.980042 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.980042 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.980318 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.980318 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.980565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.980565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.980806 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.980932 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.981068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.981196 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.981334 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.981463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.981590 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.981718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.981852 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.981980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.982107 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.982234 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.982362 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.982489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.982657 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.982825 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.982954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.983092 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.983219 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.983346 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.983484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.983612 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.983739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.983866 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.983992 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.984119 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.984275 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.984409 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.984542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.984669 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.984795 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.984932 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.985068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.985195 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.985322 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.985450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.985578 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.985705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.985847 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.985975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.986101 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.986228 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.986355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.986482 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.986621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.986763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.986890 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.987017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.987184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.987326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.987463 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.987610 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.987820 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.988015 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.988150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.988339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.988481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.988610 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.988755 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.988883 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.989010 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.989137 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.989272 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.989401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.989527 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.989655 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.989789 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.989918 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.990052 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.990182 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.990431 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.990562 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.990701 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.990830 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.991018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.991162 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.991290 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.991418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.991545 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.991673 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.991809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.991939 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.992066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.992194 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.992346 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.992474 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.992628 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.992762 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.992896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.993024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.993151 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.993278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.993415 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.993577 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.993711 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.993839 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.993967 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.994094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.994230 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.994375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.994504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.994504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.994744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.994879 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.995014 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.995142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.995272 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.995399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.995526 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.995662 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.995790 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.995917 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.996045 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.996045 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.996336 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.996477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.996606 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.996733 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.996859 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.996986 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.996986 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.997241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.997369 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.997369 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.997608 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.997735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.997735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.997992 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.998166 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.998322 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.998450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.998450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.998692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.998827 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.998955 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.999081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.999081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.999323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.999450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.999450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.999709 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.999837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:38.999964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.000091 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.000091 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.000453 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.000585 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.000585 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.000826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] resource.caching = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.000953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.001080 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.001216 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.001346 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.001474 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.001612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.001740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] resource.caching = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.001740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.001989 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.002118 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.002245 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.002379 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.002507 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.002645 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.002849 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.002981 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.003108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.003236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.003363 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.003503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.003639 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] role.caching = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.003768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.003895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] role.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.004023 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.004150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.004354 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] role.caching = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.004497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.004627 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] role.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.004754 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.004883 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.005011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.005138 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.005284 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.005415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.005544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.005673 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.005800 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.005928 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.006064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.006193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.006321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.006449 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.006578 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.006705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.006841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.007016 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.007160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.007289 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.007416 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.007558 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.007688 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.007817 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.007817 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.008059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.008245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.008391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.008391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.008636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.008765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.008904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.009031 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.009167 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.009297 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.009429 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.009557 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.009685 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.009813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.009948 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.010077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.010205 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.010333 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.010460 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.010600 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.010737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.010866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.011000 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.011128 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.011255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.011386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.011521 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.011650 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.011777 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.011905 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.012032 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.012159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.012332 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.012464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.012601 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.012730 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.012859 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.012985 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] token.caching = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.013121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.013250 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.013378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.013506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.013633 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] token.caching = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.013760 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.013953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.014097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.014236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.014414 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.014548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.014685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.014814 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.014948 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.015077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.015203 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.015336 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.015472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.015600 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.015728 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.015856 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.015984 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.016122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.016320 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.016455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.016583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.016711 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.016838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.016965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.017101 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.017230 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.017357 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.017484 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.017611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.017738 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.017883 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.connection = **** {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.018021 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.018200 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.018362 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.018532 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.018665 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.connection = **** {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.018803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.018940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.019069 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.019206 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.019336 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.019464 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.019591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.019718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.019858 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.019994 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.020123 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.020273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.020273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.020521 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.020649 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.020788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.020918 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.021045 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.021173 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.021301 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.021429 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.021564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.021704 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.021832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.021959 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.022086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.022214 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.022350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.022479 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.022616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.022745 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.022878 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.022878 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:37:39.023142 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.023142 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:37:39.023142 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:37:39.041623 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.041909 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.042060 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.042300 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.042444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.042584 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.050797 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.051189 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.079666 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.080101 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.080541 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.080754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.134438 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.134863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.184821 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.185120 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.185274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.185417 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.251455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.251759 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.251932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.252076 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.252246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.252411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.252549 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.252549 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.252813 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.252996 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.253269 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.253444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.278083 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.278390 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.278540 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.278683 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.278839 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.278977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.279113 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.279249 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.279385 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.279614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.279764 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.279913 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.280048 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.280048 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.291298 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.291557 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.304243 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.304494 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.304641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.304804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.304955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.305092 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.305241 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.305379 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.305515 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.305658 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.305794 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.305928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86737) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.306063 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.306063 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86736) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:37:39.322910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.323152 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 12:37:39.323445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.323660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.323809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 12:37:39.323949 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 12:37:39.324095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.324265 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.324408 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.324544 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 12:37:39.324679 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.324814 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.324960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.325096 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.325096 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.325364 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.335345 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.335571 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.335719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.335857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.335992 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.336125 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.336307 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.336495 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.344710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.345805 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.347925 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.348237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.348500 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.348785 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.349070 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.349329 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.349596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.349874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.350038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.350143 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.350412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.350580 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.350669 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.351018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.351419 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.351790 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.352141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.352524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.352894 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.353257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.353757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.354119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.378345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.379935 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.380229 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.380907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.382582 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.382968 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.385596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.385830 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.386111 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.388821 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.389221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.389601 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.393629 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.393912 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.397433 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.397822 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.398290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.398571 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.398844 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.399115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.399379 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.399644 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.399907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.400165 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.403067 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.403475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.403853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.404252 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.404668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.405039 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.405420 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.405793 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.419217 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.419481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.423988 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.425299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.425686 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.427791 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.428083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.430637 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.433127 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.434559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.434950 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.436687 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.440135 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.440334 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.440499 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.440778 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.441078 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.441348 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.441617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.444488 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.448146 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.448560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.448948 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.449328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.449704 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.450080 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.462528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.462528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.462528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.462528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.468994 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.469911 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.470303 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.470667 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.470802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.471079 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.471204 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.474319 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.474600 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.474873 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.475144 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.475412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.479495 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.481515 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.481899 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.485105 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.485490 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.485882 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.486261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.486638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.490156 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.490449 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.490724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.491003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.491276 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.491543 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.491829 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.503049 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.503049 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.503049 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.503049 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.505497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.505497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.505497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.509585 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.512784 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.522667 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.526224 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.623735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.625399 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.626976 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.627256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.627543 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.635922 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.637488 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.639543 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.640945 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.641225 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.641478 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.641603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.641769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.643327 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.643932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.644319 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.650845 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.651134 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.651403 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.652738 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.654425 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.658259 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.658659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.659042 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.659424 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.659720 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86736) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.659996 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.660259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.660559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.660826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.661099 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.661379 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.661628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.661888 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.662154 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.662421 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.662686 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.662947 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.663210 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86736) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.669764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.670190 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.670649 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.678659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86737) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:37:39.679053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.679414 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.679807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.680237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.680598 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.680985 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.681347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.681715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.682081 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.682460 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.682817 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.683189 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.683554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86737) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:37:39.700836 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56510fd8f9c0 pid: 86736 (default app) Nov 02 12:37:39.704366 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ded2e-8f59-4cf5-a46f-484f4a966456 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:39.704655 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ded2e-8f59-4cf5-a46f-484f4a966456 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:39.704932 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ded2e-8f59-4cf5-a46f-484f4a966456 None None] PATH_INFO: `/v3` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:39.711056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1/1] 10.222.0.90 () {50 vars in 791 bytes} [Wed Nov 2 12:37:39 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:39.721542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56510fd8f9c0 pid: 86737 (default app) Nov 02 12:37:48.069177 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc730b-0834-4be7-9b86-df09435800d5 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:48.069738 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc730b-0834-4be7-9b86-df09435800d5 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:48.069738 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc730b-0834-4be7-9b86-df09435800d5 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:48.071794 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 2/2] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:37:48.079576 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df844ce4-8a37-4c63-99bd-748a82a818b6 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:48.080073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df844ce4-8a37-4c63-99bd-748a82a818b6 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:48.080073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df844ce4-8a37-4c63-99bd-748a82a818b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:48.111988 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG oslo_db.sqlalchemy.engines [None req-df844ce4-8a37-4c63-99bd-748a82a818b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:37:48.298526 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG passlib.handlers.bcrypt [None req-df844ce4-8a37-4c63-99bd-748a82a818b6 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86737) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 12:37:48.298948 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG passlib.handlers.bcrypt [None req-df844ce4-8a37-4c63-99bd-748a82a818b6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86737) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 12:37:48.353811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-df844ce4-8a37-4c63-99bd-748a82a818b6 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:48.355326 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-df844ce4-8a37-4c63-99bd-748a82a818b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:48.485831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1/3] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:37:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 02 12:37:48.620321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc730b-0834-4be7-9b86-df09435800d5 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:48.655905 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG oslo_db.sqlalchemy.engines [None req-52fc730b-0834-4be7-9b86-df09435800d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:37:48.782867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc730b-0834-4be7-9b86-df09435800d5 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:48.787708 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622afa0-9408-4896-a1c8-0e62ba1a9fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:48.788489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622afa0-9408-4896-a1c8-0e62ba1a9fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:48.788770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622afa0-9408-4896-a1c8-0e62ba1a9fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:48.789042 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622afa0-9408-4896-a1c8-0e62ba1a9fe0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:48.798657 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622afa0-9408-4896-a1c8-0e62ba1a9fe0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:48.849226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9622afa0-9408-4896-a1c8-0e62ba1a9fe0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 12:37:48.849560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622afa0-9408-4896-a1c8-0e62ba1a9fe0 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:48.859533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 3/4] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Nov 2 12:37:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:48.866119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df844ce4-8a37-4c63-99bd-748a82a818b6 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:48.881102 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df844ce4-8a37-4c63-99bd-748a82a818b6 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:48.887015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272561e-fe9f-42c4-bd42-41eaaf318c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:48.888187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272561e-fe9f-42c4-bd42-41eaaf318c4e admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:48.888509 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272561e-fe9f-42c4-bd42-41eaaf318c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:48.888791 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272561e-fe9f-42c4-bd42-41eaaf318c4e admin admin] PATH_INFO: `/v3/projects/b31a529f322f43dfa78c0719df9a66db` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:48.890614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272561e-fe9f-42c4-bd42-41eaaf318c4e admin admin] RBAC: Authorizing `identity:get_project(project_id=b31a529f322f43dfa78c0719df9a66db)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:48.943193 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b272561e-fe9f-42c4-bd42-41eaaf318c4e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 12:37:48.943536 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272561e-fe9f-42c4-bd42-41eaaf318c4e admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:48.948370 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 2/5] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Nov 2 12:37:48 2022] GET /identity/v3/projects/b31a529f322f43dfa78c0719df9a66db => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:51.259852 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79723aa3-f822-442f-96d3-646d73490a06 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:51.260432 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79723aa3-f822-442f-96d3-646d73490a06 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:51.260432 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79723aa3-f822-442f-96d3-646d73490a06 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:51.265040 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 4/6] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:37:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:37:51.271925 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3862932-323b-4638-bc04-006f17bf407b None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:51.272633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3862932-323b-4638-bc04-006f17bf407b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:51.272913 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3862932-323b-4638-bc04-006f17bf407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:51.295880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-f3862932-323b-4638-bc04-006f17bf407b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:51.297463 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f3862932-323b-4638-bc04-006f17bf407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:51.307748 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 3/7] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:37:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 12:37:51.331320 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79723aa3-f822-442f-96d3-646d73490a06 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:51.349327 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79723aa3-f822-442f-96d3-646d73490a06 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:51.355144 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e55e27-306b-4094-ae4c-0799d43bb1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:51.355775 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e55e27-306b-4094-ae4c-0799d43bb1ee admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:51.356055 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e55e27-306b-4094-ae4c-0799d43bb1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:51.356356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e55e27-306b-4094-ae4c-0799d43bb1ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:51.364107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e55e27-306b-4094-ae4c-0799d43bb1ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:51.365923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e55e27-306b-4094-ae4c-0799d43bb1ee admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:51.374759 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 5/8] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Nov 2 12:37:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:51.384006 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3862932-323b-4638-bc04-006f17bf407b None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:51.399026 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3862932-323b-4638-bc04-006f17bf407b None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:51.406718 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3c0aa-8a81-4f91-8489-c1ed338c694b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:51.407604 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3c0aa-8a81-4f91-8489-c1ed338c694b admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:51.407876 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3c0aa-8a81-4f91-8489-c1ed338c694b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:51.408358 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3c0aa-8a81-4f91-8489-c1ed338c694b admin admin] PATH_INFO: `/v3/users/278e685f13c54040af7579fa7ad454a8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:51.409874 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3c0aa-8a81-4f91-8489-c1ed338c694b admin admin] RBAC: Authorizing `identity:get_user(user_id=278e685f13c54040af7579fa7ad454a8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:51.411731 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3c0aa-8a81-4f91-8489-c1ed338c694b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:51.413347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 4/9] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Nov 2 12:37:51 2022] GET /identity/v3/users/278e685f13c54040af7579fa7ad454a8 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:53.788102 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a54e7-11de-4f47-899c-73c82a8232ab None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:53.788678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a54e7-11de-4f47-899c-73c82a8232ab None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:53.788678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a54e7-11de-4f47-899c-73c82a8232ab None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:53.790331 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 6/10] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:37:53.795928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d965532-4b2f-403e-a372-49325b5ee85f None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:53.796408 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d965532-4b2f-403e-a372-49325b5ee85f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:53.796501 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d965532-4b2f-403e-a372-49325b5ee85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:53.813965 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-8d965532-4b2f-403e-a372-49325b5ee85f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:53.815146 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8d965532-4b2f-403e-a372-49325b5ee85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:53.841861 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fff66-0742-4489-9d1c-b1d3ed0036aa None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:53.842143 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fff66-0742-4489-9d1c-b1d3ed0036aa None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:53.842417 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fff66-0742-4489-9d1c-b1d3ed0036aa None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:53.844364 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 7/11] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:37:53.849763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52473318-0e3a-4e8b-b9ee-ddd2d61c9bf9 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:53.850041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52473318-0e3a-4e8b-b9ee-ddd2d61c9bf9 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:53.850312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52473318-0e3a-4e8b-b9ee-ddd2d61c9bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:53.891730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG passlib.handlers.bcrypt [None req-52473318-0e3a-4e8b-b9ee-ddd2d61c9bf9 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86736) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 12:37:53.892143 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG passlib.handlers.bcrypt [None req-52473318-0e3a-4e8b-b9ee-ddd2d61c9bf9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86736) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 12:37:53.897537 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 5/12] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:53.921347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d965532-4b2f-403e-a372-49325b5ee85f None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:53.938922 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-52473318-0e3a-4e8b-b9ee-ddd2d61c9bf9 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:53.940775 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-52473318-0e3a-4e8b-b9ee-ddd2d61c9bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:54.020612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d965532-4b2f-403e-a372-49325b5ee85f None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:54.039114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 8/13] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:54.054679 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327a91d-fa93-42f1-8b3c-3fd12441af70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:54.055494 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327a91d-fa93-42f1-8b3c-3fd12441af70 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.055777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327a91d-fa93-42f1-8b3c-3fd12441af70 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.056043 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327a91d-fa93-42f1-8b3c-3fd12441af70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.061664 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52473318-0e3a-4e8b-b9ee-ddd2d61c9bf9 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:54.067975 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327a91d-fa93-42f1-8b3c-3fd12441af70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:37:54.074985 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-9327a91d-fa93-42f1-8b3c-3fd12441af70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:37:54.076255 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 6/14] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:37:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:37:54.082055 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327a91d-fa93-42f1-8b3c-3fd12441af70 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:54.160867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52473318-0e3a-4e8b-b9ee-ddd2d61c9bf9 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:54.177652 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327a91d-fa93-42f1-8b3c-3fd12441af70 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:54.196050 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c74810-5eaa-4152-af2a-908cc44349fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:54.197013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c74810-5eaa-4152-af2a-908cc44349fb None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.197297 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c74810-5eaa-4152-af2a-908cc44349fb None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.197572 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c74810-5eaa-4152-af2a-908cc44349fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.211570 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c73e43-9f9a-4888-b21f-239c8ff867ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:54.212272 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c73e43-9f9a-4888-b21f-239c8ff867ea None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.212556 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c73e43-9f9a-4888-b21f-239c8ff867ea None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.212832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c73e43-9f9a-4888-b21f-239c8ff867ea None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.213589 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c73e43-9f9a-4888-b21f-239c8ff867ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:54.213898 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c73e43-9f9a-4888-b21f-239c8ff867ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:54.215304 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c73e43-9f9a-4888-b21f-239c8ff867ea None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:54.226553 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 7/15] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:37:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:37:54.232301 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c73e43-9f9a-4888-b21f-239c8ff867ea None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:54.266428 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c74810-5eaa-4152-af2a-908cc44349fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:54.267970 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c74810-5eaa-4152-af2a-908cc44349fb None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:54.331323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c73e43-9f9a-4888-b21f-239c8ff867ea None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:54.361639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 9/16] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:37:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:54.365210 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04ce6d-3470-4987-8da0-7913d3888031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:54.366082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04ce6d-3470-4987-8da0-7913d3888031 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.366360 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04ce6d-3470-4987-8da0-7913d3888031 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.366699 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04ce6d-3470-4987-8da0-7913d3888031 None admin] PATH_INFO: `/v3/users/278e685f13c54040af7579fa7ad454a8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.367898 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04ce6d-3470-4987-8da0-7913d3888031 None admin] RBAC: Authorizing `identity:get_user(user_id=278e685f13c54040af7579fa7ad454a8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:54.367994 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c74810-5eaa-4152-af2a-908cc44349fb None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:54.369387 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04ce6d-3470-4987-8da0-7913d3888031 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:54.370980 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 8/17] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:37:54 2022] GET /identity/v3/users/278e685f13c54040af7579fa7ad454a8 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:37:54.376662 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04ce6d-3470-4987-8da0-7913d3888031 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:54.462683 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c74810-5eaa-4152-af2a-908cc44349fb None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:54.472659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04ce6d-3470-4987-8da0-7913d3888031 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:54.495318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0b5c2-f813-46c8-97ec-276cefba7bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:54.496117 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0b5c2-f813-46c8-97ec-276cefba7bdf None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.496422 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0b5c2-f813-46c8-97ec-276cefba7bdf None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.496691 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0b5c2-f813-46c8-97ec-276cefba7bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.507554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b410fd-d0ea-47d0-8592-53e2dc88c002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:54.508382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b410fd-d0ea-47d0-8592-53e2dc88c002 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.508666 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b410fd-d0ea-47d0-8592-53e2dc88c002 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.508937 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b410fd-d0ea-47d0-8592-53e2dc88c002 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.510091 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b410fd-d0ea-47d0-8592-53e2dc88c002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:54.511570 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b410fd-d0ea-47d0-8592-53e2dc88c002 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:54.513199 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 9/18] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:37:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:37:54.516084 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0b5c2-f813-46c8-97ec-276cefba7bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:54.517574 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0b5c2-f813-46c8-97ec-276cefba7bdf None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:54.519035 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b410fd-d0ea-47d0-8592-53e2dc88c002 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:54.535219 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-2fb0b5c2-f813-46c8-97ec-276cefba7bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:37:54.536581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 10/19] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:37:54.542569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0b5c2-f813-46c8-97ec-276cefba7bdf None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:54.616593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b410fd-d0ea-47d0-8592-53e2dc88c002 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:54.638799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0b5c2-f813-46c8-97ec-276cefba7bdf None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:54.649378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4d9a4-9e18-453b-bbed-864491ec62c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:54.650049 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4d9a4-9e18-453b-bbed-864491ec62c4 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.650331 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4d9a4-9e18-453b-bbed-864491ec62c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.650608 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4d9a4-9e18-453b-bbed-864491ec62c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.651441 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4d9a4-9e18-453b-bbed-864491ec62c4 None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.domain.id=default, user.id=278e685f13c54040af7579fa7ad454a8) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:54.651753 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4d9a4-9e18-453b-bbed-864491ec62c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:54.653259 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4d9a4-9e18-453b-bbed-864491ec62c4 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:54.660154 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 10/20] 10.222.0.90 () {56 vars in 1322 bytes} [Wed Nov 2 12:37:54 2022] GET /identity/v3/role_assignments?user.id=278e685f13c54040af7579fa7ad454a8&scope.domain.id=default&role.id=85136c55809b4d9db97c263a72392ad1 => generated 233 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:37:54.671552 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59907e-7070-4430-b4a8-b0f2ad3ad24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:54.672245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59907e-7070-4430-b4a8-b0f2ad3ad24b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.672547 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59907e-7070-4430-b4a8-b0f2ad3ad24b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.672820 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59907e-7070-4430-b4a8-b0f2ad3ad24b None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.673568 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59907e-7070-4430-b4a8-b0f2ad3ad24b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:54.673871 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59907e-7070-4430-b4a8-b0f2ad3ad24b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:54.675452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59907e-7070-4430-b4a8-b0f2ad3ad24b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:54.695149 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 11/21] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:57.311544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a44648-a86e-496b-9b95-b01933623fd0 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:57.312058 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a44648-a86e-496b-9b95-b01933623fd0 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:57.312160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a44648-a86e-496b-9b95-b01933623fd0 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:57.314492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 11/22] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:37:57.319741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863acee-9583-4c4b-8b3b-ab8cc371590e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:57.320129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863acee-9583-4c4b-8b3b-ab8cc371590e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:57.320337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863acee-9583-4c4b-8b3b-ab8cc371590e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:57.341334 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-4863acee-9583-4c4b-8b3b-ab8cc371590e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:57.342555 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4863acee-9583-4c4b-8b3b-ab8cc371590e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:57.426140 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 12/23] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:57.469711 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a44648-a86e-496b-9b95-b01933623fd0 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:57.606232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a44648-a86e-496b-9b95-b01933623fd0 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:57.647682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cd9c6-0c28-43d1-8917-f742bf56eb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:57.648519 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cd9c6-0c28-43d1-8917-f742bf56eb9b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:57.648802 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cd9c6-0c28-43d1-8917-f742bf56eb9b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:57.649073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cd9c6-0c28-43d1-8917-f742bf56eb9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:57.665153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cd9c6-0c28-43d1-8917-f742bf56eb9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:37:57.672166 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-713cd9c6-0c28-43d1-8917-f742bf56eb9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:37:57.673747 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 12/24] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:37:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:37:57.679537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863acee-9583-4c4b-8b3b-ab8cc371590e None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:57.694034 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22180c67-3fd0-4c52-9375-e34d051c1acb None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:57.694320 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22180c67-3fd0-4c52-9375-e34d051c1acb None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:57.694592 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22180c67-3fd0-4c52-9375-e34d051c1acb None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:57.696718 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 13/25] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:37:57.701577 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d5f6f-9058-4768-8adf-91d84aae4f43 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:57.701860 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d5f6f-9058-4768-8adf-91d84aae4f43 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:57.702139 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d5f6f-9058-4768-8adf-91d84aae4f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:57.725313 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-a13d5f6f-9058-4768-8adf-91d84aae4f43 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:57.726518 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-a13d5f6f-9058-4768-8adf-91d84aae4f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:57.829760 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 14/26] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:37:57.831757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec994d7-40ac-49d4-82b3-455bf6d24ade None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:57.832042 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec994d7-40ac-49d4-82b3-455bf6d24ade None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:57.832340 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec994d7-40ac-49d4-82b3-455bf6d24ade None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:57.837071 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 15/27] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:37:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:37:57.842852 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4274a81-cd21-43cc-813d-8fa78fbcc764 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:57.843135 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4274a81-cd21-43cc-813d-8fa78fbcc764 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:57.843406 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4274a81-cd21-43cc-813d-8fa78fbcc764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:57.871468 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863acee-9583-4c4b-8b3b-ab8cc371590e None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:57.880517 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-b4274a81-cd21-43cc-813d-8fa78fbcc764 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:57.881724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b4274a81-cd21-43cc-813d-8fa78fbcc764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:57.928557 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1c28e-abca-4be8-94fb-82602a17e6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:57.931290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c28e-abca-4be8-94fb-82602a17e6a6 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:57.931290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c28e-abca-4be8-94fb-82602a17e6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:57.931290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c28e-abca-4be8-94fb-82602a17e6a6 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:57.931290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1c28e-abca-4be8-94fb-82602a17e6a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:57.931290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1c28e-abca-4be8-94fb-82602a17e6a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:57.936241 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1c28e-abca-4be8-94fb-82602a17e6a6 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:57.957942 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 13/28] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:37:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:57.959068 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1c28e-abca-4be8-94fb-82602a17e6a6 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:58.010839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 16/29] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:58.011762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4274a81-cd21-43cc-813d-8fa78fbcc764 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:58.081973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1c28e-abca-4be8-94fb-82602a17e6a6 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:58.120652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02834ad7-c649-48dd-9ec6-8843d5ca7da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:58.122018 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02834ad7-c649-48dd-9ec6-8843d5ca7da7 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.125226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02834ad7-c649-48dd-9ec6-8843d5ca7da7 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.125755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02834ad7-c649-48dd-9ec6-8843d5ca7da7 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.126768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02834ad7-c649-48dd-9ec6-8843d5ca7da7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:58.128523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02834ad7-c649-48dd-9ec6-8843d5ca7da7 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:58.205161 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4274a81-cd21-43cc-813d-8fa78fbcc764 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:58.244405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd72a62-67b4-4e34-bdc2-a17968b64bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:58.245298 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd72a62-67b4-4e34-bdc2-a17968b64bd7 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.245577 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd72a62-67b4-4e34-bdc2-a17968b64bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.245849 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd72a62-67b4-4e34-bdc2-a17968b64bd7 None admin] PATH_INFO: `/v3/users/278e685f13c54040af7579fa7ad454a8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.247084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd72a62-67b4-4e34-bdc2-a17968b64bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=278e685f13c54040af7579fa7ad454a8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:58.248737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd72a62-67b4-4e34-bdc2-a17968b64bd7 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:58.250451 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 17/30] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:37:58 2022] GET /identity/v3/users/278e685f13c54040af7579fa7ad454a8 => generated 247 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:58.251354 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd72a62-67b4-4e34-bdc2-a17968b64bd7 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:58.320746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 14/31] 10.222.0.90 () {60 vars in 1131 bytes} [Wed Nov 2 12:37:57 2022] POST /identity/v3/roles => generated 219 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:58.323057 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02834ad7-c649-48dd-9ec6-8843d5ca7da7 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:58.390801 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd72a62-67b4-4e34-bdc2-a17968b64bd7 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:58.436754 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b009907-5712-4ffa-810e-e55d5c5bd410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:58.437576 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b009907-5712-4ffa-810e-e55d5c5bd410 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.437855 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b009907-5712-4ffa-810e-e55d5c5bd410 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.438126 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b009907-5712-4ffa-810e-e55d5c5bd410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.452092 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b009907-5712-4ffa-810e-e55d5c5bd410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:58.453819 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b009907-5712-4ffa-810e-e55d5c5bd410 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:58.474250 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-6b009907-5712-4ffa-810e-e55d5c5bd410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:37:58.475741 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 18/32] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:37:58.477235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d0aa1-6341-4e80-8469-c4f3a032481c None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.478162 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d0aa1-6341-4e80-8469-c4f3a032481c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.478447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d0aa1-6341-4e80-8469-c4f3a032481c None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.480653 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 19/33] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:37:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:37:58.485601 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d0aa1-6341-4e80-8469-c4f3a032481c None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:58.553226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02834ad7-c649-48dd-9ec6-8843d5ca7da7 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:58.596972 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989f1ec-c964-431b-9086-6d80015b694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:58.598324 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989f1ec-c964-431b-9086-6d80015b694e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.598852 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989f1ec-c964-431b-9086-6d80015b694e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.599808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989f1ec-c964-431b-9086-6d80015b694e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.602085 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989f1ec-c964-431b-9086-6d80015b694e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:58.604730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989f1ec-c964-431b-9086-6d80015b694e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:58.606569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 15/34] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:37:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:58.608133 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6ff5e-de18-4941-ab15-13db19b63e96 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.609323 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6ff5e-de18-4941-ab15-13db19b63e96 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.609934 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6ff5e-de18-4941-ab15-13db19b63e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.632756 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-76d6ff5e-de18-4941-ab15-13db19b63e96 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:58.635206 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-76d6ff5e-de18-4941-ab15-13db19b63e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:58.637508 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d0aa1-6341-4e80-8469-c4f3a032481c None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:58.681681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52eeed1-e19d-4f19-ab65-ce2e1ebcf04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:58.682549 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eeed1-e19d-4f19-ab65-ce2e1ebcf04f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.682987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eeed1-e19d-4f19-ab65-ce2e1ebcf04f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.683356 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eeed1-e19d-4f19-ab65-ce2e1ebcf04f None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.684180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52eeed1-e19d-4f19-ab65-ce2e1ebcf04f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:58.684605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52eeed1-e19d-4f19-ab65-ce2e1ebcf04f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:58.686230 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52eeed1-e19d-4f19-ab65-ce2e1ebcf04f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:58.713692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 20/35] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:58.715392 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52eeed1-e19d-4f19-ab65-ce2e1ebcf04f None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:58.718999 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 16/36] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:58.721463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ba566-64b4-4b88-a55b-118ba2c7f2f5 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.721898 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ba566-64b4-4b88-a55b-118ba2c7f2f5 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.722311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ba566-64b4-4b88-a55b-118ba2c7f2f5 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.724462 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 17/37] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:37:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:37:58.725891 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ba566-64b4-4b88-a55b-118ba2c7f2f5 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:58.831706 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52eeed1-e19d-4f19-ab65-ce2e1ebcf04f None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:58.835050 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ba566-64b4-4b88-a55b-118ba2c7f2f5 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:58.864816 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cef75-aaed-4fb3-8ada-9d28821cf334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:58.865755 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cef75-aaed-4fb3-8ada-9d28821cf334 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.866036 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cef75-aaed-4fb3-8ada-9d28821cf334 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.866370 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cef75-aaed-4fb3-8ada-9d28821cf334 None admin] PATH_INFO: `/v3/domains/default/users/278e685f13c54040af7579fa7ad454a8/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.867683 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7ca96-961b-471e-8821-98fc2394dd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:58.868397 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cef75-aaed-4fb3-8ada-9d28821cf334 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=278e685f13c54040af7579fa7ad454a8, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:58.868503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7ca96-961b-471e-8821-98fc2394dd8b None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.868678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7ca96-961b-471e-8821-98fc2394dd8b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.868946 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7ca96-961b-471e-8821-98fc2394dd8b None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.869652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7ca96-961b-471e-8821-98fc2394dd8b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:58.869885 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cef75-aaed-4fb3-8ada-9d28821cf334 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:58.871084 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7ca96-961b-471e-8821-98fc2394dd8b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:58.908245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 18/38] 10.222.0.90 () {60 vars in 1141 bytes} [Wed Nov 2 12:37:58 2022] POST /identity/v3/projects => generated 301 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:58.908245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571232dd-1979-4ed2-b8be-a54eb49c1cb0 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.908245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571232dd-1979-4ed2-b8be-a54eb49c1cb0 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.908245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571232dd-1979-4ed2-b8be-a54eb49c1cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.929290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-571232dd-1979-4ed2-b8be-a54eb49c1cb0 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:58.930799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-571232dd-1979-4ed2-b8be-a54eb49c1cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:58.991470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 21/39] 10.222.0.90 () {58 vars in 1361 bytes} [Wed Nov 2 12:37:58 2022] PUT /identity/v3/domains/default/users/278e685f13c54040af7579fa7ad454a8/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:58.992470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cef75-aaed-4fb3-8ada-9d28821cf334 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:59.003774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 19/40] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:59.048656 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571232dd-1979-4ed2-b8be-a54eb49c1cb0 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:59.173250 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cef75-aaed-4fb3-8ada-9d28821cf334 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:59.228885 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345fb01-b2f3-4156-aa24-187336f88e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:59.229955 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345fb01-b2f3-4156-aa24-187336f88e0e None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:59.230304 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345fb01-b2f3-4156-aa24-187336f88e0e None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:59.230659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345fb01-b2f3-4156-aa24-187336f88e0e None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:59.231470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345fb01-b2f3-4156-aa24-187336f88e0e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:59.233303 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345fb01-b2f3-4156-aa24-187336f88e0e None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:59.240942 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571232dd-1979-4ed2-b8be-a54eb49c1cb0 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:59.259318 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 22/41] 10.222.0.90 () {60 vars in 1131 bytes} [Wed Nov 2 12:37:58 2022] POST /identity/v3/roles => generated 225 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:59.287975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467605ce-a15f-4f8a-bea5-ef8b61aac6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:59.288872 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467605ce-a15f-4f8a-bea5-ef8b61aac6c0 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:59.289164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467605ce-a15f-4f8a-bea5-ef8b61aac6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:59.289439 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467605ce-a15f-4f8a-bea5-ef8b61aac6c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:59.290218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467605ce-a15f-4f8a-bea5-ef8b61aac6c0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:59.291672 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467605ce-a15f-4f8a-bea5-ef8b61aac6c0 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:59.307341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5588c-76c4-4ec1-8085-a9338a90b086 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:59.307662 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5588c-76c4-4ec1-8085-a9338a90b086 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:59.307893 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5588c-76c4-4ec1-8085-a9338a90b086 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:59.309897 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 23/42] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:37:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:37:59.310141 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 20/43] 10.222.0.90 () {60 vars in 1131 bytes} [Wed Nov 2 12:37:59 2022] POST /identity/v3/roles => generated 223 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:37:59.315543 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e226fa-b56f-4957-9bce-c1e72059c60a None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:59.315840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e226fa-b56f-4957-9bce-c1e72059c60a None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:59.316125 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e226fa-b56f-4957-9bce-c1e72059c60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:59.336401 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-74e226fa-b56f-4957-9bce-c1e72059c60a None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:59.338031 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-74e226fa-b56f-4957-9bce-c1e72059c60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:59.416783 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 24/44] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:59.441891 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467605ce-a15f-4f8a-bea5-ef8b61aac6c0 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:59.556702 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467605ce-a15f-4f8a-bea5-ef8b61aac6c0 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:59.588641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa27f8-86aa-492c-a7bb-8924fe935970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:59.589471 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa27f8-86aa-492c-a7bb-8924fe935970 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:59.589751 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa27f8-86aa-492c-a7bb-8924fe935970 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:59.590023 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa27f8-86aa-492c-a7bb-8924fe935970 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:59.591392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa27f8-86aa-492c-a7bb-8924fe935970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:59.592884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa27f8-86aa-492c-a7bb-8924fe935970 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:59.594497 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 21/45] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:37:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:59.600149 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e226fa-b56f-4957-9bce-c1e72059c60a None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:59.696458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e226fa-b56f-4957-9bce-c1e72059c60a None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:59.730613 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6939f-2204-43aa-82b7-e5f372518ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:59.731284 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6939f-2204-43aa-82b7-e5f372518ad8 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:59.731572 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6939f-2204-43aa-82b7-e5f372518ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:59.731920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6939f-2204-43aa-82b7-e5f372518ad8 None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:59.732664 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6939f-2204-43aa-82b7-e5f372518ad8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:59.734159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6939f-2204-43aa-82b7-e5f372518ad8 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:59.762167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 25/46] 10.222.0.90 () {60 vars in 1141 bytes} [Wed Nov 2 12:37:59 2022] POST /identity/v3/projects => generated 312 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:38:01.415418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d7cc5-7699-471b-bfb6-6934d5cce324 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:01.415952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d7cc5-7699-471b-bfb6-6934d5cce324 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:01.415952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d7cc5-7699-471b-bfb6-6934d5cce324 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:01.417894 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 22/47] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:01.423490 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d8efc-8d42-4db0-9779-5b8b74a427ae None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:01.424106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d8efc-8d42-4db0-9779-5b8b74a427ae None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:01.424106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d8efc-8d42-4db0-9779-5b8b74a427ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:01.441840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-1e1d8efc-8d42-4db0-9779-5b8b74a427ae None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:01.443045 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1e1d8efc-8d42-4db0-9779-5b8b74a427ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:01.512807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 26/48] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:01.538052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d7cc5-7699-471b-bfb6-6934d5cce324 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:01.643306 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d7cc5-7699-471b-bfb6-6934d5cce324 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:01.677330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8268695-b74c-4a09-941b-0c6b827082af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:01.678210 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8268695-b74c-4a09-941b-0c6b827082af None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:01.678493 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8268695-b74c-4a09-941b-0c6b827082af None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:01.678765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8268695-b74c-4a09-941b-0c6b827082af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:01.691452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8268695-b74c-4a09-941b-0c6b827082af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:01.698395 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-f8268695-b74c-4a09-941b-0c6b827082af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:38:01.699668 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 23/49] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:38:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:01.706311 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d8efc-8d42-4db0-9779-5b8b74a427ae None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:01.810366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d8efc-8d42-4db0-9779-5b8b74a427ae None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:01.843608 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851d371-a12c-43f5-b13d-df6399f71492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:01.844317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851d371-a12c-43f5-b13d-df6399f71492 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:01.844606 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851d371-a12c-43f5-b13d-df6399f71492 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:01.844887 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851d371-a12c-43f5-b13d-df6399f71492 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:01.845652 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851d371-a12c-43f5-b13d-df6399f71492 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:01.845968 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851d371-a12c-43f5-b13d-df6399f71492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:01.847398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851d371-a12c-43f5-b13d-df6399f71492 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:01.855492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 27/50] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:01.861204 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8268695-b74c-4a09-941b-0c6b827082af None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:01.979910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8268695-b74c-4a09-941b-0c6b827082af None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:02.025834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17357ad1-051c-4478-b5ef-adba1d13f9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:02.026894 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17357ad1-051c-4478-b5ef-adba1d13f9bf None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:02.027182 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17357ad1-051c-4478-b5ef-adba1d13f9bf None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:02.027459 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17357ad1-051c-4478-b5ef-adba1d13f9bf None admin] PATH_INFO: `/v3/users/278e685f13c54040af7579fa7ad454a8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:02.029085 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17357ad1-051c-4478-b5ef-adba1d13f9bf None admin] RBAC: Authorizing `identity:get_user(user_id=278e685f13c54040af7579fa7ad454a8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:02.030569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17357ad1-051c-4478-b5ef-adba1d13f9bf None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:02.032667 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 24/51] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:01 2022] GET /identity/v3/users/278e685f13c54040af7579fa7ad454a8 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:02.038225 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851d371-a12c-43f5-b13d-df6399f71492 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:02.094315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a3c7c-5713-4ffd-a14d-2149156e2bd8 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:02.094575 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a3c7c-5713-4ffd-a14d-2149156e2bd8 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:02.094851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a3c7c-5713-4ffd-a14d-2149156e2bd8 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:02.097129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 25/52] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:02.102214 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630fbfa-88ba-4a5b-99dd-71bf62a83263 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:02.102501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630fbfa-88ba-4a5b-99dd-71bf62a83263 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:02.102774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630fbfa-88ba-4a5b-99dd-71bf62a83263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:02.120464 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-c630fbfa-88ba-4a5b-99dd-71bf62a83263 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:02.121639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c630fbfa-88ba-4a5b-99dd-71bf62a83263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:02.137797 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851d371-a12c-43f5-b13d-df6399f71492 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:02.171531 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c77a5-8981-4853-b884-2008ede40156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:02.172367 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c77a5-8981-4853-b884-2008ede40156 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:02.172651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c77a5-8981-4853-b884-2008ede40156 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:02.172920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c77a5-8981-4853-b884-2008ede40156 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:02.174267 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c77a5-8981-4853-b884-2008ede40156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:02.175727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c77a5-8981-4853-b884-2008ede40156 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:02.177535 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 28/53] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:38:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:02.183123 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c77a5-8981-4853-b884-2008ede40156 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:02.186918 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 26/54] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:02.209874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630fbfa-88ba-4a5b-99dd-71bf62a83263 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:02.281039 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c77a5-8981-4853-b884-2008ede40156 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:02.304530 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630fbfa-88ba-4a5b-99dd-71bf62a83263 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:02.314556 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87a3b6-3707-44b2-8bd6-c868c2cf3d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:02.315203 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87a3b6-3707-44b2-8bd6-c868c2cf3d31 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:02.315484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87a3b6-3707-44b2-8bd6-c868c2cf3d31 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:02.315749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87a3b6-3707-44b2-8bd6-c868c2cf3d31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:02.316683 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87a3b6-3707-44b2-8bd6-c868c2cf3d31 None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.domain.id=default, user.id=278e685f13c54040af7579fa7ad454a8) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:02.316925 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87a3b6-3707-44b2-8bd6-c868c2cf3d31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:02.318486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87a3b6-3707-44b2-8bd6-c868c2cf3d31 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:02.324175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 29/55] 10.222.0.90 () {56 vars in 1322 bytes} [Wed Nov 2 12:38:02 2022] GET /identity/v3/role_assignments?user.id=278e685f13c54040af7579fa7ad454a8&scope.domain.id=default&role.id=85136c55809b4d9db97c263a72392ad1 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:02.339670 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966b2d0-a66c-4eb3-b8e2-660f0b471135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:02.340549 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b2d0-a66c-4eb3-b8e2-660f0b471135 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:02.340832 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b2d0-a66c-4eb3-b8e2-660f0b471135 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:02.341183 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b2d0-a66c-4eb3-b8e2-660f0b471135 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:02.342470 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966b2d0-a66c-4eb3-b8e2-660f0b471135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:02.344005 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966b2d0-a66c-4eb3-b8e2-660f0b471135 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:02.345982 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 27/56] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:38:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:02.351962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87a3b6-3707-44b2-8bd6-c868c2cf3d31 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:02.465102 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87a3b6-3707-44b2-8bd6-c868c2cf3d31 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:02.502660 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec945d2a-f9ef-4ecf-b043-2bff70c6b459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:02.504136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec945d2a-f9ef-4ecf-b043-2bff70c6b459 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:02.504136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec945d2a-f9ef-4ecf-b043-2bff70c6b459 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:02.504136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec945d2a-f9ef-4ecf-b043-2bff70c6b459 None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:02.504803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec945d2a-f9ef-4ecf-b043-2bff70c6b459 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:02.506244 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec945d2a-f9ef-4ecf-b043-2bff70c6b459 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:02.533592 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 30/57] 10.222.0.90 () {60 vars in 1140 bytes} [Wed Nov 2 12:38:02 2022] POST /identity/v3/projects => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:38:04.888763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82771d9f-e608-445c-84f6-933c8eb3ffe0 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:04.889621 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82771d9f-e608-445c-84f6-933c8eb3ffe0 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:04.889621 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82771d9f-e608-445c-84f6-933c8eb3ffe0 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:04.892406 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 28/58] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:04.901596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277b6fa-1797-43f5-b721-91d3289b1d99 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:04.902292 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277b6fa-1797-43f5-b721-91d3289b1d99 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:04.902497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277b6fa-1797-43f5-b721-91d3289b1d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:04.922088 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-b277b6fa-1797-43f5-b721-91d3289b1d99 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:04.923283 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b277b6fa-1797-43f5-b721-91d3289b1d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:04.992663 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 31/59] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:05.025226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82771d9f-e608-445c-84f6-933c8eb3ffe0 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:05.128928 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82771d9f-e608-445c-84f6-933c8eb3ffe0 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:05.163631 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d3507-a892-4a23-8aa0-fae9a42ccf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:05.164411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d3507-a892-4a23-8aa0-fae9a42ccf8f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:05.164706 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d3507-a892-4a23-8aa0-fae9a42ccf8f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:05.164982 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d3507-a892-4a23-8aa0-fae9a42ccf8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:05.166249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d3507-a892-4a23-8aa0-fae9a42ccf8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:05.167763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d3507-a892-4a23-8aa0-fae9a42ccf8f None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:05.169496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 29/60] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:38:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:05.175327 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277b6fa-1797-43f5-b721-91d3289b1d99 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:05.287365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277b6fa-1797-43f5-b721-91d3289b1d99 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:05.324141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbb70f-f416-4199-ace3-a8761b4bc1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:05.324886 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbb70f-f416-4199-ace3-a8761b4bc1de None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:05.325173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbb70f-f416-4199-ace3-a8761b4bc1de None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:05.325484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbb70f-f416-4199-ace3-a8761b4bc1de None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:05.326192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbb70f-f416-4199-ace3-a8761b4bc1de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:05.327682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbb70f-f416-4199-ace3-a8761b4bc1de None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:05.361849 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 32/61] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:38:05 2022] POST /identity/v3/users => generated 275 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:08.978199 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa559a-ecea-4052-9267-c0ca780cff45 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:08.979248 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa559a-ecea-4052-9267-c0ca780cff45 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:08.979724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa559a-ecea-4052-9267-c0ca780cff45 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:08.982203 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 30/62] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:08.987331 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f631379-eb41-433c-b1c5-9d4eb02a7a60 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:08.987824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f631379-eb41-433c-b1c5-9d4eb02a7a60 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:08.987903 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f631379-eb41-433c-b1c5-9d4eb02a7a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.013447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-8f631379-eb41-433c-b1c5-9d4eb02a7a60 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:09.014657 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8f631379-eb41-433c-b1c5-9d4eb02a7a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:09.112079 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 33/63] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:09.147502 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa559a-ecea-4052-9267-c0ca780cff45 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:09.263237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f571b-9247-4942-832c-74e41e515e72 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.263404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f571b-9247-4942-832c-74e41e515e72 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.263663 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f571b-9247-4942-832c-74e41e515e72 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.265835 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 34/64] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:09.271485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f8427-8144-44bd-99b1-8e66dc0ddaaa None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.271775 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f8427-8144-44bd-99b1-8e66dc0ddaaa None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.272065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f8427-8144-44bd-99b1-8e66dc0ddaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.277981 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa559a-ecea-4052-9267-c0ca780cff45 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:09.306095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-d36f8427-8144-44bd-99b1-8e66dc0ddaaa None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:09.311054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-d36f8427-8144-44bd-99b1-8e66dc0ddaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:09.337684 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83105c02-8e5b-4175-b7e9-a49fc3438e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:09.338496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83105c02-8e5b-4175-b7e9-a49fc3438e9d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.338781 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83105c02-8e5b-4175-b7e9-a49fc3438e9d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.339057 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83105c02-8e5b-4175-b7e9-a49fc3438e9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.351000 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83105c02-8e5b-4175-b7e9-a49fc3438e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:09.358016 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-83105c02-8e5b-4175-b7e9-a49fc3438e9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:09.359261 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 31/65] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:09.364577 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed651b0b-c8fa-40b3-bc40-32a747a3f206 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.364875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed651b0b-c8fa-40b3-bc40-32a747a3f206 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.365156 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed651b0b-c8fa-40b3-bc40-32a747a3f206 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.367077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 32/66] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:09.368241 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b997b02-53b9-4ce1-aacc-c31a180db6d7 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.368583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b997b02-53b9-4ce1-aacc-c31a180db6d7 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.368867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b997b02-53b9-4ce1-aacc-c31a180db6d7 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.370435 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 33/67] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:09.371122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b997b02-53b9-4ce1-aacc-c31a180db6d7 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:09.392596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 35/68] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:09.393892 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb3196-456e-479e-ac89-737308d45ca4 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.394174 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb3196-456e-479e-ac89-737308d45ca4 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.394447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb3196-456e-479e-ac89-737308d45ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.411510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-63cb3196-456e-479e-ac89-737308d45ca4 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:09.413097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-63cb3196-456e-479e-ac89-737308d45ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:09.480073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 36/69] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:09.481571 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e87eb0-ca0f-4d92-b8b0-261aca78861f None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.481893 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e87eb0-ca0f-4d92-b8b0-261aca78861f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.482258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e87eb0-ca0f-4d92-b8b0-261aca78861f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.482853 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b997b02-53b9-4ce1-aacc-c31a180db6d7 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:09.498193 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-71e87eb0-ca0f-4d92-b8b0-261aca78861f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:09.499564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-71e87eb0-ca0f-4d92-b8b0-261aca78861f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:09.516334 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefba2c5-9336-4544-99ea-e51297b7d816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:09.516944 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefba2c5-9336-4544-99ea-e51297b7d816 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.517226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefba2c5-9336-4544-99ea-e51297b7d816 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.517539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefba2c5-9336-4544-99ea-e51297b7d816 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.518241 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefba2c5-9336-4544-99ea-e51297b7d816 None admin] RBAC: Adding query filter params (name=member) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:09.518544 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefba2c5-9336-4544-99ea-e51297b7d816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:09.519939 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefba2c5-9336-4544-99ea-e51297b7d816 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:09.527766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 34/70] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:09.528573 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefba2c5-9336-4544-99ea-e51297b7d816 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:09.569851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 37/71] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:09.571340 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232e4ff-0ab1-427a-9c67-d7c73bc50640 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.571624 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232e4ff-0ab1-427a-9c67-d7c73bc50640 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.571920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232e4ff-0ab1-427a-9c67-d7c73bc50640 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.573742 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 38/72] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:09.574400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232e4ff-0ab1-427a-9c67-d7c73bc50640 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:09.622710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefba2c5-9336-4544-99ea-e51297b7d816 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:09.653525 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57736c53-6d26-4687-969a-9f61a0d1c96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:09.654349 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57736c53-6d26-4687-969a-9f61a0d1c96a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.654632 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57736c53-6d26-4687-969a-9f61a0d1c96a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.654908 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57736c53-6d26-4687-969a-9f61a0d1c96a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.664721 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57736c53-6d26-4687-969a-9f61a0d1c96a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:09.671598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-57736c53-6d26-4687-969a-9f61a0d1c96a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:38:09.672820 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 35/73] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:38:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:09.673591 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57736c53-6d26-4687-969a-9f61a0d1c96a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:09.676739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232e4ff-0ab1-427a-9c67-d7c73bc50640 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:09.712438 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b4d03-86a4-47f0-934e-11a901245a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:09.713235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b4d03-86a4-47f0-934e-11a901245a4d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.713515 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b4d03-86a4-47f0-934e-11a901245a4d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.713788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b4d03-86a4-47f0-934e-11a901245a4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.723944 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b4d03-86a4-47f0-934e-11a901245a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:09.730858 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-d45b4d03-86a4-47f0-934e-11a901245a4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:09.732093 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 39/74] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:09.733277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92cc28-682e-46e8-999a-0c5c70dea59f None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.733560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92cc28-682e-46e8-999a-0c5c70dea59f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.733823 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92cc28-682e-46e8-999a-0c5c70dea59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.750138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-2a92cc28-682e-46e8-999a-0c5c70dea59f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:09.751329 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2a92cc28-682e-46e8-999a-0c5c70dea59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:09.769199 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57736c53-6d26-4687-969a-9f61a0d1c96a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:09.801277 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849dc07-2465-4ce9-80ad-73fd5cfe384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:09.802152 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849dc07-2465-4ce9-80ad-73fd5cfe384d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.802433 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849dc07-2465-4ce9-80ad-73fd5cfe384d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.802709 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849dc07-2465-4ce9-80ad-73fd5cfe384d None admin] PATH_INFO: `/v3/users/a26927c413cd49c198cd0c5719fb07c3` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.814167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 40/75] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:09.814989 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92cc28-682e-46e8-999a-0c5c70dea59f None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:09.817194 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849dc07-2465-4ce9-80ad-73fd5cfe384d None admin] RBAC: Authorizing `identity:get_user(user_id=a26927c413cd49c198cd0c5719fb07c3)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:09.818707 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849dc07-2465-4ce9-80ad-73fd5cfe384d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:09.820477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 36/76] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:09 2022] GET /identity/v3/users/a26927c413cd49c198cd0c5719fb07c3 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:09.825546 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849dc07-2465-4ce9-80ad-73fd5cfe384d None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:09.920147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92cc28-682e-46e8-999a-0c5c70dea59f None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:09.922227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849dc07-2465-4ce9-80ad-73fd5cfe384d None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:09.953403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a8971-806f-4584-b792-35f5aa576148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:09.954247 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8971-806f-4584-b792-35f5aa576148 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.954449 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403a940-539d-4ffc-a0c3-1c172e34947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:09.954551 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8971-806f-4584-b792-35f5aa576148 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.954782 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8971-806f-4584-b792-35f5aa576148 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.955238 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403a940-539d-4ffc-a0c3-1c172e34947b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.955522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403a940-539d-4ffc-a0c3-1c172e34947b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.955893 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403a940-539d-4ffc-a0c3-1c172e34947b None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.956699 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403a940-539d-4ffc-a0c3-1c172e34947b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:09.957008 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403a940-539d-4ffc-a0c3-1c172e34947b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:09.958396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403a940-539d-4ffc-a0c3-1c172e34947b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:09.964701 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a8971-806f-4584-b792-35f5aa576148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:09.966545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 37/77] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:09.967351 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403a940-539d-4ffc-a0c3-1c172e34947b None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:09.972039 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-412a8971-806f-4584-b792-35f5aa576148 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:38:09.973260 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 41/78] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:38:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:09.975114 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a8971-806f-4584-b792-35f5aa576148 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:10.065585 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403a940-539d-4ffc-a0c3-1c172e34947b None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:10.071151 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a8971-806f-4584-b792-35f5aa576148 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:10.097697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1d8a8-916c-4849-9c0f-2e99dced0ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:10.098378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1d8a8-916c-4849-9c0f-2e99dced0ffd None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:10.098662 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1d8a8-916c-4849-9c0f-2e99dced0ffd None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:10.098940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1d8a8-916c-4849-9c0f-2e99dced0ffd None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:10.099686 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1d8a8-916c-4849-9c0f-2e99dced0ffd None admin] RBAC: Adding query filter params (name=member) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:10.099993 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1d8a8-916c-4849-9c0f-2e99dced0ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:10.101676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1d8a8-916c-4849-9c0f-2e99dced0ffd None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:10.104634 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2921e5-c9fa-4098-9eed-0cb85b5b13e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:10.105295 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2921e5-c9fa-4098-9eed-0cb85b5b13e3 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:10.105567 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2921e5-c9fa-4098-9eed-0cb85b5b13e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:10.105841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2921e5-c9fa-4098-9eed-0cb85b5b13e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:10.110347 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 38/79] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:10.111201 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1d8a8-916c-4849-9c0f-2e99dced0ffd None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:10.170632 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2921e5-c9fa-4098-9eed-0cb85b5b13e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:10.172068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2921e5-c9fa-4098-9eed-0cb85b5b13e3 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:10.208224 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1d8a8-916c-4849-9c0f-2e99dced0ffd None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:10.240597 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaa11b-cb0a-4ea4-9e72-3311b6758416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:10.241418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa11b-cb0a-4ea4-9e72-3311b6758416 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:10.241686 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa11b-cb0a-4ea4-9e72-3311b6758416 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:10.242001 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa11b-cb0a-4ea4-9e72-3311b6758416 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:10.243178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaa11b-cb0a-4ea4-9e72-3311b6758416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:10.244691 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaa11b-cb0a-4ea4-9e72-3311b6758416 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:10.246296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 39/80] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:38:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:10.247056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaa11b-cb0a-4ea4-9e72-3311b6758416 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:10.270127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 42/81] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:10.270972 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2921e5-c9fa-4098-9eed-0cb85b5b13e3 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:10.343826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaa11b-cb0a-4ea4-9e72-3311b6758416 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:10.368062 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2921e5-c9fa-4098-9eed-0cb85b5b13e3 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:10.377720 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423b443-ae51-4829-92f6-64c48fd5493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:10.378840 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423b443-ae51-4829-92f6-64c48fd5493e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:10.378957 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423b443-ae51-4829-92f6-64c48fd5493e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:10.379258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423b443-ae51-4829-92f6-64c48fd5493e None admin] PATH_INFO: `/v3/users/278e685f13c54040af7579fa7ad454a8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:10.380840 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423b443-ae51-4829-92f6-64c48fd5493e None admin] RBAC: Authorizing `identity:get_user(user_id=278e685f13c54040af7579fa7ad454a8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:10.382350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423b443-ae51-4829-92f6-64c48fd5493e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:10.383992 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 40/82] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:10 2022] GET /identity/v3/users/278e685f13c54040af7579fa7ad454a8 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:10.384783 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423b443-ae51-4829-92f6-64c48fd5493e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:10.402815 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49eb1cf-e6e3-4130-a38b-5234a36a853e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:10.403493 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49eb1cf-e6e3-4130-a38b-5234a36a853e None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:10.403829 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49eb1cf-e6e3-4130-a38b-5234a36a853e None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:10.404111 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49eb1cf-e6e3-4130-a38b-5234a36a853e None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:10.404892 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49eb1cf-e6e3-4130-a38b-5234a36a853e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:10.405202 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49eb1cf-e6e3-4130-a38b-5234a36a853e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:10.406940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49eb1cf-e6e3-4130-a38b-5234a36a853e None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:10.414621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 43/83] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:38:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:10.415397 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49eb1cf-e6e3-4130-a38b-5234a36a853e None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:10.485282 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423b443-ae51-4829-92f6-64c48fd5493e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:10.510196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49eb1cf-e6e3-4130-a38b-5234a36a853e None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:10.519511 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932e741-142c-46de-bf36-0d6383bc783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:10.520426 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932e741-142c-46de-bf36-0d6383bc783a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:10.520710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932e741-142c-46de-bf36-0d6383bc783a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:10.520989 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932e741-142c-46de-bf36-0d6383bc783a None admin] PATH_INFO: `/v3/users/a26927c413cd49c198cd0c5719fb07c3` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:10.522232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932e741-142c-46de-bf36-0d6383bc783a None admin] RBAC: Authorizing `identity:get_user(user_id=a26927c413cd49c198cd0c5719fb07c3)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:10.523699 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932e741-142c-46de-bf36-0d6383bc783a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:10.525383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 41/84] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:10 2022] GET /identity/v3/users/a26927c413cd49c198cd0c5719fb07c3 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:10.526143 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932e741-142c-46de-bf36-0d6383bc783a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:10.543422 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348fc12-47ce-4a0f-9c7d-b500487d3348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:10.544100 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348fc12-47ce-4a0f-9c7d-b500487d3348 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:10.544408 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348fc12-47ce-4a0f-9c7d-b500487d3348 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:10.544682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348fc12-47ce-4a0f-9c7d-b500487d3348 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:10.545386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348fc12-47ce-4a0f-9c7d-b500487d3348 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:10.546859 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348fc12-47ce-4a0f-9c7d-b500487d3348 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:10.566373 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 44/85] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:38:10 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:10.567231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348fc12-47ce-4a0f-9c7d-b500487d3348 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:10.627782 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932e741-142c-46de-bf36-0d6383bc783a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:10.663900 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5ff77-5402-4dd1-96cf-e829b811c9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:10.664880 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ff77-5402-4dd1-96cf-e829b811c9dc None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:10.665170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ff77-5402-4dd1-96cf-e829b811c9dc None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:10.665447 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ff77-5402-4dd1-96cf-e829b811c9dc None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:10.666758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5ff77-5402-4dd1-96cf-e829b811c9dc None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:10.668436 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5ff77-5402-4dd1-96cf-e829b811c9dc None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:10.675895 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 42/86] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:10 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:10.675895 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5ff77-5402-4dd1-96cf-e829b811c9dc None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:10.677449 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348fc12-47ce-4a0f-9c7d-b500487d3348 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:10.712060 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda66d1-543f-4be2-bfec-afaf43ceac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:10.712910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda66d1-543f-4be2-bfec-afaf43ceac80 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:10.713194 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda66d1-543f-4be2-bfec-afaf43ceac80 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:10.713487 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda66d1-543f-4be2-bfec-afaf43ceac80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:10.774966 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5ff77-5402-4dd1-96cf-e829b811c9dc None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:10.783250 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda66d1-543f-4be2-bfec-afaf43ceac80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:10.785111 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda66d1-543f-4be2-bfec-afaf43ceac80 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:10.810183 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2529a1-e52e-4b4f-bb22-246eda76ac6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:10.811394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2529a1-e52e-4b4f-bb22-246eda76ac6a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:10.811863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2529a1-e52e-4b4f-bb22-246eda76ac6a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:10.812362 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2529a1-e52e-4b4f-bb22-246eda76ac6a None admin] PATH_INFO: `/v3/users/a26927c413cd49c198cd0c5719fb07c3` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:10.813801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2529a1-e52e-4b4f-bb22-246eda76ac6a None admin] RBAC: Authorizing `identity:get_user(user_id=a26927c413cd49c198cd0c5719fb07c3)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:10.815262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2529a1-e52e-4b4f-bb22-246eda76ac6a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:10.817838 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 43/87] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:10 2022] GET /identity/v3/users/a26927c413cd49c198cd0c5719fb07c3 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:10.817838 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2529a1-e52e-4b4f-bb22-246eda76ac6a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:10.887099 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 45/88] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:10.887979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda66d1-543f-4be2-bfec-afaf43ceac80 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:10.923740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2529a1-e52e-4b4f-bb22-246eda76ac6a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:10.958373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f00f8-5d3b-46b1-aefb-2553b8d10ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:10.959044 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f00f8-5d3b-46b1-aefb-2553b8d10ab4 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:10.959345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f00f8-5d3b-46b1-aefb-2553b8d10ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:10.959626 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f00f8-5d3b-46b1-aefb-2553b8d10ab4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:10.987086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda66d1-543f-4be2-bfec-afaf43ceac80 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:11.020805 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d4b2f-a8a4-4fea-a2c0-68cca353479b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:11.021478 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d4b2f-a8a4-4fea-a2c0-68cca353479b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:11.021758 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d4b2f-a8a4-4fea-a2c0-68cca353479b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:11.022033 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d4b2f-a8a4-4fea-a2c0-68cca353479b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:11.022875 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d4b2f-a8a4-4fea-a2c0-68cca353479b None admin] RBAC: Adding query filter params (role.id=ab7ac47ce77b490b8868c79a13a2a0aa, scope.project.id=5ec8dbf812ab46129e7de7e927d484f0, user.id=a26927c413cd49c198cd0c5719fb07c3) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:11.023187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d4b2f-a8a4-4fea-a2c0-68cca353479b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:11.024677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d4b2f-a8a4-4fea-a2c0-68cca353479b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:11.027409 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f00f8-5d3b-46b1-aefb-2553b8d10ab4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:11.028975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f00f8-5d3b-46b1-aefb-2553b8d10ab4 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:11.030702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 46/89] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:10 2022] GET /identity/v3/role_assignments?user.id=a26927c413cd49c198cd0c5719fb07c3&scope.project.id=5ec8dbf812ab46129e7de7e927d484f0&role.id=ab7ac47ce77b490b8868c79a13a2a0aa => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:11.031596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d4b2f-a8a4-4fea-a2c0-68cca353479b None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:11.132044 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 44/90] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:11.132980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f00f8-5d3b-46b1-aefb-2553b8d10ab4 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:11.134064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d4b2f-a8a4-4fea-a2c0-68cca353479b None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:11.168935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415f280-f2bf-4835-be36-523bd1653d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:11.169639 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415f280-f2bf-4835-be36-523bd1653d32 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:11.169922 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415f280-f2bf-4835-be36-523bd1653d32 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:11.170204 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415f280-f2bf-4835-be36-523bd1653d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:11.235777 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f00f8-5d3b-46b1-aefb-2553b8d10ab4 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:11.241689 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415f280-f2bf-4835-be36-523bd1653d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:11.243262 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415f280-f2bf-4835-be36-523bd1653d32 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:11.271920 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ab208-3530-4612-b929-ac354dd604b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:11.272870 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ab208-3530-4612-b929-ac354dd604b5 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:11.273139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ab208-3530-4612-b929-ac354dd604b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:11.273419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ab208-3530-4612-b929-ac354dd604b5 None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:11.274673 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ab208-3530-4612-b929-ac354dd604b5 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:11.276093 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ab208-3530-4612-b929-ac354dd604b5 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:11.277852 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 45/91] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:11 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:11.278649 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ab208-3530-4612-b929-ac354dd604b5 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:11.345601 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 47/92] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:11.346473 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415f280-f2bf-4835-be36-523bd1653d32 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:11.447638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415f280-f2bf-4835-be36-523bd1653d32 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:11.452432 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ab208-3530-4612-b929-ac354dd604b5 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:11.491710 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d82b71-f8f3-43d8-bfe0-23d046c4a831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:11.492693 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d82b71-f8f3-43d8-bfe0-23d046c4a831 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:11.492993 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d82b71-f8f3-43d8-bfe0-23d046c4a831 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:11.493287 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d82b71-f8f3-43d8-bfe0-23d046c4a831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:11.494700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d82b71-f8f3-43d8-bfe0-23d046c4a831 None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=5ec8dbf812ab46129e7de7e927d484f0, user.id=278e685f13c54040af7579fa7ad454a8) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:11.495285 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d82b71-f8f3-43d8-bfe0-23d046c4a831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:11.496966 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d82b71-f8f3-43d8-bfe0-23d046c4a831 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:11.500245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc4ba9-152e-4433-913f-77abfab91da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:11.501232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc4ba9-152e-4433-913f-77abfab91da5 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:11.501512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc4ba9-152e-4433-913f-77abfab91da5 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:11.502005 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc4ba9-152e-4433-913f-77abfab91da5 None admin] PATH_INFO: `/v3/projects/a4adbcc6aa7c4568a74b74314dadd506` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:11.505492 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc4ba9-152e-4433-913f-77abfab91da5 None admin] RBAC: Authorizing `identity:get_project(project_id=a4adbcc6aa7c4568a74b74314dadd506)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:11.506495 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 48/93] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:11 2022] GET /identity/v3/role_assignments?user.id=278e685f13c54040af7579fa7ad454a8&scope.project.id=5ec8dbf812ab46129e7de7e927d484f0&role.id=85136c55809b4d9db97c263a72392ad1 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:11.507361 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d82b71-f8f3-43d8-bfe0-23d046c4a831 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:11.513778 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc4ba9-152e-4433-913f-77abfab91da5 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:11.515926 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 46/94] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:11 2022] GET /identity/v3/projects/a4adbcc6aa7c4568a74b74314dadd506 => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:11.521744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc4ba9-152e-4433-913f-77abfab91da5 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:11.622837 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d82b71-f8f3-43d8-bfe0-23d046c4a831 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:11.660865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be135c-55d4-49c7-858c-e877a33fcd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:11.662115 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be135c-55d4-49c7-858c-e877a33fcd73 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:11.662399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be135c-55d4-49c7-858c-e877a33fcd73 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:11.662680 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be135c-55d4-49c7-858c-e877a33fcd73 None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:11.663916 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be135c-55d4-49c7-858c-e877a33fcd73 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:11.665972 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be135c-55d4-49c7-858c-e877a33fcd73 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:11.667851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 49/95] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:11 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:11.674831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be135c-55d4-49c7-858c-e877a33fcd73 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:11.770050 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc4ba9-152e-4433-913f-77abfab91da5 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:11.818859 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426da312-146d-40c6-90bc-951508444bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:11.819461 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426da312-146d-40c6-90bc-951508444bef None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:11.819737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426da312-146d-40c6-90bc-951508444bef None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:11.820009 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426da312-146d-40c6-90bc-951508444bef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:11.820886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426da312-146d-40c6-90bc-951508444bef None admin] RBAC: Adding query filter params (role.id=ab7ac47ce77b490b8868c79a13a2a0aa, scope.project.id=a4adbcc6aa7c4568a74b74314dadd506, user.id=a26927c413cd49c198cd0c5719fb07c3) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:11.821184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426da312-146d-40c6-90bc-951508444bef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:11.822634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426da312-146d-40c6-90bc-951508444bef None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:11.832061 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be135c-55d4-49c7-858c-e877a33fcd73 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:11.832660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 47/96] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:11 2022] GET /identity/v3/role_assignments?user.id=a26927c413cd49c198cd0c5719fb07c3&scope.project.id=a4adbcc6aa7c4568a74b74314dadd506&role.id=ab7ac47ce77b490b8868c79a13a2a0aa => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:11.888492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7837ca-1612-428b-a20e-7a9e40360880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:11.889185 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7837ca-1612-428b-a20e-7a9e40360880 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:11.889473 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7837ca-1612-428b-a20e-7a9e40360880 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:11.889753 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7837ca-1612-428b-a20e-7a9e40360880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:11.890610 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7837ca-1612-428b-a20e-7a9e40360880 None admin] RBAC: Adding query filter params (role.id=7b4e238c731941f18493cd62e30b1e4f, scope.project.id=5ec8dbf812ab46129e7de7e927d484f0, user.id=a26927c413cd49c198cd0c5719fb07c3) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:11.890931 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7837ca-1612-428b-a20e-7a9e40360880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:11.892475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7837ca-1612-428b-a20e-7a9e40360880 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:11.906554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 50/97] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:11 2022] GET /identity/v3/role_assignments?user.id=a26927c413cd49c198cd0c5719fb07c3&scope.project.id=5ec8dbf812ab46129e7de7e927d484f0&role.id=7b4e238c731941f18493cd62e30b1e4f => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:13.690793 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb300408-bcac-4f43-a2d4-0342ced44c72 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:13.691806 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb300408-bcac-4f43-a2d4-0342ced44c72 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:13.692318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb300408-bcac-4f43-a2d4-0342ced44c72 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:13.694628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 48/98] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:13.699671 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d278a1-23f6-4d4b-b251-dd5b28e74684 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:13.700558 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d278a1-23f6-4d4b-b251-dd5b28e74684 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:13.701038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d278a1-23f6-4d4b-b251-dd5b28e74684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:13.726060 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-74d278a1-23f6-4d4b-b251-dd5b28e74684 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:13.727681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-74d278a1-23f6-4d4b-b251-dd5b28e74684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:13.814920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 51/99] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:13.862516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb300408-bcac-4f43-a2d4-0342ced44c72 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:13.961336 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff994ad1-9dee-4ffc-8894-3bb402342e4c None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:13.961716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff994ad1-9dee-4ffc-8894-3bb402342e4c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:13.961930 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff994ad1-9dee-4ffc-8894-3bb402342e4c None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:13.963739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 52/100] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:38:13.971423 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7e51f-c95f-4ae7-be64-5e23097d6557 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:13.971423 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7e51f-c95f-4ae7-be64-5e23097d6557 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:13.971423 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7e51f-c95f-4ae7-be64-5e23097d6557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:13.986620 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb300408-bcac-4f43-a2d4-0342ced44c72 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:13.992000 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-0ae7e51f-c95f-4ae7-be64-5e23097d6557 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:13.993284 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0ae7e51f-c95f-4ae7-be64-5e23097d6557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:14.026201 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652234b4-706c-4891-8314-bf88487e22cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:14.027981 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652234b4-706c-4891-8314-bf88487e22cc None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:14.028481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652234b4-706c-4891-8314-bf88487e22cc None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:14.029587 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652234b4-706c-4891-8314-bf88487e22cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:14.031822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652234b4-706c-4891-8314-bf88487e22cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:14.033487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652234b4-706c-4891-8314-bf88487e22cc None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:14.035486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 49/101] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:38:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:14.042279 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652234b4-706c-4891-8314-bf88487e22cc None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:14.081178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 53/102] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:14.109531 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7e51f-c95f-4ae7-be64-5e23097d6557 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:14.203189 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652234b4-706c-4891-8314-bf88487e22cc None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:14.273593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7e51f-c95f-4ae7-be64-5e23097d6557 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:14.277392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583ae24-bf5b-4bc0-9c7b-b542b7add0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:14.278293 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583ae24-bf5b-4bc0-9c7b-b542b7add0c7 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:14.278844 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583ae24-bf5b-4bc0-9c7b-b542b7add0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:14.279314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583ae24-bf5b-4bc0-9c7b-b542b7add0c7 None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:14.280658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583ae24-bf5b-4bc0-9c7b-b542b7add0c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:14.282308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583ae24-bf5b-4bc0-9c7b-b542b7add0c7 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:14.325587 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 50/103] 10.222.0.90 () {60 vars in 1141 bytes} [Wed Nov 2 12:38:14 2022] POST /identity/v3/projects => generated 302 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:14.329688 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65c6d5-02f6-441e-8370-89e7c9072911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:14.330489 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65c6d5-02f6-441e-8370-89e7c9072911 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:14.330769 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65c6d5-02f6-441e-8370-89e7c9072911 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:14.331037 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65c6d5-02f6-441e-8370-89e7c9072911 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:14.354259 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65c6d5-02f6-441e-8370-89e7c9072911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:14.361752 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-ee65c6d5-02f6-441e-8370-89e7c9072911 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:38:14.363265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 54/104] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:14.369576 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583ae24-bf5b-4bc0-9c7b-b542b7add0c7 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:14.521224 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583ae24-bf5b-4bc0-9c7b-b542b7add0c7 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:14.562590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f55d05-20f6-4262-b3f8-e0c24824fe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:14.563595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f55d05-20f6-4262-b3f8-e0c24824fe1d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:14.564282 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f55d05-20f6-4262-b3f8-e0c24824fe1d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:14.564837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f55d05-20f6-4262-b3f8-e0c24824fe1d None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:14.565782 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f55d05-20f6-4262-b3f8-e0c24824fe1d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:14.566280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f55d05-20f6-4262-b3f8-e0c24824fe1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:14.567848 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f55d05-20f6-4262-b3f8-e0c24824fe1d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:14.580081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 51/105] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:14.581861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7410a-4ada-4ef2-80c2-027e662ca8bd None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:14.582154 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7410a-4ada-4ef2-80c2-027e662ca8bd None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:14.582436 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7410a-4ada-4ef2-80c2-027e662ca8bd None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:14.584296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 55/106] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:14.585727 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f55d05-20f6-4262-b3f8-e0c24824fe1d None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:14.598088 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c00c8e-bd88-4ca3-a214-1e6d905a2ce3 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:14.598409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c00c8e-bd88-4ca3-a214-1e6d905a2ce3 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:14.598652 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c00c8e-bd88-4ca3-a214-1e6d905a2ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:14.633470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-32c00c8e-bd88-4ca3-a214-1e6d905a2ce3 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:14.634677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-32c00c8e-bd88-4ca3-a214-1e6d905a2ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:14.732038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 56/107] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:14.742907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f55d05-20f6-4262-b3f8-e0c24824fe1d None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:14.774801 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c00c8e-bd88-4ca3-a214-1e6d905a2ce3 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:14.793587 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4039d1-4997-466f-80c9-59c225a19e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:14.794552 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4039d1-4997-466f-80c9-59c225a19e0e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:14.794832 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4039d1-4997-466f-80c9-59c225a19e0e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:14.795101 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4039d1-4997-466f-80c9-59c225a19e0e None admin] PATH_INFO: `/v3/users/9edb6c80152a46b899c4771601d162d8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:14.826173 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4039d1-4997-466f-80c9-59c225a19e0e None admin] RBAC: Authorizing `identity:get_user(user_id=9edb6c80152a46b899c4771601d162d8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:14.827604 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4039d1-4997-466f-80c9-59c225a19e0e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:14.829393 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 52/108] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:14 2022] GET /identity/v3/users/9edb6c80152a46b899c4771601d162d8 => generated 289 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:14.840741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4039d1-4997-466f-80c9-59c225a19e0e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:14.932987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c00c8e-bd88-4ca3-a214-1e6d905a2ce3 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:14.972760 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726322c-ee79-43b1-8b74-36aa99246766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:14.973664 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726322c-ee79-43b1-8b74-36aa99246766 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:14.973944 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726322c-ee79-43b1-8b74-36aa99246766 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:14.974211 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726322c-ee79-43b1-8b74-36aa99246766 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:14.981671 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4039d1-4997-466f-80c9-59c225a19e0e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:14.985692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726322c-ee79-43b1-8b74-36aa99246766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:14.992974 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-6726322c-ee79-43b1-8b74-36aa99246766 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:38:14.994262 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 57/109] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:38:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:15.000104 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726322c-ee79-43b1-8b74-36aa99246766 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:15.019463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca471705-82d5-4118-b01a-62ab95247b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:15.020286 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca471705-82d5-4118-b01a-62ab95247b8b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.020575 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca471705-82d5-4118-b01a-62ab95247b8b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.021021 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca471705-82d5-4118-b01a-62ab95247b8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.096906 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca471705-82d5-4118-b01a-62ab95247b8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:15.098331 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca471705-82d5-4118-b01a-62ab95247b8b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:15.102576 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726322c-ee79-43b1-8b74-36aa99246766 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:15.139058 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a8017-8944-461c-a78d-f90c575c6aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:15.139757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a8017-8944-461c-a78d-f90c575c6aeb None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.140038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a8017-8944-461c-a78d-f90c575c6aeb None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.140344 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a8017-8944-461c-a78d-f90c575c6aeb None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.141167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a8017-8944-461c-a78d-f90c575c6aeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:15.141476 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a8017-8944-461c-a78d-f90c575c6aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:15.143117 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a8017-8944-461c-a78d-f90c575c6aeb None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:15.152644 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 58/110] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:15.154218 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cee32-703d-40dd-bb09-294202a1e012 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.154502 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cee32-703d-40dd-bb09-294202a1e012 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.154778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cee32-703d-40dd-bb09-294202a1e012 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.161912 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 59/111] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:15.162705 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cee32-703d-40dd-bb09-294202a1e012 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:15.204172 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 53/112] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:15.205786 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0388470-3dbf-4016-835d-3a031b2a8e6d None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.206074 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0388470-3dbf-4016-835d-3a031b2a8e6d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.206350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0388470-3dbf-4016-835d-3a031b2a8e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.228870 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e0388470-3dbf-4016-835d-3a031b2a8e6d None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:15.230618 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e0388470-3dbf-4016-835d-3a031b2a8e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:15.312851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 54/113] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:15.314394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0388470-3dbf-4016-835d-3a031b2a8e6d None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:15.315013 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cee32-703d-40dd-bb09-294202a1e012 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:15.402424 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ca068-a49b-4543-ad96-83d2eb270da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:15.403763 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ca068-a49b-4543-ad96-83d2eb270da8 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.404193 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ca068-a49b-4543-ad96-83d2eb270da8 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.404640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ca068-a49b-4543-ad96-83d2eb270da8 None admin] PATH_INFO: `/v3/users/278e685f13c54040af7579fa7ad454a8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.412988 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ca068-a49b-4543-ad96-83d2eb270da8 None admin] RBAC: Authorizing `identity:get_user(user_id=278e685f13c54040af7579fa7ad454a8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:15.414660 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ca068-a49b-4543-ad96-83d2eb270da8 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:15.416686 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 60/114] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:15 2022] GET /identity/v3/users/278e685f13c54040af7579fa7ad454a8 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:15.417675 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ca068-a49b-4543-ad96-83d2eb270da8 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:15.419809 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0388470-3dbf-4016-835d-3a031b2a8e6d None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:15.459394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1386d62-04e7-41b0-8273-819cd8f21814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:15.462607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1386d62-04e7-41b0-8273-819cd8f21814 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.462607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1386d62-04e7-41b0-8273-819cd8f21814 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.462607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1386d62-04e7-41b0-8273-819cd8f21814 None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.462607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1386d62-04e7-41b0-8273-819cd8f21814 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:15.463958 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1386d62-04e7-41b0-8273-819cd8f21814 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:15.466185 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 55/115] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:15 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:15.467312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1386d62-04e7-41b0-8273-819cd8f21814 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:15.570399 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1386d62-04e7-41b0-8273-819cd8f21814 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:15.612030 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ca068-a49b-4543-ad96-83d2eb270da8 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:15.613520 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee67429-e8cd-41b1-bb85-ea63e5a416da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:15.614477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee67429-e8cd-41b1-bb85-ea63e5a416da None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.614753 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee67429-e8cd-41b1-bb85-ea63e5a416da None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.615072 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee67429-e8cd-41b1-bb85-ea63e5a416da None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.616926 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee67429-e8cd-41b1-bb85-ea63e5a416da None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:15.618371 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee67429-e8cd-41b1-bb85-ea63e5a416da None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:15.620078 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 56/116] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:15 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:15.620943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee67429-e8cd-41b1-bb85-ea63e5a416da None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:15.664382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87418b5-6fe8-46f9-9eb0-57836187ae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:15.665084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87418b5-6fe8-46f9-9eb0-57836187ae14 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.665370 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87418b5-6fe8-46f9-9eb0-57836187ae14 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.665645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87418b5-6fe8-46f9-9eb0-57836187ae14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.676235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87418b5-6fe8-46f9-9eb0-57836187ae14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:15.683290 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-e87418b5-6fe8-46f9-9eb0-57836187ae14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:15.684584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 61/117] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:15.685959 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87418b5-6fe8-46f9-9eb0-57836187ae14 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:15.751113 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee67429-e8cd-41b1-bb85-ea63e5a416da None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:15.785993 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8fd69-a2d4-4530-9ca4-fa7dfc3e3bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:15.786994 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8fd69-a2d4-4530-9ca4-fa7dfc3e3bd6 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.787426 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87418b5-6fe8-46f9-9eb0-57836187ae14 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:15.788012 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8fd69-a2d4-4530-9ca4-fa7dfc3e3bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.788503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8fd69-a2d4-4530-9ca4-fa7dfc3e3bd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.789532 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8fd69-a2d4-4530-9ca4-fa7dfc3e3bd6 None admin] RBAC: Adding query filter params (role.id=0174fdbdbb3946bdb17aded65287dd75, scope.project.id=5ec8dbf812ab46129e7de7e927d484f0, user.id=9edb6c80152a46b899c4771601d162d8) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:15.790058 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8fd69-a2d4-4530-9ca4-fa7dfc3e3bd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:15.791752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8fd69-a2d4-4530-9ca4-fa7dfc3e3bd6 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:15.797608 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 57/118] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:15 2022] GET /identity/v3/role_assignments?user.id=9edb6c80152a46b899c4771601d162d8&scope.project.id=5ec8dbf812ab46129e7de7e927d484f0&role.id=0174fdbdbb3946bdb17aded65287dd75 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:15.799501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e24c-ea0c-4b54-a532-1330d2e72690 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.800009 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e24c-ea0c-4b54-a532-1330d2e72690 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.800509 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e24c-ea0c-4b54-a532-1330d2e72690 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.806897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 58/119] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:15.808252 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9e24c-ea0c-4b54-a532-1330d2e72690 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:15.823674 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882347e-d921-4e2b-ac5b-6063f8e1ff71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:15.824617 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882347e-d921-4e2b-ac5b-6063f8e1ff71 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.824986 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882347e-d921-4e2b-ac5b-6063f8e1ff71 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.825167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882347e-d921-4e2b-ac5b-6063f8e1ff71 None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0/users/278e685f13c54040af7579fa7ad454a8/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.827211 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882347e-d921-4e2b-ac5b-6063f8e1ff71 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ec8dbf812ab46129e7de7e927d484f0, user_id=278e685f13c54040af7579fa7ad454a8, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:15.828709 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882347e-d921-4e2b-ac5b-6063f8e1ff71 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:15.856597 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 62/120] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:38:15 2022] PUT /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0/users/278e685f13c54040af7579fa7ad454a8/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:15.858167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe6d66-a019-4ece-97a2-391f2c03dec9 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.858470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe6d66-a019-4ece-97a2-391f2c03dec9 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.858863 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe6d66-a019-4ece-97a2-391f2c03dec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.897912 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-64fe6d66-a019-4ece-97a2-391f2c03dec9 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:15.898729 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-64fe6d66-a019-4ece-97a2-391f2c03dec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:15.931835 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9e24c-ea0c-4b54-a532-1330d2e72690 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:15.974399 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d17759-76b5-49bd-a0a5-f2e645df718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:15.975558 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d17759-76b5-49bd-a0a5-f2e645df718a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.976046 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d17759-76b5-49bd-a0a5-f2e645df718a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.976577 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d17759-76b5-49bd-a0a5-f2e645df718a None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.977561 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d17759-76b5-49bd-a0a5-f2e645df718a None admin] RBAC: Adding query filter params (name=member) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:15.978069 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d17759-76b5-49bd-a0a5-f2e645df718a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:15.979667 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d17759-76b5-49bd-a0a5-f2e645df718a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:15.989916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 59/121] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:16.021676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d17759-76b5-49bd-a0a5-f2e645df718a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.031586 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 63/122] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:16.054230 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe6d66-a019-4ece-97a2-391f2c03dec9 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.161392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d17759-76b5-49bd-a0a5-f2e645df718a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:16.163428 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe6d66-a019-4ece-97a2-391f2c03dec9 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:16.197989 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87a163-1458-43f1-a22f-4b9e39b00d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.199122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a163-1458-43f1-a22f-4b9e39b00d6a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.199553 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a163-1458-43f1-a22f-4b9e39b00d6a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.199971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a163-1458-43f1-a22f-4b9e39b00d6a None admin] PATH_INFO: `/v3/users/a26927c413cd49c198cd0c5719fb07c3` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.205011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2449286-45e7-47a8-9c42-f3e46f6536d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.206000 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87a163-1458-43f1-a22f-4b9e39b00d6a None admin] RBAC: Authorizing `identity:get_user(user_id=a26927c413cd49c198cd0c5719fb07c3)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:16.207180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2449286-45e7-47a8-9c42-f3e46f6536d2 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.209219 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2449286-45e7-47a8-9c42-f3e46f6536d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.209654 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2449286-45e7-47a8-9c42-f3e46f6536d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.210367 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87a163-1458-43f1-a22f-4b9e39b00d6a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:16.214177 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 60/123] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:16 2022] GET /identity/v3/users/a26927c413cd49c198cd0c5719fb07c3 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:16.216585 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04251193-d29c-4622-8ef5-cf995e8da83f None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.219256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04251193-d29c-4622-8ef5-cf995e8da83f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.219716 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04251193-d29c-4622-8ef5-cf995e8da83f None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.221884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 61/124] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:16.223961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04251193-d29c-4622-8ef5-cf995e8da83f None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.236911 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2449286-45e7-47a8-9c42-f3e46f6536d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:16.244472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-d2449286-45e7-47a8-9c42-f3e46f6536d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:38:16.245903 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 64/125] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:38:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:38:16.247224 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42cd6d-59d5-4328-bb45-b6935e4d0741 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.247633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42cd6d-59d5-4328-bb45-b6935e4d0741 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.248012 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42cd6d-59d5-4328-bb45-b6935e4d0741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.269974 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-dc42cd6d-59d5-4328-bb45-b6935e4d0741 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:16.271294 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-dc42cd6d-59d5-4328-bb45-b6935e4d0741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:16.341976 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04251193-d29c-4622-8ef5-cf995e8da83f None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:16.346691 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 65/126] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:16.347773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42cd6d-59d5-4328-bb45-b6935e4d0741 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.396953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8e26f-cb45-43cb-8061-ad6aa1a931ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.398066 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8e26f-cb45-43cb-8061-ad6aa1a931ce None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.398477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8e26f-cb45-43cb-8061-ad6aa1a931ce None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.398900 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8e26f-cb45-43cb-8061-ad6aa1a931ce None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.400258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8e26f-cb45-43cb-8061-ad6aa1a931ce None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:16.401884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8e26f-cb45-43cb-8061-ad6aa1a931ce None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:16.410008 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 62/127] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:16 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:16.414030 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8e26f-cb45-43cb-8061-ad6aa1a931ce None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.468926 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42cd6d-59d5-4328-bb45-b6935e4d0741 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:16.519486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93ed38-5c65-43d7-891a-120e98027e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.520852 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93ed38-5c65-43d7-891a-120e98027e6c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.523869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93ed38-5c65-43d7-891a-120e98027e6c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.524280 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93ed38-5c65-43d7-891a-120e98027e6c None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.525150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93ed38-5c65-43d7-891a-120e98027e6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:16.525611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93ed38-5c65-43d7-891a-120e98027e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:16.527179 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93ed38-5c65-43d7-891a-120e98027e6c None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:16.537859 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 66/128] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:38:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:16.539075 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93ed38-5c65-43d7-891a-120e98027e6c None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.627752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8e26f-cb45-43cb-8061-ad6aa1a931ce None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:16.669210 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6639e26-b4b1-4916-b54e-518d583c00e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.670080 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6639e26-b4b1-4916-b54e-518d583c00e1 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.671105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6639e26-b4b1-4916-b54e-518d583c00e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.671385 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6639e26-b4b1-4916-b54e-518d583c00e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.696087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6639e26-b4b1-4916-b54e-518d583c00e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:16.709114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-f6639e26-b4b1-4916-b54e-518d583c00e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:16.710404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 63/129] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:16.717069 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6639e26-b4b1-4916-b54e-518d583c00e1 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.752814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93ed38-5c65-43d7-891a-120e98027e6c None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:16.793305 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58f0c1-731d-4163-92fd-41b1ced41de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.796593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58f0c1-731d-4163-92fd-41b1ced41de1 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.796883 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58f0c1-731d-4163-92fd-41b1ced41de1 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.797153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58f0c1-731d-4163-92fd-41b1ced41de1 None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0/users/a26927c413cd49c198cd0c5719fb07c3/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.802401 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58f0c1-731d-4163-92fd-41b1ced41de1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ec8dbf812ab46129e7de7e927d484f0, user_id=a26927c413cd49c198cd0c5719fb07c3, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:16.803904 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58f0c1-731d-4163-92fd-41b1ced41de1 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:16.831407 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 67/130] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:38:16 2022] PUT /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0/users/a26927c413cd49c198cd0c5719fb07c3/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:16.838132 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58f0c1-731d-4163-92fd-41b1ced41de1 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.923147 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6639e26-b4b1-4916-b54e-518d583c00e1 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:16.968861 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d465a3d-1d08-4d6d-ac8b-ea52a09c9e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.969716 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d465a3d-1d08-4d6d-ac8b-ea52a09c9e43 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.970003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d465a3d-1d08-4d6d-ac8b-ea52a09c9e43 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.970415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d465a3d-1d08-4d6d-ac8b-ea52a09c9e43 None admin] PATH_INFO: `/v3/users/a26927c413cd49c198cd0c5719fb07c3` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.974048 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d465a3d-1d08-4d6d-ac8b-ea52a09c9e43 None admin] RBAC: Authorizing `identity:get_user(user_id=a26927c413cd49c198cd0c5719fb07c3)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:16.975560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d465a3d-1d08-4d6d-ac8b-ea52a09c9e43 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:16.977411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 64/131] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:16 2022] GET /identity/v3/users/a26927c413cd49c198cd0c5719fb07c3 => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:16.983807 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d465a3d-1d08-4d6d-ac8b-ea52a09c9e43 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:17.080591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58f0c1-731d-4163-92fd-41b1ced41de1 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:17.115323 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d465a3d-1d08-4d6d-ac8b-ea52a09c9e43 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:17.149575 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b618fda-0c89-47fc-8d71-501bff5d8311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:17.150325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b618fda-0c89-47fc-8d71-501bff5d8311 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:17.150609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b618fda-0c89-47fc-8d71-501bff5d8311 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:17.150877 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b618fda-0c89-47fc-8d71-501bff5d8311 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:17.151680 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b618fda-0c89-47fc-8d71-501bff5d8311 None admin] RBAC: Adding query filter params (name=member) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:17.151990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b618fda-0c89-47fc-8d71-501bff5d8311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:17.154083 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b618fda-0c89-47fc-8d71-501bff5d8311 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:17.166576 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 68/132] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:17.171773 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dcf4d-fd8e-451d-85a2-030f4465d7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:17.173695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b618fda-0c89-47fc-8d71-501bff5d8311 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:17.174218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dcf4d-fd8e-451d-85a2-030f4465d7f0 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:17.174504 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dcf4d-fd8e-451d-85a2-030f4465d7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:17.175232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dcf4d-fd8e-451d-85a2-030f4465d7f0 None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:17.179164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dcf4d-fd8e-451d-85a2-030f4465d7f0 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:17.180662 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dcf4d-fd8e-451d-85a2-030f4465d7f0 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:17.182389 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 65/133] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:16 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:17.189793 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dcf4d-fd8e-451d-85a2-030f4465d7f0 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:17.336248 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dcf4d-fd8e-451d-85a2-030f4465d7f0 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:17.376410 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014b7ee-a9a0-4834-be2f-6abdf3972f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:17.377437 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014b7ee-a9a0-4834-be2f-6abdf3972f4d None admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:17.377707 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014b7ee-a9a0-4834-be2f-6abdf3972f4d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:17.377979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014b7ee-a9a0-4834-be2f-6abdf3972f4d None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0/users/a26927c413cd49c198cd0c5719fb07c3/roles/7b4e238c731941f18493cd62e30b1e4f` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:17.384094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014b7ee-a9a0-4834-be2f-6abdf3972f4d None admin] RBAC: Authorizing `identity:create_grant(project_id=5ec8dbf812ab46129e7de7e927d484f0, user_id=a26927c413cd49c198cd0c5719fb07c3, role_id=7b4e238c731941f18493cd62e30b1e4f)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:17.386409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b618fda-0c89-47fc-8d71-501bff5d8311 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:17.389368 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014b7ee-a9a0-4834-be2f-6abdf3972f4d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:17.415382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 66/134] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:38:17 2022] PUT /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0/users/a26927c413cd49c198cd0c5719fb07c3/roles/7b4e238c731941f18493cd62e30b1e4f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:17.445958 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d36b1e-fcec-476e-b710-086589fd3bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:17.446927 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d36b1e-fcec-476e-b710-086589fd3bb8 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:17.447210 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d36b1e-fcec-476e-b710-086589fd3bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:17.447483 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d36b1e-fcec-476e-b710-086589fd3bb8 None admin] PATH_INFO: `/v3/users/a26927c413cd49c198cd0c5719fb07c3` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:17.448778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d36b1e-fcec-476e-b710-086589fd3bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=a26927c413cd49c198cd0c5719fb07c3)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:17.450392 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d36b1e-fcec-476e-b710-086589fd3bb8 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:17.452633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 69/135] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:17 2022] GET /identity/v3/users/a26927c413cd49c198cd0c5719fb07c3 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:17.459346 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014b7ee-a9a0-4834-be2f-6abdf3972f4d None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:17.596350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014b7ee-a9a0-4834-be2f-6abdf3972f4d None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:17.646445 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c57355-59f7-465b-9317-7822801a8dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:17.647351 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c57355-59f7-465b-9317-7822801a8dc0 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:17.647633 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c57355-59f7-465b-9317-7822801a8dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:17.647907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c57355-59f7-465b-9317-7822801a8dc0 None admin] PATH_INFO: `/v3/projects/a4adbcc6aa7c4568a74b74314dadd506` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:17.649284 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c57355-59f7-465b-9317-7822801a8dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=a4adbcc6aa7c4568a74b74314dadd506)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:17.650790 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c57355-59f7-465b-9317-7822801a8dc0 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:17.652656 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 67/136] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:17 2022] GET /identity/v3/projects/a4adbcc6aa7c4568a74b74314dadd506 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:17.659165 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d36b1e-fcec-476e-b710-086589fd3bb8 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:17.765710 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d36b1e-fcec-476e-b710-086589fd3bb8 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:17.808800 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40ecc4-28d7-4066-88ff-3704136b81ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:17.811096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40ecc4-28d7-4066-88ff-3704136b81ee None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:17.811096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40ecc4-28d7-4066-88ff-3704136b81ee None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:17.811096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40ecc4-28d7-4066-88ff-3704136b81ee None admin] PATH_INFO: `/v3/projects/a4adbcc6aa7c4568a74b74314dadd506/users/a26927c413cd49c198cd0c5719fb07c3/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:17.813253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40ecc4-28d7-4066-88ff-3704136b81ee None admin] RBAC: Authorizing `identity:create_grant(project_id=a4adbcc6aa7c4568a74b74314dadd506, user_id=a26927c413cd49c198cd0c5719fb07c3, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:17.816223 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40ecc4-28d7-4066-88ff-3704136b81ee None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:17.829958 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3714f-dedc-449f-93c4-ba2dc483f4ad None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:17.830298 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3714f-dedc-449f-93c4-ba2dc483f4ad None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:17.830640 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3714f-dedc-449f-93c4-ba2dc483f4ad None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:17.832829 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 68/137] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:17.833750 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 70/138] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:38:17 2022] PUT /identity/v3/projects/a4adbcc6aa7c4568a74b74314dadd506/users/a26927c413cd49c198cd0c5719fb07c3/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:17.850537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191f957-38af-4a7f-8e17-ccd7485421f7 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:17.850871 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191f957-38af-4a7f-8e17-ccd7485421f7 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:17.851045 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191f957-38af-4a7f-8e17-ccd7485421f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:17.875168 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-c191f957-38af-4a7f-8e17-ccd7485421f7 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:17.876556 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c191f957-38af-4a7f-8e17-ccd7485421f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:17.975947 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 69/139] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:18.030442 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40ecc4-28d7-4066-88ff-3704136b81ee None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:18.144429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40ecc4-28d7-4066-88ff-3704136b81ee None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:18.184821 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175636a5-106f-466c-ac8c-8542cfb1485d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:18.185690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175636a5-106f-466c-ac8c-8542cfb1485d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:18.185998 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175636a5-106f-466c-ac8c-8542cfb1485d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:18.186306 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175636a5-106f-466c-ac8c-8542cfb1485d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:18.187588 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175636a5-106f-466c-ac8c-8542cfb1485d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:18.189208 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175636a5-106f-466c-ac8c-8542cfb1485d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:18.191103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 71/140] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:38:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:18.197138 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191f957-38af-4a7f-8e17-ccd7485421f7 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:18.319952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191f957-38af-4a7f-8e17-ccd7485421f7 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:18.364936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16791537-b2fd-4a2f-be0d-def0b311fd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:18.365691 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16791537-b2fd-4a2f-be0d-def0b311fd13 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:18.366018 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16791537-b2fd-4a2f-be0d-def0b311fd13 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:18.366299 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16791537-b2fd-4a2f-be0d-def0b311fd13 None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:18.367031 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16791537-b2fd-4a2f-be0d-def0b311fd13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:18.368576 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16791537-b2fd-4a2f-be0d-def0b311fd13 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:18.403387 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 70/141] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:38:18 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:18.832306 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b3837-615f-4ed3-95cd-f3f105af4a19 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:18.833022 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b3837-615f-4ed3-95cd-f3f105af4a19 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:18.833022 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b3837-615f-4ed3-95cd-f3f105af4a19 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:18.834941 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 72/142] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:18.839903 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c15ea4-e45a-4d84-bd29-34c580ef6dcf None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:18.840228 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c15ea4-e45a-4d84-bd29-34c580ef6dcf None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:18.840514 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c15ea4-e45a-4d84-bd29-34c580ef6dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:18.865189 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-31c15ea4-e45a-4d84-bd29-34c580ef6dcf None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:18.866405 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-31c15ea4-e45a-4d84-bd29-34c580ef6dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:18.946350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 71/143] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:18.984964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b3837-615f-4ed3-95cd-f3f105af4a19 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:19.101955 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b3837-615f-4ed3-95cd-f3f105af4a19 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:19.144000 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38f99d-bdbc-4f56-be9e-380b7e342607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:19.144860 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38f99d-bdbc-4f56-be9e-380b7e342607 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:19.145144 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38f99d-bdbc-4f56-be9e-380b7e342607 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:19.145420 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38f99d-bdbc-4f56-be9e-380b7e342607 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:19.161266 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38f99d-bdbc-4f56-be9e-380b7e342607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:19.168391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-2f38f99d-bdbc-4f56-be9e-380b7e342607 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:38:19.169714 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 73/144] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:38:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:19.175643 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c15ea4-e45a-4d84-bd29-34c580ef6dcf None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:19.284117 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c15ea4-e45a-4d84-bd29-34c580ef6dcf None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:19.327424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5910d-88f6-44cc-a6a9-898b201a19c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:19.328121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5910d-88f6-44cc-a6a9-898b201a19c6 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:19.328431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5910d-88f6-44cc-a6a9-898b201a19c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:19.328711 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5910d-88f6-44cc-a6a9-898b201a19c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:19.329490 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5910d-88f6-44cc-a6a9-898b201a19c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:19.329833 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5910d-88f6-44cc-a6a9-898b201a19c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:19.331357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5910d-88f6-44cc-a6a9-898b201a19c6 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:19.333474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c215-a698-40a4-95ef-8c0bf069511a None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:19.333759 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c215-a698-40a4-95ef-8c0bf069511a None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:19.334056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c215-a698-40a4-95ef-8c0bf069511a None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:19.336081 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 74/145] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:19.341508 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813183b-0cd7-4aea-ae44-6e69fe907a96 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:19.341792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813183b-0cd7-4aea-ae44-6e69fe907a96 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:19.342073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813183b-0cd7-4aea-ae44-6e69fe907a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:19.351546 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 72/146] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:19.357496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5910d-88f6-44cc-a6a9-898b201a19c6 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:19.362246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-6813183b-0cd7-4aea-ae44-6e69fe907a96 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:19.363448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6813183b-0cd7-4aea-ae44-6e69fe907a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:19.452298 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 75/147] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:19.483176 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5910d-88f6-44cc-a6a9-898b201a19c6 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:19.484223 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813183b-0cd7-4aea-ae44-6e69fe907a96 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:19.527719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a32bfb-f52a-4af6-99ba-117d52337f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:19.528703 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a32bfb-f52a-4af6-99ba-117d52337f11 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:19.529617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a32bfb-f52a-4af6-99ba-117d52337f11 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:19.529617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a32bfb-f52a-4af6-99ba-117d52337f11 None admin] PATH_INFO: `/v3/users/278e685f13c54040af7579fa7ad454a8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:19.530983 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a32bfb-f52a-4af6-99ba-117d52337f11 None admin] RBAC: Authorizing `identity:get_user(user_id=278e685f13c54040af7579fa7ad454a8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:19.532599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a32bfb-f52a-4af6-99ba-117d52337f11 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:19.534370 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 73/148] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:19 2022] GET /identity/v3/users/278e685f13c54040af7579fa7ad454a8 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:19.540554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a32bfb-f52a-4af6-99ba-117d52337f11 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:19.606744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813183b-0cd7-4aea-ae44-6e69fe907a96 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:19.642220 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7413db-56e3-4954-947d-5924fd07c73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:19.643328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7413db-56e3-4954-947d-5924fd07c73a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:19.643777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7413db-56e3-4954-947d-5924fd07c73a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:19.644235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7413db-56e3-4954-947d-5924fd07c73a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:19.655498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7413db-56e3-4954-947d-5924fd07c73a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:19.663171 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-0f7413db-56e3-4954-947d-5924fd07c73a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:38:19.668335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 76/149] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:19.671195 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7413db-56e3-4954-947d-5924fd07c73a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:19.675696 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a32bfb-f52a-4af6-99ba-117d52337f11 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:19.720619 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79612e1-2a4f-46e8-98ac-0ad15e6377cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:19.721291 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79612e1-2a4f-46e8-98ac-0ad15e6377cc None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:19.721581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79612e1-2a4f-46e8-98ac-0ad15e6377cc None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:19.721862 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79612e1-2a4f-46e8-98ac-0ad15e6377cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:19.774040 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7413db-56e3-4954-947d-5924fd07c73a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:19.795180 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79612e1-2a4f-46e8-98ac-0ad15e6377cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:19.796727 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79612e1-2a4f-46e8-98ac-0ad15e6377cc None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:19.809558 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9c0cf-bf0a-48bc-9697-4ae5c9c998ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:19.810777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9c0cf-bf0a-48bc-9697-4ae5c9c998ae None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:19.811264 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9c0cf-bf0a-48bc-9697-4ae5c9c998ae None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:19.811726 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9c0cf-bf0a-48bc-9697-4ae5c9c998ae None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:19.812820 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9c0cf-bf0a-48bc-9697-4ae5c9c998ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:19.813339 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9c0cf-bf0a-48bc-9697-4ae5c9c998ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:19.815148 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9c0cf-bf0a-48bc-9697-4ae5c9c998ae None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:19.824732 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 77/150] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:19.831366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9c0cf-bf0a-48bc-9697-4ae5c9c998ae None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:19.899318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 74/151] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:19.905319 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79612e1-2a4f-46e8-98ac-0ad15e6377cc None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:19.934928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9c0cf-bf0a-48bc-9697-4ae5c9c998ae None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:19.972614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d7a12-4627-4d04-84be-526815052367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:19.973847 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d7a12-4627-4d04-84be-526815052367 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:19.974328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d7a12-4627-4d04-84be-526815052367 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:19.974795 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d7a12-4627-4d04-84be-526815052367 None admin] PATH_INFO: `/v3/users/9edb6c80152a46b899c4771601d162d8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:19.976228 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d7a12-4627-4d04-84be-526815052367 None admin] RBAC: Authorizing `identity:get_user(user_id=9edb6c80152a46b899c4771601d162d8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:19.977939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d7a12-4627-4d04-84be-526815052367 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:19.979909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 78/152] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:19 2022] GET /identity/v3/users/9edb6c80152a46b899c4771601d162d8 => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:19.986363 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d7a12-4627-4d04-84be-526815052367 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:20.007655 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79612e1-2a4f-46e8-98ac-0ad15e6377cc None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:20.044657 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0bffc-788b-41f4-aa5f-2a65cf8f9381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:20.045545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0bffc-788b-41f4-aa5f-2a65cf8f9381 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:20.045848 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0bffc-788b-41f4-aa5f-2a65cf8f9381 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:20.046303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0bffc-788b-41f4-aa5f-2a65cf8f9381 None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:20.047317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0bffc-788b-41f4-aa5f-2a65cf8f9381 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:20.048866 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0bffc-788b-41f4-aa5f-2a65cf8f9381 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:20.050570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 75/153] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:19 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:20.056630 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0bffc-788b-41f4-aa5f-2a65cf8f9381 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:20.093739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d7a12-4627-4d04-84be-526815052367 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:20.132931 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396d97c-5b56-4668-bc89-d79b27b69f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:20.138146 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396d97c-5b56-4668-bc89-d79b27b69f58 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:20.138728 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396d97c-5b56-4668-bc89-d79b27b69f58 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:20.139303 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396d97c-5b56-4668-bc89-d79b27b69f58 None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:20.145098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396d97c-5b56-4668-bc89-d79b27b69f58 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:20.146924 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396d97c-5b56-4668-bc89-d79b27b69f58 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:20.149074 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 79/154] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:19 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:20.157620 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396d97c-5b56-4668-bc89-d79b27b69f58 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:20.165029 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0bffc-788b-41f4-aa5f-2a65cf8f9381 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:20.224995 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a7ebd-cb58-421d-a3d9-9b5ae47cae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:20.225764 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a7ebd-cb58-421d-a3d9-9b5ae47cae11 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:20.225975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a7ebd-cb58-421d-a3d9-9b5ae47cae11 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:20.226249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a7ebd-cb58-421d-a3d9-9b5ae47cae11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:20.227361 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a7ebd-cb58-421d-a3d9-9b5ae47cae11 None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=5ec8dbf812ab46129e7de7e927d484f0, user.id=278e685f13c54040af7579fa7ad454a8) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:20.227361 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a7ebd-cb58-421d-a3d9-9b5ae47cae11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:20.229014 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a7ebd-cb58-421d-a3d9-9b5ae47cae11 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:20.250556 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 76/155] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:20 2022] GET /identity/v3/role_assignments?user.id=278e685f13c54040af7579fa7ad454a8&scope.project.id=5ec8dbf812ab46129e7de7e927d484f0&role.id=85136c55809b4d9db97c263a72392ad1 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:20.295374 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396d97c-5b56-4668-bc89-d79b27b69f58 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:20.331588 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60c1d1-fdce-41fa-a575-97bf36a60086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:20.332925 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60c1d1-fdce-41fa-a575-97bf36a60086 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:20.333431 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60c1d1-fdce-41fa-a575-97bf36a60086 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:20.333912 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60c1d1-fdce-41fa-a575-97bf36a60086 None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0/users/9edb6c80152a46b899c4771601d162d8/roles/0174fdbdbb3946bdb17aded65287dd75` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:20.336456 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60c1d1-fdce-41fa-a575-97bf36a60086 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ec8dbf812ab46129e7de7e927d484f0, user_id=9edb6c80152a46b899c4771601d162d8, role_id=0174fdbdbb3946bdb17aded65287dd75)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:20.338343 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60c1d1-fdce-41fa-a575-97bf36a60086 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:20.359994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 80/156] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:38:20 2022] PUT /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0/users/9edb6c80152a46b899c4771601d162d8/roles/0174fdbdbb3946bdb17aded65287dd75 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:20.581537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d6ad5-7c54-4515-a7f5-9e62a1f304fd None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:20.581850 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d6ad5-7c54-4515-a7f5-9e62a1f304fd None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:20.582096 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d6ad5-7c54-4515-a7f5-9e62a1f304fd None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:20.583976 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 77/157] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:20.602869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fa034-0656-4304-9c36-155caadcbaf3 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:20.603480 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fa034-0656-4304-9c36-155caadcbaf3 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:20.603942 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fa034-0656-4304-9c36-155caadcbaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:20.632357 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-7e4fa034-0656-4304-9c36-155caadcbaf3 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:20.633970 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-7e4fa034-0656-4304-9c36-155caadcbaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:20.710294 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 81/158] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:20.756244 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d6ad5-7c54-4515-a7f5-9e62a1f304fd None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:20.961632 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d6ad5-7c54-4515-a7f5-9e62a1f304fd None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:21.016225 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374aa0d-8786-4626-a31c-1a094800d33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:21.017511 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374aa0d-8786-4626-a31c-1a094800d33c None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:21.017979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374aa0d-8786-4626-a31c-1a094800d33c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:21.018427 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374aa0d-8786-4626-a31c-1a094800d33c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:21.033871 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374aa0d-8786-4626-a31c-1a094800d33c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:21.041381 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-9374aa0d-8786-4626-a31c-1a094800d33c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:21.044034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 78/159] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:21.049083 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fa034-0656-4304-9c36-155caadcbaf3 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:21.153464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fa034-0656-4304-9c36-155caadcbaf3 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:21.189197 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668c9c7-f269-4cb7-8e4d-8748ccde9f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:21.190309 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668c9c7-f269-4cb7-8e4d-8748ccde9f89 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:21.190777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668c9c7-f269-4cb7-8e4d-8748ccde9f89 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:21.191227 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668c9c7-f269-4cb7-8e4d-8748ccde9f89 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:21.192154 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668c9c7-f269-4cb7-8e4d-8748ccde9f89 None admin] RBAC: Adding query filter params (name=member) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:21.192679 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668c9c7-f269-4cb7-8e4d-8748ccde9f89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:21.194262 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668c9c7-f269-4cb7-8e4d-8748ccde9f89 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:21.203271 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 82/160] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:21.208911 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374aa0d-8786-4626-a31c-1a094800d33c None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:21.324415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374aa0d-8786-4626-a31c-1a094800d33c None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:21.364373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7b0c1-96c4-4a97-b132-305fe86db9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:21.365686 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7b0c1-96c4-4a97-b132-305fe86db9f7 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:21.366181 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7b0c1-96c4-4a97-b132-305fe86db9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:21.366637 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7b0c1-96c4-4a97-b132-305fe86db9f7 None admin] PATH_INFO: `/v3/users/a26927c413cd49c198cd0c5719fb07c3` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:21.368113 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7b0c1-96c4-4a97-b132-305fe86db9f7 None admin] RBAC: Authorizing `identity:get_user(user_id=a26927c413cd49c198cd0c5719fb07c3)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:21.369872 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7b0c1-96c4-4a97-b132-305fe86db9f7 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:21.371741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 79/161] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:21 2022] GET /identity/v3/users/a26927c413cd49c198cd0c5719fb07c3 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:21.377840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668c9c7-f269-4cb7-8e4d-8748ccde9f89 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:21.498965 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668c9c7-f269-4cb7-8e4d-8748ccde9f89 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:21.540326 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019be02-5aff-480d-8ee5-ef67c6422ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:21.541354 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019be02-5aff-480d-8ee5-ef67c6422ee8 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:21.541834 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019be02-5aff-480d-8ee5-ef67c6422ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:21.542287 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019be02-5aff-480d-8ee5-ef67c6422ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:21.611340 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019be02-5aff-480d-8ee5-ef67c6422ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:21.613284 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019be02-5aff-480d-8ee5-ef67c6422ee8 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:21.715042 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 83/162] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:21.720486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7b0c1-96c4-4a97-b132-305fe86db9f7 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:21.828567 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7b0c1-96c4-4a97-b132-305fe86db9f7 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:21.873304 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e09ce-6fc0-4c22-8bfb-d5186ea849f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:21.874508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e09ce-6fc0-4c22-8bfb-d5186ea849f2 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:21.874991 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e09ce-6fc0-4c22-8bfb-d5186ea849f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:21.875442 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e09ce-6fc0-4c22-8bfb-d5186ea849f2 None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:21.876940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e09ce-6fc0-4c22-8bfb-d5186ea849f2 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:21.878593 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e09ce-6fc0-4c22-8bfb-d5186ea849f2 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:21.880503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 80/163] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:21 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:21.886578 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019be02-5aff-480d-8ee5-ef67c6422ee8 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:21.988584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019be02-5aff-480d-8ee5-ef67c6422ee8 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:22.022661 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcff57-78f5-4f63-bef9-601de15013b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:22.023686 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcff57-78f5-4f63-bef9-601de15013b5 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.024181 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcff57-78f5-4f63-bef9-601de15013b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.024669 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcff57-78f5-4f63-bef9-601de15013b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.025671 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcff57-78f5-4f63-bef9-601de15013b5 None admin] RBAC: Adding query filter params (role.id=ab7ac47ce77b490b8868c79a13a2a0aa, scope.project.id=5ec8dbf812ab46129e7de7e927d484f0, user.id=a26927c413cd49c198cd0c5719fb07c3) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:22.026164 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcff57-78f5-4f63-bef9-601de15013b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:22.027784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcff57-78f5-4f63-bef9-601de15013b5 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:22.034986 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 84/164] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:21 2022] GET /identity/v3/role_assignments?user.id=a26927c413cd49c198cd0c5719fb07c3&scope.project.id=5ec8dbf812ab46129e7de7e927d484f0&role.id=ab7ac47ce77b490b8868c79a13a2a0aa => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:22.591208 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6439e1c-8c75-4434-9299-2c852454d017 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.592182 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6439e1c-8c75-4434-9299-2c852454d017 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.592682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6439e1c-8c75-4434-9299-2c852454d017 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.594782 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 81/165] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:22.596816 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe556b-2f99-4486-914b-69cfa3fa0325 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.597596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe556b-2f99-4486-914b-69cfa3fa0325 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.598054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe556b-2f99-4486-914b-69cfa3fa0325 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.599802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67477e-20f1-460b-a4f0-cfb335dfc178 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.600309 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67477e-20f1-460b-a4f0-cfb335dfc178 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.600780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67477e-20f1-460b-a4f0-cfb335dfc178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.608277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 85/166] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:22 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:22.618626 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cda7a-76f0-4319-8e4a-d7faf99b7b9b None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.619133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cda7a-76f0-4319-8e4a-d7faf99b7b9b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.619606 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cda7a-76f0-4319-8e4a-d7faf99b7b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.628864 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-dd67477e-20f1-460b-a4f0-cfb335dfc178 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:22.642960 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-dd67477e-20f1-460b-a4f0-cfb335dfc178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:22.665236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-768cda7a-76f0-4319-8e4a-d7faf99b7b9b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:22.666429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-768cda7a-76f0-4319-8e4a-d7faf99b7b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:22.749434 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 82/167] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:22.801757 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67477e-20f1-460b-a4f0-cfb335dfc178 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:22.805166 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 86/168] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:22.836295 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cda7a-76f0-4319-8e4a-d7faf99b7b9b None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:22.945924 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67477e-20f1-460b-a4f0-cfb335dfc178 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:22.979591 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4f39c-04e7-43da-b110-6cce289867c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:22.980504 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4f39c-04e7-43da-b110-6cce289867c8 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.980805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4f39c-04e7-43da-b110-6cce289867c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.981076 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4f39c-04e7-43da-b110-6cce289867c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.993508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4f39c-04e7-43da-b110-6cce289867c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:23.001279 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-76c4f39c-04e7-43da-b110-6cce289867c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:38:23.002565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 83/169] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:38:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:38:23.008615 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4f39c-04e7-43da-b110-6cce289867c8 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:23.056016 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cda7a-76f0-4319-8e4a-d7faf99b7b9b None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:23.112375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4f39c-04e7-43da-b110-6cce289867c8 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:23.133538 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f04de4-22b3-4ae4-904d-349c855f071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:23.134412 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f04de4-22b3-4ae4-904d-349c855f071b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.134691 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f04de4-22b3-4ae4-904d-349c855f071b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.134961 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f04de4-22b3-4ae4-904d-349c855f071b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.145858 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f850135-8f73-49ec-be21-d17f3831281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:23.146531 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f850135-8f73-49ec-be21-d17f3831281f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.146819 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f850135-8f73-49ec-be21-d17f3831281f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.147083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f850135-8f73-49ec-be21-d17f3831281f None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.147851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f850135-8f73-49ec-be21-d17f3831281f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:23.148154 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f850135-8f73-49ec-be21-d17f3831281f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:23.149603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f850135-8f73-49ec-be21-d17f3831281f None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:23.155603 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f04de4-22b3-4ae4-904d-349c855f071b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:23.158467 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 84/170] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:38:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:23.162809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-17f04de4-22b3-4ae4-904d-349c855f071b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:23.164559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f850135-8f73-49ec-be21-d17f3831281f None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:23.168781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 87/171] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:38:23.174708 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f04de4-22b3-4ae4-904d-349c855f071b None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:23.278668 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f850135-8f73-49ec-be21-d17f3831281f None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:23.300649 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f04de4-22b3-4ae4-904d-349c855f071b None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:23.312892 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ca73f-a438-4469-bbee-f91f3108d39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:23.313974 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ca73f-a438-4469-bbee-f91f3108d39e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.314253 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ca73f-a438-4469-bbee-f91f3108d39e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.314523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ca73f-a438-4469-bbee-f91f3108d39e None admin] PATH_INFO: `/v3/users/a26927c413cd49c198cd0c5719fb07c3` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.315783 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ca73f-a438-4469-bbee-f91f3108d39e None admin] RBAC: Authorizing `identity:get_user(user_id=a26927c413cd49c198cd0c5719fb07c3)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:23.317255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ca73f-a438-4469-bbee-f91f3108d39e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:23.318926 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 85/172] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:23 2022] GET /identity/v3/users/a26927c413cd49c198cd0c5719fb07c3 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:23.324384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ca73f-a438-4469-bbee-f91f3108d39e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:23.338396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1091c9-74c1-4bcf-9def-ce62551ab97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:23.339564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1091c9-74c1-4bcf-9def-ce62551ab97a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.340428 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1091c9-74c1-4bcf-9def-ce62551ab97a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.341169 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1091c9-74c1-4bcf-9def-ce62551ab97a None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.342256 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1091c9-74c1-4bcf-9def-ce62551ab97a None admin] RBAC: Adding query filter params (name=member) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:23.342872 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1091c9-74c1-4bcf-9def-ce62551ab97a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:23.344778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1091c9-74c1-4bcf-9def-ce62551ab97a None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:23.355902 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 88/173] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:23.364307 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1091c9-74c1-4bcf-9def-ce62551ab97a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:23.482812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1091c9-74c1-4bcf-9def-ce62551ab97a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:23.532121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ca73f-a438-4469-bbee-f91f3108d39e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:23.562063 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4ce34-d390-4e13-85ed-649e66954691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:23.562978 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4ce34-d390-4e13-85ed-649e66954691 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.563256 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4ce34-d390-4e13-85ed-649e66954691 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.563552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4ce34-d390-4e13-85ed-649e66954691 None admin] PATH_INFO: `/v3/users/a26927c413cd49c198cd0c5719fb07c3` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.564762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4ce34-d390-4e13-85ed-649e66954691 None admin] RBAC: Authorizing `identity:get_user(user_id=a26927c413cd49c198cd0c5719fb07c3)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:23.566222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4ce34-d390-4e13-85ed-649e66954691 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:23.576690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 89/174] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:23 2022] GET /identity/v3/users/a26927c413cd49c198cd0c5719fb07c3 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:23.577682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4ce34-d390-4e13-85ed-649e66954691 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:23.599597 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c9c27-f412-4713-b0fb-a6af9668759b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:23.601011 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c9c27-f412-4713-b0fb-a6af9668759b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.601483 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c9c27-f412-4713-b0fb-a6af9668759b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.601960 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c9c27-f412-4713-b0fb-a6af9668759b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.711293 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4ce34-d390-4e13-85ed-649e66954691 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:23.746520 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c9c27-f412-4713-b0fb-a6af9668759b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:23.748069 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c9c27-f412-4713-b0fb-a6af9668759b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:23.749524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58c135-857f-476f-8e15-de4c280b050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:23.750196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58c135-857f-476f-8e15-de4c280b050f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.750473 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58c135-857f-476f-8e15-de4c280b050f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.750745 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58c135-857f-476f-8e15-de4c280b050f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.878599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 86/175] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:23.879897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b1b7c-d56c-486b-aa8d-8356511763b0 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.880182 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b1b7c-d56c-486b-aa8d-8356511763b0 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.880481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b1b7c-d56c-486b-aa8d-8356511763b0 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.882157 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 87/176] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:23.884247 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b1b7c-d56c-486b-aa8d-8356511763b0 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:23.901269 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58c135-857f-476f-8e15-de4c280b050f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:23.902764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58c135-857f-476f-8e15-de4c280b050f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:24.033822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b1b7c-d56c-486b-aa8d-8356511763b0 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:24.056489 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 90/177] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:24.057620 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb64a2-24e8-4945-ba84-6dd182a9a133 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.057905 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb64a2-24e8-4945-ba84-6dd182a9a133 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.058179 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb64a2-24e8-4945-ba84-6dd182a9a133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.067861 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823af92-61ef-439d-8023-ab536cd9ef4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:24.068768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823af92-61ef-439d-8023-ab536cd9ef4a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.069046 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823af92-61ef-439d-8023-ab536cd9ef4a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.069318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823af92-61ef-439d-8023-ab536cd9ef4a None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.070509 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823af92-61ef-439d-8023-ab536cd9ef4a None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:24.072021 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823af92-61ef-439d-8023-ab536cd9ef4a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:24.073952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 88/178] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:23 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:24.075094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7472d46-e36b-4245-8b6d-1e3c5e2991b2 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.075300 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7472d46-e36b-4245-8b6d-1e3c5e2991b2 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.075562 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7472d46-e36b-4245-8b6d-1e3c5e2991b2 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.077405 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 89/179] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:24.077959 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7472d46-e36b-4245-8b6d-1e3c5e2991b2 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:24.083410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-84eb64a2-24e8-4945-ba84-6dd182a9a133 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:24.084645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-84eb64a2-24e8-4945-ba84-6dd182a9a133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:24.152267 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 91/180] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:24.153242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb64a2-24e8-4945-ba84-6dd182a9a133 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:24.184038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7472d46-e36b-4245-8b6d-1e3c5e2991b2 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:24.219261 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c7d04-7393-4a7e-b8c7-d8a52f3d1d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:24.220267 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c7d04-7393-4a7e-b8c7-d8a52f3d1d16 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.220548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c7d04-7393-4a7e-b8c7-d8a52f3d1d16 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.220817 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c7d04-7393-4a7e-b8c7-d8a52f3d1d16 None admin] PATH_INFO: `/v3/projects/a4adbcc6aa7c4568a74b74314dadd506` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.222038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c7d04-7393-4a7e-b8c7-d8a52f3d1d16 None admin] RBAC: Authorizing `identity:get_project(project_id=a4adbcc6aa7c4568a74b74314dadd506)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:24.223594 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c7d04-7393-4a7e-b8c7-d8a52f3d1d16 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:24.225579 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 90/181] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:24 2022] GET /identity/v3/projects/a4adbcc6aa7c4568a74b74314dadd506 => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:24.226554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9634d4b-d4f9-4101-926a-682ac8cb92f0 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.226831 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9634d4b-d4f9-4101-926a-682ac8cb92f0 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.227101 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9634d4b-d4f9-4101-926a-682ac8cb92f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.243998 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-b9634d4b-d4f9-4101-926a-682ac8cb92f0 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:24.245257 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-b9634d4b-d4f9-4101-926a-682ac8cb92f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:24.257035 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb64a2-24e8-4945-ba84-6dd182a9a133 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:24.291700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e18f0e-54ce-4ae4-a952-1f1a7dbdd3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:24.292392 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e18f0e-54ce-4ae4-a952-1f1a7dbdd3ff None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.292674 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e18f0e-54ce-4ae4-a952-1f1a7dbdd3ff None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.292942 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e18f0e-54ce-4ae4-a952-1f1a7dbdd3ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.293787 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e18f0e-54ce-4ae4-a952-1f1a7dbdd3ff None admin] RBAC: Adding query filter params (role.id=7b4e238c731941f18493cd62e30b1e4f, scope.project.id=5ec8dbf812ab46129e7de7e927d484f0, user.id=a26927c413cd49c198cd0c5719fb07c3) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:24.294114 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e18f0e-54ce-4ae4-a952-1f1a7dbdd3ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:24.295565 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e18f0e-54ce-4ae4-a952-1f1a7dbdd3ff None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:24.304409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 92/182] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:24 2022] GET /identity/v3/role_assignments?user.id=a26927c413cd49c198cd0c5719fb07c3&scope.project.id=5ec8dbf812ab46129e7de7e927d484f0&role.id=7b4e238c731941f18493cd62e30b1e4f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:24.304409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e18f0e-54ce-4ae4-a952-1f1a7dbdd3ff None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:24.313386 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 91/183] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:24.320494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9634d4b-d4f9-4101-926a-682ac8cb92f0 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:24.435420 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e18f0e-54ce-4ae4-a952-1f1a7dbdd3ff None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:24.459626 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9634d4b-d4f9-4101-926a-682ac8cb92f0 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:24.474634 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e97f1-fab1-46ed-a2fd-831ef75d0e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:24.475497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e97f1-fab1-46ed-a2fd-831ef75d0e9c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.475809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e97f1-fab1-46ed-a2fd-831ef75d0e9c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.476031 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e97f1-fab1-46ed-a2fd-831ef75d0e9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.488173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e97f1-fab1-46ed-a2fd-831ef75d0e9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:24.495918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-003e97f1-fab1-46ed-a2fd-831ef75d0e9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:38:24.497266 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 93/184] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:38:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:24.498774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8297ea3-e44f-4a11-a0de-e278ae3199c5 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.499053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8297ea3-e44f-4a11-a0de-e278ae3199c5 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.499323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8297ea3-e44f-4a11-a0de-e278ae3199c5 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.499862 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebfade-eabb-426c-a18f-62849bac0b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:24.500798 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebfade-eabb-426c-a18f-62849bac0b5d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.501265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 94/185] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:24.501386 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebfade-eabb-426c-a18f-62849bac0b5d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.501969 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebfade-eabb-426c-a18f-62849bac0b5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.502185 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8297ea3-e44f-4a11-a0de-e278ae3199c5 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:24.503336 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebfade-eabb-426c-a18f-62849bac0b5d None admin] RBAC: Adding query filter params (role.id=ab7ac47ce77b490b8868c79a13a2a0aa, scope.project.id=a4adbcc6aa7c4568a74b74314dadd506, user.id=a26927c413cd49c198cd0c5719fb07c3) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:24.503841 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebfade-eabb-426c-a18f-62849bac0b5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:24.505528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebfade-eabb-426c-a18f-62849bac0b5d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:24.512449 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 92/186] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:24 2022] GET /identity/v3/role_assignments?user.id=a26927c413cd49c198cd0c5719fb07c3&scope.project.id=a4adbcc6aa7c4568a74b74314dadd506&role.id=ab7ac47ce77b490b8868c79a13a2a0aa => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:24.514131 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa386ff9-9231-4637-b6ee-ebf65aedb8b0 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.514664 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa386ff9-9231-4637-b6ee-ebf65aedb8b0 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.515130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa386ff9-9231-4637-b6ee-ebf65aedb8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.545980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-aa386ff9-9231-4637-b6ee-ebf65aedb8b0 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:24.547195 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-aa386ff9-9231-4637-b6ee-ebf65aedb8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:24.632124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 93/187] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:24.635837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa386ff9-9231-4637-b6ee-ebf65aedb8b0 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:24.645586 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8297ea3-e44f-4a11-a0de-e278ae3199c5 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:24.690124 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290c1ab-3942-4871-bcf8-5c3109b0ff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:24.690990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290c1ab-3942-4871-bcf8-5c3109b0ff9f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.691271 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290c1ab-3942-4871-bcf8-5c3109b0ff9f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.691544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290c1ab-3942-4871-bcf8-5c3109b0ff9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.706068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290c1ab-3942-4871-bcf8-5c3109b0ff9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:24.716014 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-3290c1ab-3942-4871-bcf8-5c3109b0ff9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:38:24.717988 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 95/188] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:38:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:24.719405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf270da-0b9d-4a73-8cff-ede81efde7df None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.719744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf270da-0b9d-4a73-8cff-ede81efde7df None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.720025 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf270da-0b9d-4a73-8cff-ede81efde7df None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.721829 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 96/189] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:24.722734 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf270da-0b9d-4a73-8cff-ede81efde7df None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:24.755933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa386ff9-9231-4637-b6ee-ebf65aedb8b0 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:24.792995 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74251e8-38ab-4c43-8ab3-b3c633f4e333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:24.793677 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74251e8-38ab-4c43-8ab3-b3c633f4e333 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.793991 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74251e8-38ab-4c43-8ab3-b3c633f4e333 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.794260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74251e8-38ab-4c43-8ab3-b3c633f4e333 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.795005 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74251e8-38ab-4c43-8ab3-b3c633f4e333 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:24.795305 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74251e8-38ab-4c43-8ab3-b3c633f4e333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:24.796864 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74251e8-38ab-4c43-8ab3-b3c633f4e333 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:24.805407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 94/190] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:38:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:24.806226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74251e8-38ab-4c43-8ab3-b3c633f4e333 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:24.827939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf270da-0b9d-4a73-8cff-ede81efde7df None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:24.859643 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed624a9b-7484-4b5b-896a-7173b9cfed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:24.860522 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed624a9b-7484-4b5b-896a-7173b9cfed73 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.860845 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed624a9b-7484-4b5b-896a-7173b9cfed73 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.861116 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed624a9b-7484-4b5b-896a-7173b9cfed73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.862248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed624a9b-7484-4b5b-896a-7173b9cfed73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:24.863685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed624a9b-7484-4b5b-896a-7173b9cfed73 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:24.865307 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 97/191] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:38:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:24.866418 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa426fe-a34a-4136-bc49-6a2b7d65a23f None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.866697 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa426fe-a34a-4136-bc49-6a2b7d65a23f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.866954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa426fe-a34a-4136-bc49-6a2b7d65a23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.884551 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-7fa426fe-a34a-4136-bc49-6a2b7d65a23f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:24.885711 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-7fa426fe-a34a-4136-bc49-6a2b7d65a23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:24.899057 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74251e8-38ab-4c43-8ab3-b3c633f4e333 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:24.930750 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a400b-71c3-45e9-b4e5-712ba7395527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:24.931414 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a400b-71c3-45e9-b4e5-712ba7395527 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.931692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a400b-71c3-45e9-b4e5-712ba7395527 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.931961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a400b-71c3-45e9-b4e5-712ba7395527 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.932726 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a400b-71c3-45e9-b4e5-712ba7395527 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:24.933022 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a400b-71c3-45e9-b4e5-712ba7395527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:24.934418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a400b-71c3-45e9-b4e5-712ba7395527 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:24.942574 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 95/192] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:24.943140 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a400b-71c3-45e9-b4e5-712ba7395527 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:24.953356 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 98/193] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:24.962083 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa426fe-a34a-4136-bc49-6a2b7d65a23f None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.049309 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a400b-71c3-45e9-b4e5-712ba7395527 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.050945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa426fe-a34a-4136-bc49-6a2b7d65a23f None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.080679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01969b9b-4b51-4d99-8172-2d4dd0b8702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.081556 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01969b9b-4b51-4d99-8172-2d4dd0b8702d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.081827 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01969b9b-4b51-4d99-8172-2d4dd0b8702d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.082097 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01969b9b-4b51-4d99-8172-2d4dd0b8702d None admin] PATH_INFO: `/v3/users/625bef5afad8477cbdc0c64be3016749` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.084291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6492792-a194-4e9d-8ca5-beb16a1712d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.084958 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6492792-a194-4e9d-8ca5-beb16a1712d1 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.085238 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6492792-a194-4e9d-8ca5-beb16a1712d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.085506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6492792-a194-4e9d-8ca5-beb16a1712d1 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.086209 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6492792-a194-4e9d-8ca5-beb16a1712d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.087750 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6492792-a194-4e9d-8ca5-beb16a1712d1 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.094683 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01969b9b-4b51-4d99-8172-2d4dd0b8702d None admin] RBAC: Authorizing `identity:get_user(user_id=625bef5afad8477cbdc0c64be3016749)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.096257 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01969b9b-4b51-4d99-8172-2d4dd0b8702d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.098153 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 96/194] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:24 2022] GET /identity/v3/users/625bef5afad8477cbdc0c64be3016749 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:25.098951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01969b9b-4b51-4d99-8172-2d4dd0b8702d None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.108944 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 99/195] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:38:24 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:25.109903 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6492792-a194-4e9d-8ca5-beb16a1712d1 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.216925 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01969b9b-4b51-4d99-8172-2d4dd0b8702d None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.220487 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6492792-a194-4e9d-8ca5-beb16a1712d1 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.252685 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b69713-23ca-4927-98f0-b5f535d59830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.253569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b69713-23ca-4927-98f0-b5f535d59830 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.253846 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b69713-23ca-4927-98f0-b5f535d59830 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.254122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b69713-23ca-4927-98f0-b5f535d59830 None admin] PATH_INFO: `/v3/users/625bef5afad8477cbdc0c64be3016749` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.255345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b69713-23ca-4927-98f0-b5f535d59830 None admin] RBAC: Authorizing `identity:get_user(user_id=625bef5afad8477cbdc0c64be3016749)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.256094 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee14477-32a3-4c10-8efa-30d62f6ec572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.256850 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b69713-23ca-4927-98f0-b5f535d59830 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.257229 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee14477-32a3-4c10-8efa-30d62f6ec572 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.257641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee14477-32a3-4c10-8efa-30d62f6ec572 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.258043 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee14477-32a3-4c10-8efa-30d62f6ec572 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.258524 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 97/196] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:25 2022] GET /identity/v3/users/625bef5afad8477cbdc0c64be3016749 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:25.264098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b69713-23ca-4927-98f0-b5f535d59830 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.270489 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee14477-32a3-4c10-8efa-30d62f6ec572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:25.277962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-2ee14477-32a3-4c10-8efa-30d62f6ec572 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:38:25.279479 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 100/197] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:25.280789 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee14477-32a3-4c10-8efa-30d62f6ec572 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.380522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b69713-23ca-4927-98f0-b5f535d59830 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.398926 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee14477-32a3-4c10-8efa-30d62f6ec572 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.421429 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d914eb-d517-4c44-9acb-177d46c4918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.422087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d914eb-d517-4c44-9acb-177d46c4918b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.422363 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d914eb-d517-4c44-9acb-177d46c4918b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.422629 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d914eb-d517-4c44-9acb-177d46c4918b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.441146 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f82c0-1daf-406a-931a-fc7efcf97278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.441808 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f82c0-1daf-406a-931a-fc7efcf97278 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.442086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f82c0-1daf-406a-931a-fc7efcf97278 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.442362 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f82c0-1daf-406a-931a-fc7efcf97278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.515337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d914eb-d517-4c44-9acb-177d46c4918b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.517402 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d914eb-d517-4c44-9acb-177d46c4918b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.532811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f82c0-1daf-406a-931a-fc7efcf97278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.534430 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f82c0-1daf-406a-931a-fc7efcf97278 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.621632 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 98/198] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:25.622699 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d914eb-d517-4c44-9acb-177d46c4918b None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.650583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 101/199] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:25.651644 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f82c0-1daf-406a-931a-fc7efcf97278 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.726114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d914eb-d517-4c44-9acb-177d46c4918b None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.752174 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f82c0-1daf-406a-931a-fc7efcf97278 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.759411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39fb59-953d-4a60-ab4c-07f80c152f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.760090 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39fb59-953d-4a60-ab4c-07f80c152f51 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.760401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39fb59-953d-4a60-ab4c-07f80c152f51 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.760678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39fb59-953d-4a60-ab4c-07f80c152f51 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.761426 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39fb59-953d-4a60-ab4c-07f80c152f51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:25.761732 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39fb59-953d-4a60-ab4c-07f80c152f51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.763151 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39fb59-953d-4a60-ab4c-07f80c152f51 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.771403 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 99/200] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:25.772149 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39fb59-953d-4a60-ab4c-07f80c152f51 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.787133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea83aad-1088-40a3-bae4-f2110ed1ec2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.788452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea83aad-1088-40a3-bae4-f2110ed1ec2d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.788892 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea83aad-1088-40a3-bae4-f2110ed1ec2d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.789168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea83aad-1088-40a3-bae4-f2110ed1ec2d None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.790349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea83aad-1088-40a3-bae4-f2110ed1ec2d None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.791803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea83aad-1088-40a3-bae4-f2110ed1ec2d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.793648 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 102/201] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:25 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:25.794431 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea83aad-1088-40a3-bae4-f2110ed1ec2d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.873259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39fb59-953d-4a60-ab4c-07f80c152f51 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.898022 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea83aad-1088-40a3-bae4-f2110ed1ec2d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.906433 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814dfb-6096-4331-9056-a0f5bfef65cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.907398 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814dfb-6096-4331-9056-a0f5bfef65cb None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.907770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814dfb-6096-4331-9056-a0f5bfef65cb None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.908054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814dfb-6096-4331-9056-a0f5bfef65cb None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.909466 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff814dfb-6096-4331-9056-a0f5bfef65cb None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.910929 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff814dfb-6096-4331-9056-a0f5bfef65cb None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.912691 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 100/202] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:25 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:25.913457 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814dfb-6096-4331-9056-a0f5bfef65cb None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.933943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956ae8a-929f-4721-bca3-3d77c51de4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.934859 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956ae8a-929f-4721-bca3-3d77c51de4ce None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.935135 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956ae8a-929f-4721-bca3-3d77c51de4ce None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.935403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956ae8a-929f-4721-bca3-3d77c51de4ce None admin] PATH_INFO: `/v3/users/9edb6c80152a46b899c4771601d162d8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.936627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956ae8a-929f-4721-bca3-3d77c51de4ce None admin] RBAC: Authorizing `identity:get_user(user_id=9edb6c80152a46b899c4771601d162d8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.938085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956ae8a-929f-4721-bca3-3d77c51de4ce None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.939789 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 103/203] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:25 2022] GET /identity/v3/users/9edb6c80152a46b899c4771601d162d8 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:25.940668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956ae8a-929f-4721-bca3-3d77c51de4ce None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:26.016570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814dfb-6096-4331-9056-a0f5bfef65cb None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:26.045313 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956ae8a-929f-4721-bca3-3d77c51de4ce None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:26.055565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e4c85-ed98-4143-bb53-1403ac602065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:26.056715 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e4c85-ed98-4143-bb53-1403ac602065 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:26.057121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e4c85-ed98-4143-bb53-1403ac602065 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:26.057400 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e4c85-ed98-4143-bb53-1403ac602065 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:26.058248 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e4c85-ed98-4143-bb53-1403ac602065 None admin] RBAC: Adding query filter params (role.id=7b4e238c731941f18493cd62e30b1e4f, scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8, user.id=625bef5afad8477cbdc0c64be3016749) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:26.058714 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e4c85-ed98-4143-bb53-1403ac602065 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:26.060236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e4c85-ed98-4143-bb53-1403ac602065 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:26.067941 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 101/204] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:25 2022] GET /identity/v3/role_assignments?user.id=625bef5afad8477cbdc0c64be3016749&scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8&role.id=7b4e238c731941f18493cd62e30b1e4f => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:26.068815 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e4c85-ed98-4143-bb53-1403ac602065 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:26.081904 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3461148-4c3f-4bc1-88f6-506969dcdf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:26.082930 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3461148-4c3f-4bc1-88f6-506969dcdf3c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:26.083216 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3461148-4c3f-4bc1-88f6-506969dcdf3c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:26.083493 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3461148-4c3f-4bc1-88f6-506969dcdf3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:26.084620 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3461148-4c3f-4bc1-88f6-506969dcdf3c None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8, user.id=625bef5afad8477cbdc0c64be3016749) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:26.085357 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3461148-4c3f-4bc1-88f6-506969dcdf3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:26.087241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3461148-4c3f-4bc1-88f6-506969dcdf3c None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:26.095324 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 104/205] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:25 2022] GET /identity/v3/role_assignments?user.id=625bef5afad8477cbdc0c64be3016749&scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8&role.id=85136c55809b4d9db97c263a72392ad1 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:26.187784 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e4c85-ed98-4143-bb53-1403ac602065 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:26.225604 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267222f-a6af-4710-a7c9-ec840402bf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:26.226289 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267222f-a6af-4710-a7c9-ec840402bf8a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:26.226570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267222f-a6af-4710-a7c9-ec840402bf8a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:26.226843 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267222f-a6af-4710-a7c9-ec840402bf8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:26.301152 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267222f-a6af-4710-a7c9-ec840402bf8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:26.302685 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267222f-a6af-4710-a7c9-ec840402bf8a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:26.431430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 102/206] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:26.437155 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3461148-4c3f-4bc1-88f6-506969dcdf3c None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:26.556424 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3461148-4c3f-4bc1-88f6-506969dcdf3c None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:26.605824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a93d41-c270-4339-8d5a-45ee86069308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:26.606825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a93d41-c270-4339-8d5a-45ee86069308 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:26.607116 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a93d41-c270-4339-8d5a-45ee86069308 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:26.607433 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a93d41-c270-4339-8d5a-45ee86069308 None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:26.608979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a93d41-c270-4339-8d5a-45ee86069308 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:26.610832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a93d41-c270-4339-8d5a-45ee86069308 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:26.612887 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 105/207] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:26 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:26.618764 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267222f-a6af-4710-a7c9-ec840402bf8a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:26.739854 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267222f-a6af-4710-a7c9-ec840402bf8a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:26.792890 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e7bf2-5ca0-4575-ac37-d877988f648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:26.793571 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e7bf2-5ca0-4575-ac37-d877988f648b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:26.793910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e7bf2-5ca0-4575-ac37-d877988f648b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:26.794190 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e7bf2-5ca0-4575-ac37-d877988f648b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:26.795019 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e7bf2-5ca0-4575-ac37-d877988f648b None admin] RBAC: Adding query filter params (role.id=0174fdbdbb3946bdb17aded65287dd75, scope.project.id=5ec8dbf812ab46129e7de7e927d484f0, user.id=9edb6c80152a46b899c4771601d162d8) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:26.795332 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e7bf2-5ca0-4575-ac37-d877988f648b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:26.796821 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e7bf2-5ca0-4575-ac37-d877988f648b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:26.802657 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 103/208] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:26 2022] GET /identity/v3/role_assignments?user.id=9edb6c80152a46b899c4771601d162d8&scope.project.id=5ec8dbf812ab46129e7de7e927d484f0&role.id=0174fdbdbb3946bdb17aded65287dd75 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:27.762582 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399f608-eb48-42ce-8a19-cd7654055ae9 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:27.763556 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399f608-eb48-42ce-8a19-cd7654055ae9 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:27.764044 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399f608-eb48-42ce-8a19-cd7654055ae9 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:27.766065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 106/209] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:27.771525 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe7e2f-326b-44cb-abf2-14673227bfa7 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:27.772387 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe7e2f-326b-44cb-abf2-14673227bfa7 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:27.772858 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe7e2f-326b-44cb-abf2-14673227bfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:27.791223 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-c1fe7e2f-326b-44cb-abf2-14673227bfa7 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:27.792824 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c1fe7e2f-326b-44cb-abf2-14673227bfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:27.859590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 104/210] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:27.863362 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6bd8e-2d55-4610-ba72-106fc5a6c0fd None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:27.863808 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6bd8e-2d55-4610-ba72-106fc5a6c0fd None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:27.864086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6bd8e-2d55-4610-ba72-106fc5a6c0fd None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:27.865891 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 107/211] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:27.871140 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d42c4-f911-4dcf-971b-87410a481469 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:27.871432 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d42c4-f911-4dcf-971b-87410a481469 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:27.871714 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d42c4-f911-4dcf-971b-87410a481469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:27.888399 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-081d42c4-f911-4dcf-971b-87410a481469 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:27.889102 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6bd8e-2d55-4610-ba72-106fc5a6c0fd None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:27.889623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-081d42c4-f911-4dcf-971b-87410a481469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:27.961215 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 105/212] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:27.986555 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d42c4-f911-4dcf-971b-87410a481469 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:28.005628 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6bd8e-2d55-4610-ba72-106fc5a6c0fd None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:28.048924 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b67733-6459-40cb-8ceb-613032758976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:28.049908 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b67733-6459-40cb-8ceb-613032758976 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.050196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b67733-6459-40cb-8ceb-613032758976 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.050470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b67733-6459-40cb-8ceb-613032758976 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.063365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b67733-6459-40cb-8ceb-613032758976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:28.072977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-98b67733-6459-40cb-8ceb-613032758976 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:28.074474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 108/213] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:28.080976 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b67733-6459-40cb-8ceb-613032758976 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:28.094358 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d42c4-f911-4dcf-971b-87410a481469 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:28.128926 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407768ca-4591-4013-8ff5-24ddfb5de035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:28.130115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407768ca-4591-4013-8ff5-24ddfb5de035 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.130650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407768ca-4591-4013-8ff5-24ddfb5de035 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.131121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407768ca-4591-4013-8ff5-24ddfb5de035 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.132537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407768ca-4591-4013-8ff5-24ddfb5de035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:28.134209 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407768ca-4591-4013-8ff5-24ddfb5de035 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:28.136038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 106/214] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:38:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:28.141686 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407768ca-4591-4013-8ff5-24ddfb5de035 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:28.180669 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b67733-6459-40cb-8ceb-613032758976 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:28.218012 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c26b91-da1d-4367-b4b6-18d0e9cd7412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:28.219703 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c26b91-da1d-4367-b4b6-18d0e9cd7412 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.220235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c26b91-da1d-4367-b4b6-18d0e9cd7412 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.220743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c26b91-da1d-4367-b4b6-18d0e9cd7412 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.222196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c26b91-da1d-4367-b4b6-18d0e9cd7412 None admin] RBAC: Adding query filter params (name=member) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:28.223114 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c26b91-da1d-4367-b4b6-18d0e9cd7412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:28.225167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c26b91-da1d-4367-b4b6-18d0e9cd7412 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:28.236356 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 109/215] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:28.242244 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c26b91-da1d-4367-b4b6-18d0e9cd7412 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:28.253026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407768ca-4591-4013-8ff5-24ddfb5de035 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:28.298899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca1567-80d9-4ca3-8fb1-9bbaf5a19612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:28.299991 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca1567-80d9-4ca3-8fb1-9bbaf5a19612 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.300496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca1567-80d9-4ca3-8fb1-9bbaf5a19612 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.300982 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca1567-80d9-4ca3-8fb1-9bbaf5a19612 None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.302375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca1567-80d9-4ca3-8fb1-9bbaf5a19612 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:28.304810 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca1567-80d9-4ca3-8fb1-9bbaf5a19612 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:28.329681 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 107/216] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:38:28 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:38:28.356314 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c26b91-da1d-4367-b4b6-18d0e9cd7412 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:28.393286 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d159b0-91e9-491b-b166-6ff3562abc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:28.394184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d159b0-91e9-491b-b166-6ff3562abc41 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.394469 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d159b0-91e9-491b-b166-6ff3562abc41 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.394728 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d159b0-91e9-491b-b166-6ff3562abc41 None admin] PATH_INFO: `/v3/users/888f46d1aa4941ba8571b00b2f59a341` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.410736 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d159b0-91e9-491b-b166-6ff3562abc41 None admin] RBAC: Authorizing `identity:get_user(user_id=888f46d1aa4941ba8571b00b2f59a341)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:28.412262 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d159b0-91e9-491b-b166-6ff3562abc41 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:28.414236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 110/217] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:28 2022] GET /identity/v3/users/888f46d1aa4941ba8571b00b2f59a341 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:28.419891 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca1567-80d9-4ca3-8fb1-9bbaf5a19612 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:28.532154 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca1567-80d9-4ca3-8fb1-9bbaf5a19612 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:28.566643 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa63efc-8e0c-418d-b821-67496c88cdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:28.567230 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa63efc-8e0c-418d-b821-67496c88cdb5 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.567507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa63efc-8e0c-418d-b821-67496c88cdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.567777 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa63efc-8e0c-418d-b821-67496c88cdb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.574349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3007c-3358-4ec4-9a47-8189bd72cf12 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.574642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3007c-3358-4ec4-9a47-8189bd72cf12 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.574936 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3007c-3358-4ec4-9a47-8189bd72cf12 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.581729 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 111/218] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:28.583910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5a5c0-d785-4c1e-bc9c-a3a8aad0197c None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.584356 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5a5c0-d785-4c1e-bc9c-a3a8aad0197c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.584507 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5a5c0-d785-4c1e-bc9c-a3a8aad0197c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.603854 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-04d5a5c0-d785-4c1e-bc9c-a3a8aad0197c None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:28.605101 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-04d5a5c0-d785-4c1e-bc9c-a3a8aad0197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:28.642388 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa63efc-8e0c-418d-b821-67496c88cdb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:28.643942 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa63efc-8e0c-418d-b821-67496c88cdb5 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:28.695461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 112/219] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:28.718259 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5a5c0-d785-4c1e-bc9c-a3a8aad0197c None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:28.775243 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 108/220] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:28.781706 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa63efc-8e0c-418d-b821-67496c88cdb5 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:28.835523 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5a5c0-d785-4c1e-bc9c-a3a8aad0197c None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:28.870045 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f16757-e302-4cd7-8165-e008897f87c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:28.870867 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f16757-e302-4cd7-8165-e008897f87c1 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.871140 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f16757-e302-4cd7-8165-e008897f87c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.871401 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f16757-e302-4cd7-8165-e008897f87c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.881865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f16757-e302-4cd7-8165-e008897f87c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:28.889609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-65f16757-e302-4cd7-8165-e008897f87c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:38:28.895783 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 113/221] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:38:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:38:28.897113 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f16757-e302-4cd7-8165-e008897f87c1 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:28.922128 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa63efc-8e0c-418d-b821-67496c88cdb5 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:28.997437 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f16757-e302-4cd7-8165-e008897f87c1 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:29.004920 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bcdac-6cd7-489b-930b-22b20b51a656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:29.006100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bcdac-6cd7-489b-930b-22b20b51a656 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:29.006592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bcdac-6cd7-489b-930b-22b20b51a656 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:29.007057 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bcdac-6cd7-489b-930b-22b20b51a656 None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:29.008539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bcdac-6cd7-489b-930b-22b20b51a656 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:29.010202 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bcdac-6cd7-489b-930b-22b20b51a656 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:29.016481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 109/222] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:28 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:29.017959 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bcdac-6cd7-489b-930b-22b20b51a656 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:29.032607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f17192-3016-4401-b4b5-f0be1b4ef19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:29.033283 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f17192-3016-4401-b4b5-f0be1b4ef19b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:29.034096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f17192-3016-4401-b4b5-f0be1b4ef19b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:29.034680 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f17192-3016-4401-b4b5-f0be1b4ef19b None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:29.035509 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f17192-3016-4401-b4b5-f0be1b4ef19b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:29.040231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f17192-3016-4401-b4b5-f0be1b4ef19b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:29.040231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f17192-3016-4401-b4b5-f0be1b4ef19b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:29.046600 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 114/223] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:38:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:29.060645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f17192-3016-4401-b4b5-f0be1b4ef19b None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:29.145965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bcdac-6cd7-489b-930b-22b20b51a656 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:29.167490 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f17192-3016-4401-b4b5-f0be1b4ef19b None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:29.187308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984833f8-43ab-4edc-9af0-9bf355979b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:29.187971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984833f8-43ab-4edc-9af0-9bf355979b7f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:29.188273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984833f8-43ab-4edc-9af0-9bf355979b7f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:29.188752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984833f8-43ab-4edc-9af0-9bf355979b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:29.190027 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984833f8-43ab-4edc-9af0-9bf355979b7f None admin] RBAC: Adding query filter params (role.id=ab7ac47ce77b490b8868c79a13a2a0aa, scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8, user.id=888f46d1aa4941ba8571b00b2f59a341) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:29.190342 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984833f8-43ab-4edc-9af0-9bf355979b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:29.192047 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984833f8-43ab-4edc-9af0-9bf355979b7f None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:29.199380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 110/224] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:29 2022] GET /identity/v3/role_assignments?user.id=888f46d1aa4941ba8571b00b2f59a341&scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8&role.id=ab7ac47ce77b490b8868c79a13a2a0aa => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:29.201313 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e1cdb-2a98-4b1d-9960-3c37ed7080f7 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:29.201794 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e1cdb-2a98-4b1d-9960-3c37ed7080f7 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:29.202275 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e1cdb-2a98-4b1d-9960-3c37ed7080f7 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:29.204226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 111/225] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:29.212689 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fab5c-fc2b-481d-9045-81cc39c75545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:29.214018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fab5c-fc2b-481d-9045-81cc39c75545 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:29.214487 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fab5c-fc2b-481d-9045-81cc39c75545 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:29.214965 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fab5c-fc2b-481d-9045-81cc39c75545 None admin] PATH_INFO: `/v3/users/625bef5afad8477cbdc0c64be3016749` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:29.216576 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fab5c-fc2b-481d-9045-81cc39c75545 None admin] RBAC: Authorizing `identity:get_user(user_id=625bef5afad8477cbdc0c64be3016749)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:29.218368 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fab5c-fc2b-481d-9045-81cc39c75545 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:29.220519 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 115/226] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:29 2022] GET /identity/v3/users/625bef5afad8477cbdc0c64be3016749 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:29.224414 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c565b-9b20-4721-8d95-9276402fe942 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:29.224955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c565b-9b20-4721-8d95-9276402fe942 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:29.225733 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c565b-9b20-4721-8d95-9276402fe942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:29.229185 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fab5c-fc2b-481d-9045-81cc39c75545 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:29.254528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-0f1c565b-9b20-4721-8d95-9276402fe942 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:29.257341 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0f1c565b-9b20-4721-8d95-9276402fe942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:29.390521 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 112/227] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:29.404489 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fab5c-fc2b-481d-9045-81cc39c75545 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:29.422158 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c565b-9b20-4721-8d95-9276402fe942 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:29.481724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4a871-c542-416b-b466-0bb6c0022228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:29.482605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4a871-c542-416b-b466-0bb6c0022228 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:29.482875 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4a871-c542-416b-b466-0bb6c0022228 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:29.483146 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4a871-c542-416b-b466-0bb6c0022228 None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:29.484431 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4a871-c542-416b-b466-0bb6c0022228 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:29.486029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4a871-c542-416b-b466-0bb6c0022228 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:29.488235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 116/228] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:29 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:29.494533 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4a871-c542-416b-b466-0bb6c0022228 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:29.575878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c565b-9b20-4721-8d95-9276402fe942 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:29.630015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4a871-c542-416b-b466-0bb6c0022228 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:29.663176 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cdef4-9b66-4e57-9e9e-a6ee7037c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:29.664341 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cdef4-9b66-4e57-9e9e-a6ee7037c0ec None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:29.664815 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cdef4-9b66-4e57-9e9e-a6ee7037c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:29.665277 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cdef4-9b66-4e57-9e9e-a6ee7037c0ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:29.684062 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cdef4-9b66-4e57-9e9e-a6ee7037c0ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:29.691362 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-303cdef4-9b66-4e57-9e9e-a6ee7037c0ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:38:29.693088 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 113/229] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:38:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:38:29.698893 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cdef4-9b66-4e57-9e9e-a6ee7037c0ec None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:29.710594 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce986fb0-a7ba-464b-82ad-b5e9c3fc8300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:29.711826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce986fb0-a7ba-464b-82ad-b5e9c3fc8300 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:29.712318 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce986fb0-a7ba-464b-82ad-b5e9c3fc8300 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:29.712871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce986fb0-a7ba-464b-82ad-b5e9c3fc8300 None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8/users/625bef5afad8477cbdc0c64be3016749/roles/7b4e238c731941f18493cd62e30b1e4f` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:29.717200 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce986fb0-a7ba-464b-82ad-b5e9c3fc8300 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd1e0280cf34f23ae68adb0de691bc8, user_id=625bef5afad8477cbdc0c64be3016749, role_id=7b4e238c731941f18493cd62e30b1e4f)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:29.718895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce986fb0-a7ba-464b-82ad-b5e9c3fc8300 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:29.739595 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 117/230] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:38:29 2022] PUT /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8/users/625bef5afad8477cbdc0c64be3016749/roles/7b4e238c731941f18493cd62e30b1e4f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:29.821636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cdef4-9b66-4e57-9e9e-a6ee7037c0ec None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:29.859481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c364f0d-a440-4c17-9c30-55e74b877760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:29.860622 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c364f0d-a440-4c17-9c30-55e74b877760 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:29.861099 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c364f0d-a440-4c17-9c30-55e74b877760 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:29.861561 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c364f0d-a440-4c17-9c30-55e74b877760 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:29.862523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c364f0d-a440-4c17-9c30-55e74b877760 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:29.863041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c364f0d-a440-4c17-9c30-55e74b877760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:29.864682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c364f0d-a440-4c17-9c30-55e74b877760 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:29.874339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 114/231] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:29.880581 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce986fb0-a7ba-464b-82ad-b5e9c3fc8300 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:29.989772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce986fb0-a7ba-464b-82ad-b5e9c3fc8300 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:30.024226 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beca29e-7c6b-4884-82b7-3ac71ba8f932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:30.025481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beca29e-7c6b-4884-82b7-3ac71ba8f932 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:30.025953 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beca29e-7c6b-4884-82b7-3ac71ba8f932 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:30.026413 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beca29e-7c6b-4884-82b7-3ac71ba8f932 None admin] PATH_INFO: `/v3/users/625bef5afad8477cbdc0c64be3016749` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:30.027822 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beca29e-7c6b-4884-82b7-3ac71ba8f932 None admin] RBAC: Authorizing `identity:get_user(user_id=625bef5afad8477cbdc0c64be3016749)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:30.029987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beca29e-7c6b-4884-82b7-3ac71ba8f932 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:30.032106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 118/232] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:29 2022] GET /identity/v3/users/625bef5afad8477cbdc0c64be3016749 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:30.038267 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c364f0d-a440-4c17-9c30-55e74b877760 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:30.138459 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c364f0d-a440-4c17-9c30-55e74b877760 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:30.172312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7897f-5e45-4347-b6c6-be8b6bc58424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:30.173542 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7897f-5e45-4347-b6c6-be8b6bc58424 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:30.174011 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7897f-5e45-4347-b6c6-be8b6bc58424 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:30.174471 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7897f-5e45-4347-b6c6-be8b6bc58424 None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:30.175867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7897f-5e45-4347-b6c6-be8b6bc58424 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:30.177541 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7897f-5e45-4347-b6c6-be8b6bc58424 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:30.180719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 115/233] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:30 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:30.186949 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beca29e-7c6b-4884-82b7-3ac71ba8f932 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:30.286408 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beca29e-7c6b-4884-82b7-3ac71ba8f932 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:30.320153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e71f18-da2d-462f-a06e-63ce05f2a652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:30.321465 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e71f18-da2d-462f-a06e-63ce05f2a652 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:30.321939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e71f18-da2d-462f-a06e-63ce05f2a652 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:30.322418 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e71f18-da2d-462f-a06e-63ce05f2a652 None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8/users/625bef5afad8477cbdc0c64be3016749/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:30.324679 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e71f18-da2d-462f-a06e-63ce05f2a652 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd1e0280cf34f23ae68adb0de691bc8, user_id=625bef5afad8477cbdc0c64be3016749, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:30.326350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e71f18-da2d-462f-a06e-63ce05f2a652 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:30.342517 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 119/234] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:38:30 2022] PUT /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8/users/625bef5afad8477cbdc0c64be3016749/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:31.270285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e0425-9e9f-4776-b33d-8dc147a1cc0d None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:31.270800 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e0425-9e9f-4776-b33d-8dc147a1cc0d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:31.270800 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e0425-9e9f-4776-b33d-8dc147a1cc0d None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:31.272925 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 116/235] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:31.278227 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5bfa5-e743-486d-a1cd-47183382d8c0 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:31.278633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5bfa5-e743-486d-a1cd-47183382d8c0 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:31.278922 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5bfa5-e743-486d-a1cd-47183382d8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:31.299740 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-01d5bfa5-e743-486d-a1cd-47183382d8c0 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:31.300941 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-01d5bfa5-e743-486d-a1cd-47183382d8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:31.388999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 120/236] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:31.430100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e0425-9e9f-4776-b33d-8dc147a1cc0d None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:31.442736 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb012e-4b3a-44be-a073-051fac1624cd None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:31.443036 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb012e-4b3a-44be-a073-051fac1624cd None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:31.443279 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb012e-4b3a-44be-a073-051fac1624cd None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:31.447515 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 121/237] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:31.453428 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e95a3-30c1-46c7-a1e7-784d9770e380 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:31.453704 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e95a3-30c1-46c7-a1e7-784d9770e380 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:31.454008 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e95a3-30c1-46c7-a1e7-784d9770e380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:31.475869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-1a7e95a3-30c1-46c7-a1e7-784d9770e380 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:31.477083 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1a7e95a3-30c1-46c7-a1e7-784d9770e380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:31.583110 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e0425-9e9f-4776-b33d-8dc147a1cc0d None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:31.605432 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 122/238] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:31.629266 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e703ad6-eb5e-4b19-93cd-bd7618dce20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:31.630124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e703ad6-eb5e-4b19-93cd-bd7618dce20e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:31.630403 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e703ad6-eb5e-4b19-93cd-bd7618dce20e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:31.630671 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e703ad6-eb5e-4b19-93cd-bd7618dce20e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:31.631812 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e703ad6-eb5e-4b19-93cd-bd7618dce20e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:31.633334 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e703ad6-eb5e-4b19-93cd-bd7618dce20e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:31.639532 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 117/239] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:38:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:31.641054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e95a3-30c1-46c7-a1e7-784d9770e380 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:31.645461 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e703ad6-eb5e-4b19-93cd-bd7618dce20e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:31.760529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e95a3-30c1-46c7-a1e7-784d9770e380 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:31.765278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e703ad6-eb5e-4b19-93cd-bd7618dce20e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:31.799077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d6b30-062b-46a0-9ac0-815592c57623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:31.799763 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d6b30-062b-46a0-9ac0-815592c57623 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:31.800037 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d6b30-062b-46a0-9ac0-815592c57623 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:31.800341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d6b30-062b-46a0-9ac0-815592c57623 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:31.801059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d6b30-062b-46a0-9ac0-815592c57623 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:31.802516 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d6b30-062b-46a0-9ac0-815592c57623 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:31.806739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1008e5-6ed5-4883-b5e8-ff081d4f3bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:31.807551 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1008e5-6ed5-4883-b5e8-ff081d4f3bb5 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:31.807830 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1008e5-6ed5-4883-b5e8-ff081d4f3bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:31.808100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1008e5-6ed5-4883-b5e8-ff081d4f3bb5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:31.830826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1008e5-6ed5-4883-b5e8-ff081d4f3bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:31.839474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 123/240] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:38:31 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:31.843162 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-7b1008e5-6ed5-4883-b5e8-ff081d4f3bb5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:38:31.844617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 118/241] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:31.850532 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d6b30-062b-46a0-9ac0-815592c57623 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:32.000389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d6b30-062b-46a0-9ac0-815592c57623 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:32.037141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d50d3-409d-4ab1-a01c-c1df32e5831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:32.038301 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d50d3-409d-4ab1-a01c-c1df32e5831b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:32.038813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d50d3-409d-4ab1-a01c-c1df32e5831b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:32.039317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d50d3-409d-4ab1-a01c-c1df32e5831b None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:32.040399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d50d3-409d-4ab1-a01c-c1df32e5831b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:32.040943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d50d3-409d-4ab1-a01c-c1df32e5831b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:32.042609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d50d3-409d-4ab1-a01c-c1df32e5831b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:32.053624 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 124/242] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:32.059351 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1008e5-6ed5-4883-b5e8-ff081d4f3bb5 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:32.163887 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1008e5-6ed5-4883-b5e8-ff081d4f3bb5 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:32.200573 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb7071-96c0-4420-8964-7ef31aaf2e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:32.201463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb7071-96c0-4420-8964-7ef31aaf2e07 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:32.201745 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb7071-96c0-4420-8964-7ef31aaf2e07 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:32.202019 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb7071-96c0-4420-8964-7ef31aaf2e07 None admin] PATH_INFO: `/v3/users/df80a43885984c199214c62389cc6f9e` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:32.217055 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff57e07-afe9-4a5b-8515-8d7b6ddc68c6 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:32.217341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff57e07-afe9-4a5b-8515-8d7b6ddc68c6 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:32.217611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff57e07-afe9-4a5b-8515-8d7b6ddc68c6 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:32.219539 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 125/243] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:32.222183 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb7071-96c0-4420-8964-7ef31aaf2e07 None admin] RBAC: Authorizing `identity:get_user(user_id=df80a43885984c199214c62389cc6f9e)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:32.223708 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb7071-96c0-4420-8964-7ef31aaf2e07 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:32.227535 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d253f63-5108-4a99-8d48-f17f27a0da74 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:32.227652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 119/244] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:32 2022] GET /identity/v3/users/df80a43885984c199214c62389cc6f9e => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:32.227725 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d253f63-5108-4a99-8d48-f17f27a0da74 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:32.227725 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d253f63-5108-4a99-8d48-f17f27a0da74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:32.231302 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb7071-96c0-4420-8964-7ef31aaf2e07 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:32.248840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-3d253f63-5108-4a99-8d48-f17f27a0da74 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:32.250487 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-3d253f63-5108-4a99-8d48-f17f27a0da74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:32.322046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 126/245] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:32.335820 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb7071-96c0-4420-8964-7ef31aaf2e07 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:32.346560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d253f63-5108-4a99-8d48-f17f27a0da74 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:32.370523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce766411-a5e9-4854-94d0-8d67eb30dc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:32.371428 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce766411-a5e9-4854-94d0-8d67eb30dc4e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:32.371990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce766411-a5e9-4854-94d0-8d67eb30dc4e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:32.372426 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce766411-a5e9-4854-94d0-8d67eb30dc4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:32.444403 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce766411-a5e9-4854-94d0-8d67eb30dc4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:32.445892 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce766411-a5e9-4854-94d0-8d67eb30dc4e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:32.454427 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d253f63-5108-4a99-8d48-f17f27a0da74 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:32.489178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709b924-a8e1-4dc5-b846-a36960b22ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:32.489987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709b924-a8e1-4dc5-b846-a36960b22ba5 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:32.490263 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709b924-a8e1-4dc5-b846-a36960b22ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:32.490541 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709b924-a8e1-4dc5-b846-a36960b22ba5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:32.502981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709b924-a8e1-4dc5-b846-a36960b22ba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:32.510443 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-b709b924-a8e1-4dc5-b846-a36960b22ba5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:32.511457 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 127/246] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:32.517265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709b924-a8e1-4dc5-b846-a36960b22ba5 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:32.548142 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 120/247] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:32.553676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce766411-a5e9-4854-94d0-8d67eb30dc4e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:32.618562 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709b924-a8e1-4dc5-b846-a36960b22ba5 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:32.652452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5837d9-93a1-464f-af7d-7bef12cf1aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:32.653182 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5837d9-93a1-464f-af7d-7bef12cf1aa0 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:32.653462 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5837d9-93a1-464f-af7d-7bef12cf1aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:32.653652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce766411-a5e9-4854-94d0-8d67eb30dc4e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:32.653753 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5837d9-93a1-464f-af7d-7bef12cf1aa0 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:32.654469 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5837d9-93a1-464f-af7d-7bef12cf1aa0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:32.655082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5837d9-93a1-464f-af7d-7bef12cf1aa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:32.656515 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5837d9-93a1-464f-af7d-7bef12cf1aa0 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:32.665486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 128/248] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:32.671386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5837d9-93a1-464f-af7d-7bef12cf1aa0 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:32.697988 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e193c-b2ed-4652-baa0-57d86033f761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:32.698807 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e193c-b2ed-4652-baa0-57d86033f761 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:32.699087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e193c-b2ed-4652-baa0-57d86033f761 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:32.699361 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e193c-b2ed-4652-baa0-57d86033f761 None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:32.700728 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e193c-b2ed-4652-baa0-57d86033f761 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:32.702237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e193c-b2ed-4652-baa0-57d86033f761 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:32.703955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 121/249] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:32 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:32.709834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e193c-b2ed-4652-baa0-57d86033f761 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:32.771747 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5837d9-93a1-464f-af7d-7bef12cf1aa0 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:32.806098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aaa7af-6eeb-4e44-aac9-7fb26c9920bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:32.806990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaa7af-6eeb-4e44-aac9-7fb26c9920bf None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:32.807270 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaa7af-6eeb-4e44-aac9-7fb26c9920bf None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:32.807539 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaa7af-6eeb-4e44-aac9-7fb26c9920bf None admin] PATH_INFO: `/v3/users/888f46d1aa4941ba8571b00b2f59a341` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:32.809082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aaa7af-6eeb-4e44-aac9-7fb26c9920bf None admin] RBAC: Authorizing `identity:get_user(user_id=888f46d1aa4941ba8571b00b2f59a341)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:32.810568 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aaa7af-6eeb-4e44-aac9-7fb26c9920bf None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:32.812530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 129/250] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:32 2022] GET /identity/v3/users/888f46d1aa4941ba8571b00b2f59a341 => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:32.818768 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aaa7af-6eeb-4e44-aac9-7fb26c9920bf None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:32.850684 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e193c-b2ed-4652-baa0-57d86033f761 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:32.894350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402fcbf-22bf-46af-9564-89a5a2cb490e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:32.895021 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402fcbf-22bf-46af-9564-89a5a2cb490e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:32.895295 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402fcbf-22bf-46af-9564-89a5a2cb490e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:32.895562 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402fcbf-22bf-46af-9564-89a5a2cb490e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:32.896437 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402fcbf-22bf-46af-9564-89a5a2cb490e None admin] RBAC: Adding query filter params (role.id=0174fdbdbb3946bdb17aded65287dd75, scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8, user.id=df80a43885984c199214c62389cc6f9e) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:32.896743 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402fcbf-22bf-46af-9564-89a5a2cb490e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:32.898314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402fcbf-22bf-46af-9564-89a5a2cb490e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:32.911754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 122/251] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:32 2022] GET /identity/v3/role_assignments?user.id=df80a43885984c199214c62389cc6f9e&scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8&role.id=0174fdbdbb3946bdb17aded65287dd75 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:32.913245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845c4c7-973f-47f4-8b1f-e7043af459a4 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:32.913528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845c4c7-973f-47f4-8b1f-e7043af459a4 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:32.913800 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845c4c7-973f-47f4-8b1f-e7043af459a4 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:32.915671 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 123/252] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:32.920711 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aaa7af-6eeb-4e44-aac9-7fb26c9920bf None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:32.925850 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69322448-8934-41c7-b57b-526b3efa5c66 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:32.926251 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69322448-8934-41c7-b57b-526b3efa5c66 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:32.926402 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69322448-8934-41c7-b57b-526b3efa5c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:32.957162 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccbab9-fc52-4b24-a37c-f5ea4897d09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:32.957461 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-69322448-8934-41c7-b57b-526b3efa5c66 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:32.957960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccbab9-fc52-4b24-a37c-f5ea4897d09b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:32.958243 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccbab9-fc52-4b24-a37c-f5ea4897d09b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:32.958403 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-69322448-8934-41c7-b57b-526b3efa5c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:32.958548 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccbab9-fc52-4b24-a37c-f5ea4897d09b None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:32.959700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccbab9-fc52-4b24-a37c-f5ea4897d09b None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:32.961179 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccbab9-fc52-4b24-a37c-f5ea4897d09b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:32.963193 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 130/253] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:32 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:32.968977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccbab9-fc52-4b24-a37c-f5ea4897d09b None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:33.064779 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 124/254] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:33.091056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69322448-8934-41c7-b57b-526b3efa5c66 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:33.139506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccbab9-fc52-4b24-a37c-f5ea4897d09b None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:33.209152 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896d382-4b4e-4b96-89b2-5b3b50646c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:33.209977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896d382-4b4e-4b96-89b2-5b3b50646c22 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:33.210257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896d382-4b4e-4b96-89b2-5b3b50646c22 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:33.210534 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896d382-4b4e-4b96-89b2-5b3b50646c22 None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8/users/888f46d1aa4941ba8571b00b2f59a341/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:33.215948 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896d382-4b4e-4b96-89b2-5b3b50646c22 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd1e0280cf34f23ae68adb0de691bc8, user_id=888f46d1aa4941ba8571b00b2f59a341, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:33.217491 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896d382-4b4e-4b96-89b2-5b3b50646c22 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:33.244073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 131/255] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:38:32 2022] PUT /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8/users/888f46d1aa4941ba8571b00b2f59a341/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:38:33.282280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69322448-8934-41c7-b57b-526b3efa5c66 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:33.334339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a10ea7-425e-4072-8281-2cfe9232f90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:33.335211 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a10ea7-425e-4072-8281-2cfe9232f90b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:33.335489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a10ea7-425e-4072-8281-2cfe9232f90b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:33.335754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a10ea7-425e-4072-8281-2cfe9232f90b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:33.350603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a10ea7-425e-4072-8281-2cfe9232f90b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:33.358225 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c7a10ea7-425e-4072-8281-2cfe9232f90b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:38:33.359979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 125/256] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:38:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:38:33.366131 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896d382-4b4e-4b96-89b2-5b3b50646c22 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:33.515448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896d382-4b4e-4b96-89b2-5b3b50646c22 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:33.553724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3e17e-9b88-48c8-8fd0-33ed15c29daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:33.554403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3e17e-9b88-48c8-8fd0-33ed15c29daf None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:33.554683 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3e17e-9b88-48c8-8fd0-33ed15c29daf None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:33.554958 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3e17e-9b88-48c8-8fd0-33ed15c29daf None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:33.555716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3e17e-9b88-48c8-8fd0-33ed15c29daf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:33.556017 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3e17e-9b88-48c8-8fd0-33ed15c29daf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:33.557441 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3e17e-9b88-48c8-8fd0-33ed15c29daf None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:33.567837 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 132/257] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:38:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:33.577897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a10ea7-425e-4072-8281-2cfe9232f90b None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:33.634804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b875cfc-1ab0-47bd-89bf-75a3ba40ce37 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:33.635415 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b875cfc-1ab0-47bd-89bf-75a3ba40ce37 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:33.635907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b875cfc-1ab0-47bd-89bf-75a3ba40ce37 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:33.638064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 133/258] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:33.643477 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495224d-b2a3-4dd9-8ad7-e785d697835c None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:33.644064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495224d-b2a3-4dd9-8ad7-e785d697835c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:33.644623 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495224d-b2a3-4dd9-8ad7-e785d697835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:33.676761 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-5495224d-b2a3-4dd9-8ad7-e785d697835c None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:33.677923 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5495224d-b2a3-4dd9-8ad7-e785d697835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:33.781382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a10ea7-425e-4072-8281-2cfe9232f90b None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:33.816075 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 134/259] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:33.839400 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd9de1-6b62-4769-9f55-a776572e9400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:33.840340 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd9de1-6b62-4769-9f55-a776572e9400 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:33.840756 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd9de1-6b62-4769-9f55-a776572e9400 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:33.841023 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd9de1-6b62-4769-9f55-a776572e9400 None admin] PATH_INFO: `/v3/users/625bef5afad8477cbdc0c64be3016749` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:33.842218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd9de1-6b62-4769-9f55-a776572e9400 None admin] RBAC: Authorizing `identity:get_user(user_id=625bef5afad8477cbdc0c64be3016749)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:33.843675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd9de1-6b62-4769-9f55-a776572e9400 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:33.845651 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 126/260] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:33 2022] GET /identity/v3/users/625bef5afad8477cbdc0c64be3016749 => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:33.851064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495224d-b2a3-4dd9-8ad7-e785d697835c None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:33.862675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd9de1-6b62-4769-9f55-a776572e9400 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:34.061175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495224d-b2a3-4dd9-8ad7-e785d697835c None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:34.087419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd9de1-6b62-4769-9f55-a776572e9400 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:34.128916 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00af4f7-3348-4c19-bff2-d1311ecfb190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:34.129625 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00af4f7-3348-4c19-bff2-d1311ecfb190 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:34.129915 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00af4f7-3348-4c19-bff2-d1311ecfb190 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:34.130192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00af4f7-3348-4c19-bff2-d1311ecfb190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:34.165561 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159b068-44c7-4430-8b47-ac267b43a27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:34.166366 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159b068-44c7-4430-8b47-ac267b43a27b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:34.166641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159b068-44c7-4430-8b47-ac267b43a27b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:34.166910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159b068-44c7-4430-8b47-ac267b43a27b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:34.197107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159b068-44c7-4430-8b47-ac267b43a27b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:34.204387 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-a159b068-44c7-4430-8b47-ac267b43a27b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:38:34.205001 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00af4f7-3348-4c19-bff2-d1311ecfb190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:34.205674 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 127/261] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:38:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:34.206481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00af4f7-3348-4c19-bff2-d1311ecfb190 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:34.226053 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159b068-44c7-4430-8b47-ac267b43a27b None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:34.308758 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 135/262] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:34.314299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00af4f7-3348-4c19-bff2-d1311ecfb190 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:34.401422 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159b068-44c7-4430-8b47-ac267b43a27b None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:34.441774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905a7af-8ce1-4e18-80cc-f236ec41a7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:34.442689 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905a7af-8ce1-4e18-80cc-f236ec41a7cf None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:34.443609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905a7af-8ce1-4e18-80cc-f236ec41a7cf None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:34.444028 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905a7af-8ce1-4e18-80cc-f236ec41a7cf None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:34.445090 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905a7af-8ce1-4e18-80cc-f236ec41a7cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:34.445688 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905a7af-8ce1-4e18-80cc-f236ec41a7cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:34.447365 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905a7af-8ce1-4e18-80cc-f236ec41a7cf None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:34.457807 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 128/263] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:34.464008 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905a7af-8ce1-4e18-80cc-f236ec41a7cf None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:34.506218 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00af4f7-3348-4c19-bff2-d1311ecfb190 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:34.543242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936339c-6561-4f44-8409-26478db33a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:34.544528 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936339c-6561-4f44-8409-26478db33a07 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:34.545845 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936339c-6561-4f44-8409-26478db33a07 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:34.546323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936339c-6561-4f44-8409-26478db33a07 None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:34.547810 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936339c-6561-4f44-8409-26478db33a07 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:34.549583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936339c-6561-4f44-8409-26478db33a07 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:34.552237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 136/264] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:34 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:34.561940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936339c-6561-4f44-8409-26478db33a07 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:34.674559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936339c-6561-4f44-8409-26478db33a07 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:34.722620 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905a7af-8ce1-4e18-80cc-f236ec41a7cf None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:34.814083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13580b35-0b8d-460f-84c8-8c2839543bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:34.814984 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13580b35-0b8d-460f-84c8-8c2839543bdd None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:34.815262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13580b35-0b8d-460f-84c8-8c2839543bdd None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:34.815527 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13580b35-0b8d-460f-84c8-8c2839543bdd None admin] PATH_INFO: `/v3/users/625bef5afad8477cbdc0c64be3016749` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:34.820952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13580b35-0b8d-460f-84c8-8c2839543bdd None admin] RBAC: Authorizing `identity:get_user(user_id=625bef5afad8477cbdc0c64be3016749)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:34.822428 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13580b35-0b8d-460f-84c8-8c2839543bdd None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:34.824425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 129/265] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:34 2022] GET /identity/v3/users/625bef5afad8477cbdc0c64be3016749 => generated 283 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:34.845139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13580b35-0b8d-460f-84c8-8c2839543bdd None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:34.847241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484930be-9902-4e33-873c-3f2aba179c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:34.848109 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484930be-9902-4e33-873c-3f2aba179c75 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:34.848562 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484930be-9902-4e33-873c-3f2aba179c75 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:34.848989 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484930be-9902-4e33-873c-3f2aba179c75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:34.849988 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484930be-9902-4e33-873c-3f2aba179c75 None admin] RBAC: Adding query filter params (role.id=7b4e238c731941f18493cd62e30b1e4f, scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8, user.id=625bef5afad8477cbdc0c64be3016749) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:34.850702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484930be-9902-4e33-873c-3f2aba179c75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:34.853259 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484930be-9902-4e33-873c-3f2aba179c75 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:34.860746 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 137/266] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:34 2022] GET /identity/v3/role_assignments?user.id=625bef5afad8477cbdc0c64be3016749&scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8&role.id=7b4e238c731941f18493cd62e30b1e4f => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:35.020276 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13580b35-0b8d-460f-84c8-8c2839543bdd None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:35.069436 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5e7d9-1e0c-4e85-8e1f-2cc02b006cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:35.070103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5e7d9-1e0c-4e85-8e1f-2cc02b006cbc None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:35.070380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5e7d9-1e0c-4e85-8e1f-2cc02b006cbc None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:35.070652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5e7d9-1e0c-4e85-8e1f-2cc02b006cbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:35.155724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5e7d9-1e0c-4e85-8e1f-2cc02b006cbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:35.157621 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5e7d9-1e0c-4e85-8e1f-2cc02b006cbc None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:35.289020 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 130/267] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:35.295273 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484930be-9902-4e33-873c-3f2aba179c75 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:35.432013 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484930be-9902-4e33-873c-3f2aba179c75 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:35.468137 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba7e3f-6884-4fa1-b488-2e3707cb7f73 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:35.468571 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba7e3f-6884-4fa1-b488-2e3707cb7f73 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:35.468755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba7e3f-6884-4fa1-b488-2e3707cb7f73 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:35.471047 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 131/268] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:35.475688 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576bbdc-e828-409d-84ee-78e11559d3d8 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:35.477132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576bbdc-e828-409d-84ee-78e11559d3d8 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:35.478057 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576bbdc-e828-409d-84ee-78e11559d3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:35.482205 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a134324-f2fc-4019-9c9e-b861ee31a078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:35.484227 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a134324-f2fc-4019-9c9e-b861ee31a078 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:35.485943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a134324-f2fc-4019-9c9e-b861ee31a078 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:35.486474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a134324-f2fc-4019-9c9e-b861ee31a078 None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:35.489918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a134324-f2fc-4019-9c9e-b861ee31a078 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:35.491667 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a134324-f2fc-4019-9c9e-b861ee31a078 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:35.498317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 138/269] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:35 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:35.510722 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-8576bbdc-e828-409d-84ee-78e11559d3d8 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:35.512311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-8576bbdc-e828-409d-84ee-78e11559d3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:35.526243 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a134324-f2fc-4019-9c9e-b861ee31a078 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:35.642437 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 132/270] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:35.674573 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576bbdc-e828-409d-84ee-78e11559d3d8 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:35.694373 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a134324-f2fc-4019-9c9e-b861ee31a078 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:35.774643 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576bbdc-e828-409d-84ee-78e11559d3d8 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:35.782053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f34fd-cd68-46fd-ab69-67d9a77d34f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:35.782733 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f34fd-cd68-46fd-ab69-67d9a77d34f8 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:35.783012 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f34fd-cd68-46fd-ab69-67d9a77d34f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:35.783280 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f34fd-cd68-46fd-ab69-67d9a77d34f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:35.784121 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f34fd-cd68-46fd-ab69-67d9a77d34f8 None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8, user.id=625bef5afad8477cbdc0c64be3016749) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:35.784439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f34fd-cd68-46fd-ab69-67d9a77d34f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:35.785887 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f34fd-cd68-46fd-ab69-67d9a77d34f8 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:35.798612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 139/271] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:35 2022] GET /identity/v3/role_assignments?user.id=625bef5afad8477cbdc0c64be3016749&scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8&role.id=85136c55809b4d9db97c263a72392ad1 => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:35.815885 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d375f0-c6a2-4c8f-915d-28d1b9a11b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:35.817134 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d375f0-c6a2-4c8f-915d-28d1b9a11b9e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:35.817618 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d375f0-c6a2-4c8f-915d-28d1b9a11b9e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:35.818082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d375f0-c6a2-4c8f-915d-28d1b9a11b9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:35.819582 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d375f0-c6a2-4c8f-915d-28d1b9a11b9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:35.821495 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d375f0-c6a2-4c8f-915d-28d1b9a11b9e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:35.823505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 133/272] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:38:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:35.829574 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f34fd-cd68-46fd-ab69-67d9a77d34f8 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:35.976627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f34fd-cd68-46fd-ab69-67d9a77d34f8 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:36.014813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea29b8c-f97b-4946-9e65-0f14cbe94b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:36.015509 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea29b8c-f97b-4946-9e65-0f14cbe94b46 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:36.015787 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea29b8c-f97b-4946-9e65-0f14cbe94b46 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:36.016059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea29b8c-f97b-4946-9e65-0f14cbe94b46 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:36.016844 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea29b8c-f97b-4946-9e65-0f14cbe94b46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:36.018351 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea29b8c-f97b-4946-9e65-0f14cbe94b46 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:36.044407 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 140/273] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:38:35 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:36.080768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e99ba-bbc3-45df-979d-9faed90c4842 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:36.081396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e99ba-bbc3-45df-979d-9faed90c4842 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:36.081867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e99ba-bbc3-45df-979d-9faed90c4842 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:36.084313 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 134/274] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:36.090170 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c527c35-8e11-4922-9635-007af386fea4 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:36.090619 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c527c35-8e11-4922-9635-007af386fea4 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:36.090804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c527c35-8e11-4922-9635-007af386fea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:36.112278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-2c527c35-8e11-4922-9635-007af386fea4 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:36.113879 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2c527c35-8e11-4922-9635-007af386fea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:36.196183 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 141/275] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:36.222399 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e99ba-bbc3-45df-979d-9faed90c4842 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:36.343367 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e99ba-bbc3-45df-979d-9faed90c4842 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:36.378882 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae338320-3b6d-446c-817a-853dea183b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:36.379687 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae338320-3b6d-446c-817a-853dea183b66 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:36.379961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae338320-3b6d-446c-817a-853dea183b66 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:36.380246 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae338320-3b6d-446c-817a-853dea183b66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:36.391000 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae338320-3b6d-446c-817a-853dea183b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:36.398136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-ae338320-3b6d-446c-817a-853dea183b66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:36.399373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 135/276] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:36.405595 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c527c35-8e11-4922-9635-007af386fea4 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:36.528806 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e04588-ac18-4bfa-8eab-a69fd607af5f None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:36.529345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e04588-ac18-4bfa-8eab-a69fd607af5f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:36.529345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e04588-ac18-4bfa-8eab-a69fd607af5f None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:36.531629 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 136/277] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:38:36.533679 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c527c35-8e11-4922-9635-007af386fea4 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:36.538450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44dea3-9719-4ef4-995d-48aa688af5bf None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:36.538450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44dea3-9719-4ef4-995d-48aa688af5bf None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:36.538702 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44dea3-9719-4ef4-995d-48aa688af5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:36.561678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-6b44dea3-9719-4ef4-995d-48aa688af5bf None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:36.563034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-6b44dea3-9719-4ef4-995d-48aa688af5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:36.577988 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970c6b7-cc79-4295-9696-9a7342643d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:36.578694 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970c6b7-cc79-4295-9696-9a7342643d34 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:36.578971 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970c6b7-cc79-4295-9696-9a7342643d34 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:36.579239 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970c6b7-cc79-4295-9696-9a7342643d34 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:36.580007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970c6b7-cc79-4295-9696-9a7342643d34 None admin] RBAC: Adding query filter params (name=member) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:36.580341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970c6b7-cc79-4295-9696-9a7342643d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:36.581897 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970c6b7-cc79-4295-9696-9a7342643d34 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:36.596759 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 142/278] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:36.602314 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970c6b7-cc79-4295-9696-9a7342643d34 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:36.636334 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 137/279] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:36.655811 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44dea3-9719-4ef4-995d-48aa688af5bf None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:36.711255 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970c6b7-cc79-4295-9696-9a7342643d34 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:36.745285 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685ea16-eec2-4068-a18c-95f33b8fa0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:36.746186 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685ea16-eec2-4068-a18c-95f33b8fa0d1 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:36.746442 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685ea16-eec2-4068-a18c-95f33b8fa0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:36.746761 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685ea16-eec2-4068-a18c-95f33b8fa0d1 None admin] PATH_INFO: `/v3/users/9f6626b4927c45ea88895b6b0b570215` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:36.756050 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44dea3-9719-4ef4-995d-48aa688af5bf None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:36.760682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685ea16-eec2-4068-a18c-95f33b8fa0d1 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6626b4927c45ea88895b6b0b570215)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:36.762227 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685ea16-eec2-4068-a18c-95f33b8fa0d1 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:36.764468 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 143/280] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:36 2022] GET /identity/v3/users/9f6626b4927c45ea88895b6b0b570215 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:36.771270 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685ea16-eec2-4068-a18c-95f33b8fa0d1 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:36.791235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f8e0c-5e2e-4b30-83bc-ad4a5c4a8013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:36.792051 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f8e0c-5e2e-4b30-83bc-ad4a5c4a8013 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:36.792355 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f8e0c-5e2e-4b30-83bc-ad4a5c4a8013 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:36.792626 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f8e0c-5e2e-4b30-83bc-ad4a5c4a8013 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:36.803509 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f8e0c-5e2e-4b30-83bc-ad4a5c4a8013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:36.810674 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-990f8e0c-5e2e-4b30-83bc-ad4a5c4a8013 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:36.811891 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 138/281] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:38:36.817988 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e3846-f6fb-4c79-a479-d18731b28923 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:36.818269 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e3846-f6fb-4c79-a479-d18731b28923 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:36.818542 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e3846-f6fb-4c79-a479-d18731b28923 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:36.820236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 139/282] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:36.821579 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e3846-f6fb-4c79-a479-d18731b28923 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:36.876643 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685ea16-eec2-4068-a18c-95f33b8fa0d1 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:36.910219 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbced73-892b-455b-8bf6-ab2316f46c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:36.910869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbced73-892b-455b-8bf6-ab2316f46c93 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:36.911143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbced73-892b-455b-8bf6-ab2316f46c93 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:36.911410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbced73-892b-455b-8bf6-ab2316f46c93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:36.912245 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbced73-892b-455b-8bf6-ab2316f46c93 None admin] RBAC: Adding query filter params (role.id=ab7ac47ce77b490b8868c79a13a2a0aa, user.id=9f6626b4927c45ea88895b6b0b570215, scope.system=all) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:36.912564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbced73-892b-455b-8bf6-ab2316f46c93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:36.914032 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbced73-892b-455b-8bf6-ab2316f46c93 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:36.919048 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 144/283] 10.222.0.90 () {56 vars in 1308 bytes} [Wed Nov 2 12:38:36 2022] GET /identity/v3/role_assignments?user.id=9f6626b4927c45ea88895b6b0b570215&scope.system=all&role.id=ab7ac47ce77b490b8868c79a13a2a0aa => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:36.920392 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e852b9-9560-4ed3-a009-8228c5fe0848 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:36.920677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e852b9-9560-4ed3-a009-8228c5fe0848 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:36.920948 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e852b9-9560-4ed3-a009-8228c5fe0848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:36.928395 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e3846-f6fb-4c79-a479-d18731b28923 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:36.938861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-b2e852b9-9560-4ed3-a009-8228c5fe0848 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:36.940057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b2e852b9-9560-4ed3-a009-8228c5fe0848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:36.965626 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49599af1-c138-44f1-8b2a-0c29496b34b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:36.966331 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49599af1-c138-44f1-8b2a-0c29496b34b1 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:36.966613 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49599af1-c138-44f1-8b2a-0c29496b34b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:36.966886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49599af1-c138-44f1-8b2a-0c29496b34b1 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:36.967649 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49599af1-c138-44f1-8b2a-0c29496b34b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:36.968005 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49599af1-c138-44f1-8b2a-0c29496b34b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:36.969769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49599af1-c138-44f1-8b2a-0c29496b34b1 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:36.979634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 140/284] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:36.996527 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49599af1-c138-44f1-8b2a-0c29496b34b1 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:37.015453 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 145/285] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:37.072435 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e852b9-9560-4ed3-a009-8228c5fe0848 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:37.173235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49599af1-c138-44f1-8b2a-0c29496b34b1 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:37.177784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e852b9-9560-4ed3-a009-8228c5fe0848 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:37.218388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f08c5-05b6-4c0d-a3bd-35f1cc10ed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:37.219264 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f08c5-05b6-4c0d-a3bd-35f1cc10ed11 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:37.219757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f08c5-05b6-4c0d-a3bd-35f1cc10ed11 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:37.220066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f08c5-05b6-4c0d-a3bd-35f1cc10ed11 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:37.236052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f05cb-631f-4dea-b736-268738229dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:37.236973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f05cb-631f-4dea-b736-268738229dd3 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:37.237249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f05cb-631f-4dea-b736-268738229dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:37.237520 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f05cb-631f-4dea-b736-268738229dd3 None admin] PATH_INFO: `/v3/users/888f46d1aa4941ba8571b00b2f59a341` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:37.239595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f05cb-631f-4dea-b736-268738229dd3 None admin] RBAC: Authorizing `identity:get_user(user_id=888f46d1aa4941ba8571b00b2f59a341)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:37.241122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f05cb-631f-4dea-b736-268738229dd3 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:37.242787 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 141/286] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:36 2022] GET /identity/v3/users/888f46d1aa4941ba8571b00b2f59a341 => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:37.246028 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f08c5-05b6-4c0d-a3bd-35f1cc10ed11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:37.253717 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-c16f08c5-05b6-4c0d-a3bd-35f1cc10ed11 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:38:37.256025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f05cb-631f-4dea-b736-268738229dd3 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:37.259679 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 146/287] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:38:37.265266 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f08c5-05b6-4c0d-a3bd-35f1cc10ed11 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:37.376562 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f08c5-05b6-4c0d-a3bd-35f1cc10ed11 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:37.410773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72de1e-a4c9-446d-8a72-67bfe1b358f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:37.411449 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72de1e-a4c9-446d-8a72-67bfe1b358f7 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:37.411729 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72de1e-a4c9-446d-8a72-67bfe1b358f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:37.411999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72de1e-a4c9-446d-8a72-67bfe1b358f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:37.412775 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72de1e-a4c9-446d-8a72-67bfe1b358f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:37.413079 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72de1e-a4c9-446d-8a72-67bfe1b358f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:37.414472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72de1e-a4c9-446d-8a72-67bfe1b358f7 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:37.418295 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f05cb-631f-4dea-b736-268738229dd3 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:37.430500 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 147/288] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:37.436584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72de1e-a4c9-446d-8a72-67bfe1b358f7 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:37.459357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171d4bc-762e-4d1b-9ac7-247ba325163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:37.460011 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171d4bc-762e-4d1b-9ac7-247ba325163e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:37.462886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171d4bc-762e-4d1b-9ac7-247ba325163e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:37.462886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171d4bc-762e-4d1b-9ac7-247ba325163e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:37.568615 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171d4bc-762e-4d1b-9ac7-247ba325163e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:37.570106 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171d4bc-762e-4d1b-9ac7-247ba325163e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:37.615568 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72de1e-a4c9-446d-8a72-67bfe1b358f7 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:37.683856 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 142/289] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:37.684082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55cda8-45b8-4087-8e81-6b4912243a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:37.685123 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55cda8-45b8-4087-8e81-6b4912243a73 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:37.685402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55cda8-45b8-4087-8e81-6b4912243a73 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:37.685670 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55cda8-45b8-4087-8e81-6b4912243a73 None admin] PATH_INFO: `/v3/users/df80a43885984c199214c62389cc6f9e` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:37.686906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55cda8-45b8-4087-8e81-6b4912243a73 None admin] RBAC: Authorizing `identity:get_user(user_id=df80a43885984c199214c62389cc6f9e)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:37.688588 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55cda8-45b8-4087-8e81-6b4912243a73 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:37.690806 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 148/290] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:37 2022] GET /identity/v3/users/df80a43885984c199214c62389cc6f9e => generated 297 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:37.691814 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171d4bc-762e-4d1b-9ac7-247ba325163e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:37.697167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55cda8-45b8-4087-8e81-6b4912243a73 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:37.803534 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171d4bc-762e-4d1b-9ac7-247ba325163e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:37.843289 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e26784-9c03-4c7a-b77d-74981272afee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:37.844288 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e26784-9c03-4c7a-b77d-74981272afee None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:37.844691 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e26784-9c03-4c7a-b77d-74981272afee None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:37.844965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e26784-9c03-4c7a-b77d-74981272afee None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:37.846342 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e26784-9c03-4c7a-b77d-74981272afee None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:37.848224 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e26784-9c03-4c7a-b77d-74981272afee None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:37.855175 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 143/291] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:37 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:37.856469 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e26784-9c03-4c7a-b77d-74981272afee None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:37.873729 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55cda8-45b8-4087-8e81-6b4912243a73 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:37.928991 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b375c7-580c-4837-9e90-5bd2e059ba52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:37.930302 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b375c7-580c-4837-9e90-5bd2e059ba52 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:37.930811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b375c7-580c-4837-9e90-5bd2e059ba52 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:37.931282 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b375c7-580c-4837-9e90-5bd2e059ba52 None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:37.935892 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b375c7-580c-4837-9e90-5bd2e059ba52 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:37.937688 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b375c7-580c-4837-9e90-5bd2e059ba52 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:37.939740 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 149/292] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:37 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:37.945540 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b375c7-580c-4837-9e90-5bd2e059ba52 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:37.968267 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e26784-9c03-4c7a-b77d-74981272afee None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:38.007739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302f4bb-3519-4aaa-9b69-d09054f00ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:38.008432 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302f4bb-3519-4aaa-9b69-d09054f00ae9 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:38.008706 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302f4bb-3519-4aaa-9b69-d09054f00ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:38.008975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302f4bb-3519-4aaa-9b69-d09054f00ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:38.009802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302f4bb-3519-4aaa-9b69-d09054f00ae9 None admin] RBAC: Adding query filter params (role.id=ab7ac47ce77b490b8868c79a13a2a0aa, scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8, user.id=888f46d1aa4941ba8571b00b2f59a341) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:38.010104 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302f4bb-3519-4aaa-9b69-d09054f00ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:38.011537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302f4bb-3519-4aaa-9b69-d09054f00ae9 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:38.026990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 144/293] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:37 2022] GET /identity/v3/role_assignments?user.id=888f46d1aa4941ba8571b00b2f59a341&scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8&role.id=ab7ac47ce77b490b8868c79a13a2a0aa => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:38.101973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b375c7-580c-4837-9e90-5bd2e059ba52 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:38.142157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290154fb-0327-44a4-a3a0-c40ad70deeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:38.143133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290154fb-0327-44a4-a3a0-c40ad70deeab None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:38.143418 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290154fb-0327-44a4-a3a0-c40ad70deeab None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:38.143690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290154fb-0327-44a4-a3a0-c40ad70deeab None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8/users/df80a43885984c199214c62389cc6f9e/roles/0174fdbdbb3946bdb17aded65287dd75` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:38.145930 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290154fb-0327-44a4-a3a0-c40ad70deeab None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd1e0280cf34f23ae68adb0de691bc8, user_id=df80a43885984c199214c62389cc6f9e, role_id=0174fdbdbb3946bdb17aded65287dd75)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:38.147458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290154fb-0327-44a4-a3a0-c40ad70deeab None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:38.166458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 150/294] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:38:37 2022] PUT /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8/users/df80a43885984c199214c62389cc6f9e/roles/0174fdbdbb3946bdb17aded65287dd75 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:38:38.978114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a761-5a5e-4d13-846a-c558e90e75eb None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:38.978650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a761-5a5e-4d13-846a-c558e90e75eb None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:38.978650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a761-5a5e-4d13-846a-c558e90e75eb None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:38.980759 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 145/295] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:38.986526 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669727e8-c7e0-4568-a059-5c519e4c6c95 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:38.987005 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669727e8-c7e0-4568-a059-5c519e4c6c95 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:38.987080 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669727e8-c7e0-4568-a059-5c519e4c6c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.004973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-669727e8-c7e0-4568-a059-5c519e4c6c95 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:39.006167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-669727e8-c7e0-4568-a059-5c519e4c6c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:39.072627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 151/296] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:39.096475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a761-5a5e-4d13-846a-c558e90e75eb None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:39.127108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff68987-d01e-4870-ae95-e5d2c6392695 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.127386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff68987-d01e-4870-ae95-e5d2c6392695 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.127828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff68987-d01e-4870-ae95-e5d2c6392695 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.133752 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 152/297] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:38:39.135181 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56eab7-7fdc-411a-9e6c-aec7ea9d6170 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.135625 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56eab7-7fdc-411a-9e6c-aec7ea9d6170 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.136038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56eab7-7fdc-411a-9e6c-aec7ea9d6170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.159201 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-9a56eab7-7fdc-411a-9e6c-aec7ea9d6170 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:39.160620 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-9a56eab7-7fdc-411a-9e6c-aec7ea9d6170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:39.216347 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a761-5a5e-4d13-846a-c558e90e75eb None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:39.252403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 153/298] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:39.254100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ced48-f819-48a8-bc98-925aec2d2d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:39.254973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ced48-f819-48a8-bc98-925aec2d2d82 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.255257 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ced48-f819-48a8-bc98-925aec2d2d82 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.255532 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ced48-f819-48a8-bc98-925aec2d2d82 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.265605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ced48-f819-48a8-bc98-925aec2d2d82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:39.270352 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56eab7-7fdc-411a-9e6c-aec7ea9d6170 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:39.273082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-6c4ced48-f819-48a8-bc98-925aec2d2d82 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:38:39.274628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 146/299] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:39.281148 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ced48-f819-48a8-bc98-925aec2d2d82 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:39.371253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56eab7-7fdc-411a-9e6c-aec7ea9d6170 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:39.405634 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dffb74-acd5-4f72-97fe-25fbd2cfeabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:39.406941 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dffb74-acd5-4f72-97fe-25fbd2cfeabc None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.407485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dffb74-acd5-4f72-97fe-25fbd2cfeabc None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.407973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dffb74-acd5-4f72-97fe-25fbd2cfeabc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.408637 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ced48-f819-48a8-bc98-925aec2d2d82 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:39.409614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dffb74-acd5-4f72-97fe-25fbd2cfeabc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:39.411324 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dffb74-acd5-4f72-97fe-25fbd2cfeabc None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:39.418028 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 154/300] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:38:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:39.419605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dffb74-acd5-4f72-97fe-25fbd2cfeabc None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:39.449558 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d1c71-58d2-44bb-866b-adb9b7cb6e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:39.450482 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d1c71-58d2-44bb-866b-adb9b7cb6e69 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.450765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d1c71-58d2-44bb-866b-adb9b7cb6e69 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.451038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d1c71-58d2-44bb-866b-adb9b7cb6e69 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.452125 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d1c71-58d2-44bb-866b-adb9b7cb6e69 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:39.452789 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d1c71-58d2-44bb-866b-adb9b7cb6e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:39.454296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d1c71-58d2-44bb-866b-adb9b7cb6e69 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:39.471101 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 147/301] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:39.476941 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d1c71-58d2-44bb-866b-adb9b7cb6e69 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:39.547126 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dffb74-acd5-4f72-97fe-25fbd2cfeabc None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:39.581380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d1c71-58d2-44bb-866b-adb9b7cb6e69 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:39.585925 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470b9fa-cd31-4ea5-a60c-69ff685000b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:39.586877 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470b9fa-cd31-4ea5-a60c-69ff685000b7 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.587379 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470b9fa-cd31-4ea5-a60c-69ff685000b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.588331 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470b9fa-cd31-4ea5-a60c-69ff685000b7 None admin] PATH_INFO: `/v3/groups` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.589234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470b9fa-cd31-4ea5-a60c-69ff685000b7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:39.591621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470b9fa-cd31-4ea5-a60c-69ff685000b7 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:39.608952 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 155/302] 10.222.0.90 () {60 vars in 1134 bytes} [Wed Nov 2 12:38:39 2022] POST /identity/v3/groups => generated 229 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:38:39.610548 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80424093-406e-4d41-9a2e-ca09f9b81202 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.611065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80424093-406e-4d41-9a2e-ca09f9b81202 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.611547 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80424093-406e-4d41-9a2e-ca09f9b81202 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.613847 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 156/303] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:39.620585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0759a57-9f6d-4650-a5e2-417635d64243 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.621766 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0759a57-9f6d-4650-a5e2-417635d64243 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.622762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0759a57-9f6d-4650-a5e2-417635d64243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.626423 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0cfb9-1df1-44d3-8213-4491fbadcb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:39.627438 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0cfb9-1df1-44d3-8213-4491fbadcb95 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.627723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0cfb9-1df1-44d3-8213-4491fbadcb95 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.628004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0cfb9-1df1-44d3-8213-4491fbadcb95 None admin] PATH_INFO: `/v3/users/ba3ab35516ad451b88afeb28fa04ef04` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.645462 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-a0759a57-9f6d-4650-a5e2-417635d64243 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:39.647510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-a0759a57-9f6d-4650-a5e2-417635d64243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:39.647770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0cfb9-1df1-44d3-8213-4491fbadcb95 None admin] RBAC: Authorizing `identity:get_user(user_id=ba3ab35516ad451b88afeb28fa04ef04)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:39.649468 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0cfb9-1df1-44d3-8213-4491fbadcb95 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:39.658952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 148/304] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:39 2022] GET /identity/v3/users/ba3ab35516ad451b88afeb28fa04ef04 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:39.661275 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0cfb9-1df1-44d3-8213-4491fbadcb95 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:39.736554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 157/305] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:39.755564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0759a57-9f6d-4650-a5e2-417635d64243 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:39.770408 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0cfb9-1df1-44d3-8213-4491fbadcb95 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:39.808859 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8558d-b857-4bcd-9198-91d303e0d438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:39.809545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8558d-b857-4bcd-9198-91d303e0d438 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.809845 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8558d-b857-4bcd-9198-91d303e0d438 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.810128 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8558d-b857-4bcd-9198-91d303e0d438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.811171 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8558d-b857-4bcd-9198-91d303e0d438 None admin] RBAC: Adding query filter params (role.id=0174fdbdbb3946bdb17aded65287dd75, user.id=ba3ab35516ad451b88afeb28fa04ef04, scope.system=all) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:39.811866 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8558d-b857-4bcd-9198-91d303e0d438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:39.813393 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8558d-b857-4bcd-9198-91d303e0d438 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:39.818542 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 149/306] 10.222.0.90 () {56 vars in 1308 bytes} [Wed Nov 2 12:38:39 2022] GET /identity/v3/role_assignments?user.id=ba3ab35516ad451b88afeb28fa04ef04&scope.system=all&role.id=0174fdbdbb3946bdb17aded65287dd75 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:39.867669 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0759a57-9f6d-4650-a5e2-417635d64243 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:39.906607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaca6fc-90e5-4761-84c2-148a6f6c1e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:39.907576 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaca6fc-90e5-4761-84c2-148a6f6c1e16 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.907865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaca6fc-90e5-4761-84c2-148a6f6c1e16 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.908145 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaca6fc-90e5-4761-84c2-148a6f6c1e16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.920309 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaca6fc-90e5-4761-84c2-148a6f6c1e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:39.927618 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-8aaca6fc-90e5-4761-84c2-148a6f6c1e16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:39.928926 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 158/307] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:38:39.935231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8558d-b857-4bcd-9198-91d303e0d438 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:40.044698 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8558d-b857-4bcd-9198-91d303e0d438 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:40.080545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088031a-3f3c-46c8-ba26-c4da96611efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:40.081147 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088031a-3f3c-46c8-ba26-c4da96611efb None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:40.081430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088031a-3f3c-46c8-ba26-c4da96611efb None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:40.081708 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088031a-3f3c-46c8-ba26-c4da96611efb None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:40.082459 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088031a-3f3c-46c8-ba26-c4da96611efb None admin] RBAC: Adding query filter params (name=member) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:40.082762 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088031a-3f3c-46c8-ba26-c4da96611efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:40.084140 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088031a-3f3c-46c8-ba26-c4da96611efb None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:40.092856 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 150/308] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:40.098425 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaca6fc-90e5-4761-84c2-148a6f6c1e16 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:40.200849 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaca6fc-90e5-4761-84c2-148a6f6c1e16 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:40.235805 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e414478-195d-48a0-98d3-bc3849aeadb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:40.236725 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e414478-195d-48a0-98d3-bc3849aeadb5 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:40.237006 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e414478-195d-48a0-98d3-bc3849aeadb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:40.237281 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e414478-195d-48a0-98d3-bc3849aeadb5 None admin] PATH_INFO: `/v3/users/9f6626b4927c45ea88895b6b0b570215` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:40.238475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e414478-195d-48a0-98d3-bc3849aeadb5 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6626b4927c45ea88895b6b0b570215)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:40.239978 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e414478-195d-48a0-98d3-bc3849aeadb5 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:40.241933 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 159/309] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:40 2022] GET /identity/v3/users/9f6626b4927c45ea88895b6b0b570215 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:40.247582 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088031a-3f3c-46c8-ba26-c4da96611efb None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:40.350011 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088031a-3f3c-46c8-ba26-c4da96611efb None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:40.384480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfdd68-a148-42f3-bd28-fa1947b899f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:40.385374 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfdd68-a148-42f3-bd28-fa1947b899f3 None admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:40.385658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfdd68-a148-42f3-bd28-fa1947b899f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:40.385935 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfdd68-a148-42f3-bd28-fa1947b899f3 None admin] PATH_INFO: `/v3/system/users/9f6626b4927c45ea88895b6b0b570215/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:40.387544 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfdd68-a148-42f3-bd28-fa1947b899f3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9f6626b4927c45ea88895b6b0b570215, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:40.389093 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfdd68-a148-42f3-bd28-fa1947b899f3 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:40.399077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 151/310] 10.222.0.90 () {58 vars in 1334 bytes} [Wed Nov 2 12:38:40 2022] PUT /identity/v3/system/users/9f6626b4927c45ea88895b6b0b570215/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:40.693211 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e446b7-3cac-4367-ac02-fbbd8a7444fd None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:40.693533 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e446b7-3cac-4367-ac02-fbbd8a7444fd None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:40.693764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e446b7-3cac-4367-ac02-fbbd8a7444fd None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:40.695571 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 160/311] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:40.701291 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc4093-727e-48db-89d4-c60a5388181d None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:40.701576 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc4093-727e-48db-89d4-c60a5388181d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:40.701860 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc4093-727e-48db-89d4-c60a5388181d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:40.719132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-21fc4093-727e-48db-89d4-c60a5388181d None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:40.720892 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-21fc4093-727e-48db-89d4-c60a5388181d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:40.786835 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 152/312] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:40.814586 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e446b7-3cac-4367-ac02-fbbd8a7444fd None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:40.921831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e446b7-3cac-4367-ac02-fbbd8a7444fd None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:40.956060 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b5660-dc16-4def-8fc0-c40d10661a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:40.956854 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b5660-dc16-4def-8fc0-c40d10661a6e None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:40.957132 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b5660-dc16-4def-8fc0-c40d10661a6e None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:40.957409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b5660-dc16-4def-8fc0-c40d10661a6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:40.967770 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b5660-dc16-4def-8fc0-c40d10661a6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:40.974792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-6e6b5660-dc16-4def-8fc0-c40d10661a6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:38:40.976304 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 161/313] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:40.982440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc4093-727e-48db-89d4-c60a5388181d None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:41.081054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc4093-727e-48db-89d4-c60a5388181d None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:41.114549 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ea03f-19ec-48ce-94be-4e4b8f4cad41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:41.115229 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ea03f-19ec-48ce-94be-4e4b8f4cad41 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:41.115509 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ea03f-19ec-48ce-94be-4e4b8f4cad41 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:41.115785 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ea03f-19ec-48ce-94be-4e4b8f4cad41 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:41.116564 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ea03f-19ec-48ce-94be-4e4b8f4cad41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:41.116876 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ea03f-19ec-48ce-94be-4e4b8f4cad41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:41.118353 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ea03f-19ec-48ce-94be-4e4b8f4cad41 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:41.127042 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 153/314] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:41.132458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b5660-dc16-4def-8fc0-c40d10661a6e None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:41.233565 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b5660-dc16-4def-8fc0-c40d10661a6e None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:41.267844 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a7993-4e44-45c9-902a-6cb695727512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:41.269108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a7993-4e44-45c9-902a-6cb695727512 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:41.269593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a7993-4e44-45c9-902a-6cb695727512 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:41.270061 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a7993-4e44-45c9-902a-6cb695727512 None admin] PATH_INFO: `/v3/users/df80a43885984c199214c62389cc6f9e` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:41.271470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a7993-4e44-45c9-902a-6cb695727512 None admin] RBAC: Authorizing `identity:get_user(user_id=df80a43885984c199214c62389cc6f9e)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:41.273232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a7993-4e44-45c9-902a-6cb695727512 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:41.275379 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 162/315] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:41 2022] GET /identity/v3/users/df80a43885984c199214c62389cc6f9e => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:41.281834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ea03f-19ec-48ce-94be-4e4b8f4cad41 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:41.385643 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ea03f-19ec-48ce-94be-4e4b8f4cad41 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:41.418878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901051df-f76d-431e-b2b3-34e5b0326fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:41.419554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901051df-f76d-431e-b2b3-34e5b0326fce None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:41.419831 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901051df-f76d-431e-b2b3-34e5b0326fce None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:41.420099 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901051df-f76d-431e-b2b3-34e5b0326fce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:41.487642 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901051df-f76d-431e-b2b3-34e5b0326fce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:41.489132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901051df-f76d-431e-b2b3-34e5b0326fce None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:41.588118 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 154/316] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:41.593512 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a7993-4e44-45c9-902a-6cb695727512 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:41.698700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a7993-4e44-45c9-902a-6cb695727512 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:41.735921 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc3fc9-e7bc-4156-b17c-c5b094ef7ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:41.737287 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc3fc9-e7bc-4156-b17c-c5b094ef7ac1 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:41.737836 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc3fc9-e7bc-4156-b17c-c5b094ef7ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:41.738315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc3fc9-e7bc-4156-b17c-c5b094ef7ac1 None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:41.740035 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc3fc9-e7bc-4156-b17c-c5b094ef7ac1 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:41.741837 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc3fc9-e7bc-4156-b17c-c5b094ef7ac1 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:41.744307 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 163/317] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:41 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:41.750887 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901051df-f76d-431e-b2b3-34e5b0326fce None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:41.852195 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901051df-f76d-431e-b2b3-34e5b0326fce None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:41.891692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9710f-42d0-4d39-9685-087de6dcec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:41.892439 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9710f-42d0-4d39-9685-087de6dcec3f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:41.892729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9710f-42d0-4d39-9685-087de6dcec3f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:41.893003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9710f-42d0-4d39-9685-087de6dcec3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:41.893876 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9710f-42d0-4d39-9685-087de6dcec3f None admin] RBAC: Adding query filter params (role.id=0174fdbdbb3946bdb17aded65287dd75, scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8, user.id=df80a43885984c199214c62389cc6f9e) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:41.894181 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9710f-42d0-4d39-9685-087de6dcec3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:41.895718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9710f-42d0-4d39-9685-087de6dcec3f None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:41.902933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 155/318] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:38:41 2022] GET /identity/v3/role_assignments?user.id=df80a43885984c199214c62389cc6f9e&scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8&role.id=0174fdbdbb3946bdb17aded65287dd75 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:42.124261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a53c6-08f1-46c3-ad64-14387c359813 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:42.124598 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a53c6-08f1-46c3-ad64-14387c359813 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:42.124764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a53c6-08f1-46c3-ad64-14387c359813 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:42.126788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 164/319] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:42.132900 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5234c-f474-49e1-9aad-64fc09fcb6d5 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:42.133829 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5234c-f474-49e1-9aad-64fc09fcb6d5 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:42.134294 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5234c-f474-49e1-9aad-64fc09fcb6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:42.152193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-14d5234c-f474-49e1-9aad-64fc09fcb6d5 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:42.153572 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-14d5234c-f474-49e1-9aad-64fc09fcb6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:42.219868 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 156/320] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:42.243023 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a53c6-08f1-46c3-ad64-14387c359813 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:42.268174 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df342a-7115-45de-b509-61a176e6da75 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:42.268535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df342a-7115-45de-b509-61a176e6da75 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:42.268768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df342a-7115-45de-b509-61a176e6da75 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:42.270732 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 157/321] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:38:42.275600 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa55b1b-6c38-4d68-a786-fe9d5220782e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:42.275865 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa55b1b-6c38-4d68-a786-fe9d5220782e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:42.276130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa55b1b-6c38-4d68-a786-fe9d5220782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:42.293122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-aaa55b1b-6c38-4d68-a786-fe9d5220782e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:42.294337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-aaa55b1b-6c38-4d68-a786-fe9d5220782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:42.345003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a53c6-08f1-46c3-ad64-14387c359813 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:42.358390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 158/322] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:42.379668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ffcae-0b36-4f67-b6d9-530df308aaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:42.380747 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ffcae-0b36-4f67-b6d9-530df308aaea None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:42.380864 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa55b1b-6c38-4d68-a786-fe9d5220782e None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:42.381001 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ffcae-0b36-4f67-b6d9-530df308aaea None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:42.381426 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ffcae-0b36-4f67-b6d9-530df308aaea None admin] PATH_INFO: `/v3/domains/default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:42.382575 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ffcae-0b36-4f67-b6d9-530df308aaea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:42.384018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ffcae-0b36-4f67-b6d9-530df308aaea None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:42.385770 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 165/323] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:38:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:42.391763 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ffcae-0b36-4f67-b6d9-530df308aaea None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:42.481120 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa55b1b-6c38-4d68-a786-fe9d5220782e None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:42.492599 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ffcae-0b36-4f67-b6d9-530df308aaea None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:42.520780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e4a6f-b70e-4376-b9f1-101935823c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:42.521578 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e4a6f-b70e-4376-b9f1-101935823c56 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:42.521870 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e4a6f-b70e-4376-b9f1-101935823c56 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:42.522129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e4a6f-b70e-4376-b9f1-101935823c56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:42.529868 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5fcbb-b219-483b-9874-3bcde7852ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:42.530783 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5fcbb-b219-483b-9874-3bcde7852ea6 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:42.531253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5fcbb-b219-483b-9874-3bcde7852ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:42.531733 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5fcbb-b219-483b-9874-3bcde7852ea6 None admin] PATH_INFO: `/v3/groups` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:42.532647 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5fcbb-b219-483b-9874-3bcde7852ea6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:42.533049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e4a6f-b70e-4376-b9f1-101935823c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:42.534510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5fcbb-b219-483b-9874-3bcde7852ea6 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:42.540074 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-605e4a6f-b70e-4376-b9f1-101935823c56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:38:42.546320 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 159/324] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:38:42.547792 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e4a6f-b70e-4376-b9f1-101935823c56 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:42.556296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 166/325] 10.222.0.90 () {60 vars in 1134 bytes} [Wed Nov 2 12:38:42 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:38:42.655375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e4a6f-b70e-4376-b9f1-101935823c56 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:42.690208 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90021b87-6e4d-4bf8-b693-2d8ecf5fe148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:42.690894 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90021b87-6e4d-4bf8-b693-2d8ecf5fe148 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:42.691167 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90021b87-6e4d-4bf8-b693-2d8ecf5fe148 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:42.691437 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90021b87-6e4d-4bf8-b693-2d8ecf5fe148 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:42.692191 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90021b87-6e4d-4bf8-b693-2d8ecf5fe148 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:42.692539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90021b87-6e4d-4bf8-b693-2d8ecf5fe148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:42.693950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90021b87-6e4d-4bf8-b693-2d8ecf5fe148 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:42.703206 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 160/326] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:42.710068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5fcbb-b219-483b-9874-3bcde7852ea6 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:42.814043 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5fcbb-b219-483b-9874-3bcde7852ea6 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:42.848344 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3bb89-1438-4032-9201-95c1c734895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:42.849658 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3bb89-1438-4032-9201-95c1c734895c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:42.849934 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3bb89-1438-4032-9201-95c1c734895c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:42.850202 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3bb89-1438-4032-9201-95c1c734895c None admin] PATH_INFO: `/v3/users/ba3ab35516ad451b88afeb28fa04ef04` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:42.851445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3bb89-1438-4032-9201-95c1c734895c None admin] RBAC: Authorizing `identity:get_user(user_id=ba3ab35516ad451b88afeb28fa04ef04)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:42.853054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3bb89-1438-4032-9201-95c1c734895c None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:42.854638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 167/327] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:42 2022] GET /identity/v3/users/ba3ab35516ad451b88afeb28fa04ef04 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:42.860818 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90021b87-6e4d-4bf8-b693-2d8ecf5fe148 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:42.868807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b31389-2593-43d9-b238-f389faa4290c None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:42.869373 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b31389-2593-43d9-b238-f389faa4290c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:42.869792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b31389-2593-43d9-b238-f389faa4290c None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:42.871871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 168/328] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:38:42.878897 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a34da-8b29-48a6-95a6-6099efa0bf0a None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:42.879185 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a34da-8b29-48a6-95a6-6099efa0bf0a None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:42.879467 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a34da-8b29-48a6-95a6-6099efa0bf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:42.896574 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-0b6a34da-8b29-48a6-95a6-6099efa0bf0a None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:42.897755 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0b6a34da-8b29-48a6-95a6-6099efa0bf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:42.970364 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 169/329] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:42.982542 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90021b87-6e4d-4bf8-b693-2d8ecf5fe148 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:42.993927 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a34da-8b29-48a6-95a6-6099efa0bf0a None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:43.020855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5fb82-a58b-49b2-b6db-7e51b5ed1902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:43.021789 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5fb82-a58b-49b2-b6db-7e51b5ed1902 None admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:43.022067 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5fb82-a58b-49b2-b6db-7e51b5ed1902 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:43.022390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5fb82-a58b-49b2-b6db-7e51b5ed1902 None admin] PATH_INFO: `/v3/system/users/ba3ab35516ad451b88afeb28fa04ef04/roles/0174fdbdbb3946bdb17aded65287dd75` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:43.024222 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5fb82-a58b-49b2-b6db-7e51b5ed1902 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ba3ab35516ad451b88afeb28fa04ef04, role_id=0174fdbdbb3946bdb17aded65287dd75)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:43.025620 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5fb82-a58b-49b2-b6db-7e51b5ed1902 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:43.037669 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 161/330] 10.222.0.90 () {58 vars in 1334 bytes} [Wed Nov 2 12:38:42 2022] PUT /identity/v3/system/users/ba3ab35516ad451b88afeb28fa04ef04/roles/0174fdbdbb3946bdb17aded65287dd75 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:43.100429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a34da-8b29-48a6-95a6-6099efa0bf0a None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:43.138703 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9ac64-18a0-4fca-b563-d6f6c0d9445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:43.139531 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9ac64-18a0-4fca-b563-d6f6c0d9445d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:43.139811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9ac64-18a0-4fca-b563-d6f6c0d9445d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:43.140083 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9ac64-18a0-4fca-b563-d6f6c0d9445d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:43.153971 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9ac64-18a0-4fca-b563-d6f6c0d9445d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:43.163072 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-0ca9ac64-18a0-4fca-b563-d6f6c0d9445d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:43.164726 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 170/331] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:38:43.170733 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5fb82-a58b-49b2-b6db-7e51b5ed1902 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:43.281331 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5fb82-a58b-49b2-b6db-7e51b5ed1902 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:43.316270 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b30002-cc18-436f-a6f4-b594f92b39f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:43.317275 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b30002-cc18-436f-a6f4-b594f92b39f8 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:43.317709 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b30002-cc18-436f-a6f4-b594f92b39f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:43.318138 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b30002-cc18-436f-a6f4-b594f92b39f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:43.319134 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b30002-cc18-436f-a6f4-b594f92b39f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:43.319595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b30002-cc18-436f-a6f4-b594f92b39f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:43.321227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b30002-cc18-436f-a6f4-b594f92b39f8 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:43.330092 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 162/332] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:43.336013 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9ac64-18a0-4fca-b563-d6f6c0d9445d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:43.446895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9ac64-18a0-4fca-b563-d6f6c0d9445d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:43.481511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb4642-1c6c-4849-aead-17efc017f765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:43.482400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4642-1c6c-4849-aead-17efc017f765 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:43.482681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4642-1c6c-4849-aead-17efc017f765 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:43.482956 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4642-1c6c-4849-aead-17efc017f765 None admin] PATH_INFO: `/v3/users/9f6626b4927c45ea88895b6b0b570215` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:43.484306 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb4642-1c6c-4849-aead-17efc017f765 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6626b4927c45ea88895b6b0b570215)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:43.485773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb4642-1c6c-4849-aead-17efc017f765 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:43.487629 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 171/333] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:43 2022] GET /identity/v3/users/9f6626b4927c45ea88895b6b0b570215 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:43.493228 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b30002-cc18-436f-a6f4-b594f92b39f8 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:43.716541 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b30002-cc18-436f-a6f4-b594f92b39f8 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:43.750483 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb078f2c-c08e-4172-ac25-60ca3a6ceabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:43.751238 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb078f2c-c08e-4172-ac25-60ca3a6ceabc None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:43.751522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb078f2c-c08e-4172-ac25-60ca3a6ceabc None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:43.751801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb078f2c-c08e-4172-ac25-60ca3a6ceabc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:43.752670 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb078f2c-c08e-4172-ac25-60ca3a6ceabc None admin] RBAC: Adding query filter params (role.id=ab7ac47ce77b490b8868c79a13a2a0aa, user.id=9f6626b4927c45ea88895b6b0b570215, scope.system=all) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:43.752987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb078f2c-c08e-4172-ac25-60ca3a6ceabc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:43.754449 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb078f2c-c08e-4172-ac25-60ca3a6ceabc None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:43.767291 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 163/334] 10.222.0.90 () {56 vars in 1308 bytes} [Wed Nov 2 12:38:43 2022] GET /identity/v3/role_assignments?user.id=9f6626b4927c45ea88895b6b0b570215&scope.system=all&role.id=ab7ac47ce77b490b8868c79a13a2a0aa => generated 510 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:45.646280 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4ac95-4418-4232-b615-23eacbf0bc4f None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:45.646280 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4ac95-4418-4232-b615-23eacbf0bc4f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:45.646280 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4ac95-4418-4232-b615-23eacbf0bc4f None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:45.647425 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 172/335] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:45.653268 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88541a65-a406-434c-8443-5ff7f3aec4d0 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:45.654539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88541a65-a406-434c-8443-5ff7f3aec4d0 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:45.655043 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88541a65-a406-434c-8443-5ff7f3aec4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:45.674476 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-88541a65-a406-434c-8443-5ff7f3aec4d0 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:45.676012 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-88541a65-a406-434c-8443-5ff7f3aec4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:45.756677 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 164/336] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:45.783058 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4ac95-4418-4232-b615-23eacbf0bc4f None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:45.892388 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c51a5b-9c49-44d7-a97d-37f8415b5114 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:45.893047 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c51a5b-9c49-44d7-a97d-37f8415b5114 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:45.893530 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c51a5b-9c49-44d7-a97d-37f8415b5114 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:45.895508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 165/337] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:38:45.901050 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8296735-1403-484c-a487-ce2f2e277a0b None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:45.901647 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8296735-1403-484c-a487-ce2f2e277a0b None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:45.902121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8296735-1403-484c-a487-ce2f2e277a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:45.926653 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e8296735-1403-484c-a487-ce2f2e277a0b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:45.929058 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e8296735-1403-484c-a487-ce2f2e277a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:45.937318 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4ac95-4418-4232-b615-23eacbf0bc4f None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.003840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e6638-44e0-4e6f-b52c-46ba55d2de83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.005095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e6638-44e0-4e6f-b52c-46ba55d2de83 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.005588 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e6638-44e0-4e6f-b52c-46ba55d2de83 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.006063 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e6638-44e0-4e6f-b52c-46ba55d2de83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.024131 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e6638-44e0-4e6f-b52c-46ba55d2de83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:46.033827 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-748e6638-44e0-4e6f-b52c-46ba55d2de83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:38:46.036585 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 166/338] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:46.038159 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad879a6-b6d8-40d3-9fca-4acb6d2bdc9e None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.038663 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad879a6-b6d8-40d3-9fca-4acb6d2bdc9e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.039123 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad879a6-b6d8-40d3-9fca-4acb6d2bdc9e None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.041003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 167/339] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:46.042744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 173/340] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:38:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:46.049276 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72a0f-4986-4f7b-afa4-06b1f5641476 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.049833 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72a0f-4986-4f7b-afa4-06b1f5641476 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.050311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72a0f-4986-4f7b-afa4-06b1f5641476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.052728 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e6638-44e0-4e6f-b52c-46ba55d2de83 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.085263 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-c2b72a0f-4986-4f7b-afa4-06b1f5641476 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:46.086444 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c2b72a0f-4986-4f7b-afa4-06b1f5641476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:46.179056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e6638-44e0-4e6f-b52c-46ba55d2de83 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.225184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dae86e-722c-499c-b069-4ee2b8f4555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.227242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dae86e-722c-499c-b069-4ee2b8f4555d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.228631 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dae86e-722c-499c-b069-4ee2b8f4555d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.229695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dae86e-722c-499c-b069-4ee2b8f4555d None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.230747 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dae86e-722c-499c-b069-4ee2b8f4555d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:46.232746 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dae86e-722c-499c-b069-4ee2b8f4555d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:46.234334 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dae86e-722c-499c-b069-4ee2b8f4555d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:46.238607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 168/341] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:46.239670 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b72a0f-4986-4f7b-afa4-06b1f5641476 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.256291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 174/342] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:38:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:46.262196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dae86e-722c-499c-b069-4ee2b8f4555d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.368930 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dae86e-722c-499c-b069-4ee2b8f4555d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.374925 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b72a0f-4986-4f7b-afa4-06b1f5641476 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.404684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2d099-2871-4ad9-a0bd-3a1f72fa1669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.405627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2d099-2871-4ad9-a0bd-3a1f72fa1669 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.406070 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2d099-2871-4ad9-a0bd-3a1f72fa1669 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.406483 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2d099-2871-4ad9-a0bd-3a1f72fa1669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.413017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ee734-e710-46af-9834-847f668ffe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.413847 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ee734-e710-46af-9834-847f668ffe50 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.414129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ee734-e710-46af-9834-847f668ffe50 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.414398 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ee734-e710-46af-9834-847f668ffe50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.426848 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ee734-e710-46af-9834-847f668ffe50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:46.434521 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c84ee734-e710-46af-9834-847f668ffe50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:46.438013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 169/343] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:46.439140 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ee734-e710-46af-9834-847f668ffe50 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.486345 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2d099-2871-4ad9-a0bd-3a1f72fa1669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:46.488439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2d099-2871-4ad9-a0bd-3a1f72fa1669 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:46.553249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ee734-e710-46af-9834-847f668ffe50 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.587752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e304ef-419a-4fe1-8f51-11777b5e8ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.588598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e304ef-419a-4fe1-8f51-11777b5e8ed7 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.588873 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e304ef-419a-4fe1-8f51-11777b5e8ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.589145 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e304ef-419a-4fe1-8f51-11777b5e8ed7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.592991 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 175/344] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:46.594027 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2d099-2871-4ad9-a0bd-3a1f72fa1669 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.604180 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e304ef-419a-4fe1-8f51-11777b5e8ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:46.612121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-84e304ef-419a-4fe1-8f51-11777b5e8ed7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:46.615028 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 170/345] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:46.615830 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e304ef-419a-4fe1-8f51-11777b5e8ed7 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.701152 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2d099-2871-4ad9-a0bd-3a1f72fa1669 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.722574 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e304ef-419a-4fe1-8f51-11777b5e8ed7 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.740398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baba9f-6059-43f3-b051-735dfcc1e8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.741377 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baba9f-6059-43f3-b051-735dfcc1e8e9 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.741859 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baba9f-6059-43f3-b051-735dfcc1e8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.742279 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baba9f-6059-43f3-b051-735dfcc1e8e9 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.743176 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baba9f-6059-43f3-b051-735dfcc1e8e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:46.743637 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baba9f-6059-43f3-b051-735dfcc1e8e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:46.745221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baba9f-6059-43f3-b051-735dfcc1e8e9 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:46.754235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 176/346] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:46.755455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baba9f-6059-43f3-b051-735dfcc1e8e9 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.756274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3ce74-559c-4163-ba31-5e19fcfcffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.757151 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3ce74-559c-4163-ba31-5e19fcfcffff None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.757425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3ce74-559c-4163-ba31-5e19fcfcffff None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.757694 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3ce74-559c-4163-ba31-5e19fcfcffff None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.758882 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3ce74-559c-4163-ba31-5e19fcfcffff None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:46.760468 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3ce74-559c-4163-ba31-5e19fcfcffff None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:46.762120 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 171/347] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:46 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:46.762895 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3ce74-559c-4163-ba31-5e19fcfcffff None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.861075 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baba9f-6059-43f3-b051-735dfcc1e8e9 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.867506 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3ce74-559c-4163-ba31-5e19fcfcffff None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.896554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecb7a7-6603-4f94-86b1-d77caea41a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.897529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecb7a7-6603-4f94-86b1-d77caea41a6c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.897965 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecb7a7-6603-4f94-86b1-d77caea41a6c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.898468 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecb7a7-6603-4f94-86b1-d77caea41a6c None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.899361 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecb7a7-6603-4f94-86b1-d77caea41a6c None admin] RBAC: Adding query filter params (name=member) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:46.899894 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecb7a7-6603-4f94-86b1-d77caea41a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:46.901305 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103a68a-33db-4db7-a26b-b249313f91b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.901775 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecb7a7-6603-4f94-86b1-d77caea41a6c None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:46.901975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103a68a-33db-4db7-a26b-b249313f91b8 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.902251 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103a68a-33db-4db7-a26b-b249313f91b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.902647 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103a68a-33db-4db7-a26b-b249313f91b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.913036 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 177/348] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:46.914181 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecb7a7-6603-4f94-86b1-d77caea41a6c None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.971167 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103a68a-33db-4db7-a26b-b249313f91b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:46.972584 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103a68a-33db-4db7-a26b-b249313f91b8 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:47.020756 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecb7a7-6603-4f94-86b1-d77caea41a6c None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:47.055647 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbb2ed-c676-4aca-b85f-f7d63087f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:47.057007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbb2ed-c676-4aca-b85f-f7d63087f441 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.057486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbb2ed-c676-4aca-b85f-f7d63087f441 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.057953 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbb2ed-c676-4aca-b85f-f7d63087f441 None admin] PATH_INFO: `/v3/groups/0b13c92dc684456fbcf49617d04ab31b` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.064527 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbb2ed-c676-4aca-b85f-f7d63087f441 None admin] RBAC: Authorizing `identity:get_group(group_id=0b13c92dc684456fbcf49617d04ab31b)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:47.066369 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbb2ed-c676-4aca-b85f-f7d63087f441 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:47.068431 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 178/349] 10.222.0.90 () {56 vars in 1180 bytes} [Wed Nov 2 12:38:46 2022] GET /identity/v3/groups/0b13c92dc684456fbcf49617d04ab31b => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:47.069433 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbb2ed-c676-4aca-b85f-f7d63087f441 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:47.074176 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 172/350] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:47.075236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103a68a-33db-4db7-a26b-b249313f91b8 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:47.171970 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103a68a-33db-4db7-a26b-b249313f91b8 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:47.173243 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbb2ed-c676-4aca-b85f-f7d63087f441 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:47.208669 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bf236-2827-4957-81a1-cd4ea9898fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:47.209359 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bf236-2827-4957-81a1-cd4ea9898fe1 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.209605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bf236-2827-4957-81a1-cd4ea9898fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.209882 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bf236-2827-4957-81a1-cd4ea9898fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.210724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bf236-2827-4957-81a1-cd4ea9898fe1 None admin] RBAC: Adding query filter params (group.id=0b13c92dc684456fbcf49617d04ab31b, role.id=7b4e238c731941f18493cd62e30b1e4f, scope.project.id=5ec8dbf812ab46129e7de7e927d484f0) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:47.211036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bf236-2827-4957-81a1-cd4ea9898fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:47.211556 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95091bb-5b10-4625-b30c-53c395136fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:47.212476 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95091bb-5b10-4625-b30c-53c395136fbc None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.212594 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bf236-2827-4957-81a1-cd4ea9898fe1 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:47.213066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95091bb-5b10-4625-b30c-53c395136fbc None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.213532 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95091bb-5b10-4625-b30c-53c395136fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.218641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 173/351] 10.222.0.90 () {56 vars in 1376 bytes} [Wed Nov 2 12:38:47 2022] GET /identity/v3/role_assignments?group.id=0b13c92dc684456fbcf49617d04ab31b&scope.project.id=5ec8dbf812ab46129e7de7e927d484f0&role.id=7b4e238c731941f18493cd62e30b1e4f => generated 260 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:47.219570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bf236-2827-4957-81a1-cd4ea9898fe1 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:47.289073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95091bb-5b10-4625-b30c-53c395136fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:47.290986 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95091bb-5b10-4625-b30c-53c395136fbc None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:47.324998 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bf236-2827-4957-81a1-cd4ea9898fe1 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:47.361460 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e5d60-c1e2-41fe-8429-c8665738cc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:47.362367 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e5d60-c1e2-41fe-8429-c8665738cc41 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.362640 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e5d60-c1e2-41fe-8429-c8665738cc41 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.362984 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e5d60-c1e2-41fe-8429-c8665738cc41 None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.364173 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e5d60-c1e2-41fe-8429-c8665738cc41 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:47.366442 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e5d60-c1e2-41fe-8429-c8665738cc41 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:47.367432 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 174/352] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:47 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:47.373149 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e5d60-c1e2-41fe-8429-c8665738cc41 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:47.399232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 179/353] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:47.405710 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95091bb-5b10-4625-b30c-53c395136fbc None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:47.521988 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95091bb-5b10-4625-b30c-53c395136fbc None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:47.549899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e5d60-c1e2-41fe-8429-c8665738cc41 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:47.568122 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5db03-c72a-480a-904e-8a949784e16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:47.569220 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5db03-c72a-480a-904e-8a949784e16f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.569811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5db03-c72a-480a-904e-8a949784e16f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.570092 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5db03-c72a-480a-904e-8a949784e16f None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.571351 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5db03-c72a-480a-904e-8a949784e16f None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:47.573370 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5db03-c72a-480a-904e-8a949784e16f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:47.575683 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 180/354] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:47 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:47.576928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f27182-6610-468e-9d0b-6b4f6015515d None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.577211 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f27182-6610-468e-9d0b-6b4f6015515d None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.577487 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f27182-6610-468e-9d0b-6b4f6015515d None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.579267 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 181/355] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:47.590349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b4cdd-1be8-4fc6-8b05-df17efa9b457 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.590861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b4cdd-1be8-4fc6-8b05-df17efa9b457 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.591154 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b4cdd-1be8-4fc6-8b05-df17efa9b457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.596512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b3ed3-c87c-4249-9a2d-8b7ba35a3524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:47.597627 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b3ed3-c87c-4249-9a2d-8b7ba35a3524 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.597870 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b3ed3-c87c-4249-9a2d-8b7ba35a3524 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.598144 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b3ed3-c87c-4249-9a2d-8b7ba35a3524 None admin] PATH_INFO: `/v3/groups/0b13c92dc684456fbcf49617d04ab31b` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.605375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b3ed3-c87c-4249-9a2d-8b7ba35a3524 None admin] RBAC: Authorizing `identity:get_group(group_id=0b13c92dc684456fbcf49617d04ab31b)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:47.607283 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b3ed3-c87c-4249-9a2d-8b7ba35a3524 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:47.609667 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 175/356] 10.222.0.90 () {56 vars in 1180 bytes} [Wed Nov 2 12:38:47 2022] GET /identity/v3/groups/0b13c92dc684456fbcf49617d04ab31b => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:47.610954 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b3ed3-c87c-4249-9a2d-8b7ba35a3524 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:47.619153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-cd3b4cdd-1be8-4fc6-8b05-df17efa9b457 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:47.620485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-cd3b4cdd-1be8-4fc6-8b05-df17efa9b457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:47.693107 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 182/357] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:47.698011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76796f6-c4be-4e7b-8133-43c9a5f119d1 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.698304 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76796f6-c4be-4e7b-8133-43c9a5f119d1 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.698582 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76796f6-c4be-4e7b-8133-43c9a5f119d1 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.700734 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 183/358] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:47.705279 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76796f6-c4be-4e7b-8133-43c9a5f119d1 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:47.741635 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b3ed3-c87c-4249-9a2d-8b7ba35a3524 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:47.783890 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b853427-7586-46ea-b6a4-da77b92d003e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:47.785332 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b853427-7586-46ea-b6a4-da77b92d003e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.785717 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b853427-7586-46ea-b6a4-da77b92d003e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.786086 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b853427-7586-46ea-b6a4-da77b92d003e None admin] PATH_INFO: `/v3/groups/0b13c92dc684456fbcf49617d04ab31b` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.787707 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b853427-7586-46ea-b6a4-da77b92d003e None admin] RBAC: Authorizing `identity:get_group(group_id=0b13c92dc684456fbcf49617d04ab31b)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:47.789676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b853427-7586-46ea-b6a4-da77b92d003e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:47.791888 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 176/359] 10.222.0.90 () {56 vars in 1180 bytes} [Wed Nov 2 12:38:47 2022] GET /identity/v3/groups/0b13c92dc684456fbcf49617d04ab31b => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:47.794215 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8d3c0-3a21-4127-942c-b08a1642f076 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.794499 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8d3c0-3a21-4127-942c-b08a1642f076 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.794923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8d3c0-3a21-4127-942c-b08a1642f076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.816380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-49b8d3c0-3a21-4127-942c-b08a1642f076 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:47.817915 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-49b8d3c0-3a21-4127-942c-b08a1642f076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:47.845935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76796f6-c4be-4e7b-8133-43c9a5f119d1 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:47.889968 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425cf8a-b983-4130-9abd-1040564d2dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:47.891062 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425cf8a-b983-4130-9abd-1040564d2dbb None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.891554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425cf8a-b983-4130-9abd-1040564d2dbb None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.892027 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425cf8a-b983-4130-9abd-1040564d2dbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.893103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425cf8a-b983-4130-9abd-1040564d2dbb None admin] RBAC: Adding query filter params (group.id=0b13c92dc684456fbcf49617d04ab31b, role.id=ab7ac47ce77b490b8868c79a13a2a0aa, scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:47.893660 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425cf8a-b983-4130-9abd-1040564d2dbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:47.895433 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425cf8a-b983-4130-9abd-1040564d2dbb None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:47.904551 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 184/360] 10.222.0.90 () {56 vars in 1376 bytes} [Wed Nov 2 12:38:47 2022] GET /identity/v3/role_assignments?group.id=0b13c92dc684456fbcf49617d04ab31b&scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8&role.id=ab7ac47ce77b490b8868c79a13a2a0aa => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:47.905861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425cf8a-b983-4130-9abd-1040564d2dbb None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:47.908040 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 177/361] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:47.909047 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8d3c0-3a21-4127-942c-b08a1642f076 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.045938 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8d3c0-3a21-4127-942c-b08a1642f076 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.053057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425cf8a-b983-4130-9abd-1040564d2dbb None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.094701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff6acb-4fbf-4bc4-b4bb-df0455bb597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.095784 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff6acb-4fbf-4bc4-b4bb-df0455bb597e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.097596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff6acb-4fbf-4bc4-b4bb-df0455bb597e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.098094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff6acb-4fbf-4bc4-b4bb-df0455bb597e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.100035 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff6acb-4fbf-4bc4-b4bb-df0455bb597e None admin] RBAC: Adding query filter params (group.id=0b13c92dc684456fbcf49617d04ab31b, role.id=ab7ac47ce77b490b8868c79a13a2a0aa, scope.project.id=5ec8dbf812ab46129e7de7e927d484f0) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:48.101415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff6acb-4fbf-4bc4-b4bb-df0455bb597e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:48.103360 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff6acb-4fbf-4bc4-b4bb-df0455bb597e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:48.111183 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7e61d-516e-4086-8f32-51694187090b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.112532 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7e61d-516e-4086-8f32-51694187090b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.113028 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7e61d-516e-4086-8f32-51694187090b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.113482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7e61d-516e-4086-8f32-51694187090b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.121308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 178/362] 10.222.0.90 () {56 vars in 1376 bytes} [Wed Nov 2 12:38:47 2022] GET /identity/v3/role_assignments?group.id=0b13c92dc684456fbcf49617d04ab31b&scope.project.id=5ec8dbf812ab46129e7de7e927d484f0&role.id=ab7ac47ce77b490b8868c79a13a2a0aa => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:48.121891 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff6acb-4fbf-4bc4-b4bb-df0455bb597e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.128148 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7e61d-516e-4086-8f32-51694187090b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:48.135670 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-2fd7e61d-516e-4086-8f32-51694187090b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:38:48.137423 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 185/363] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:48.143935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7e61d-516e-4086-8f32-51694187090b None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.305350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7e61d-516e-4086-8f32-51694187090b None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.353470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a176537-5ae6-4281-9bca-8303196b8c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.354503 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a176537-5ae6-4281-9bca-8303196b8c78 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.354968 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a176537-5ae6-4281-9bca-8303196b8c78 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.355451 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a176537-5ae6-4281-9bca-8303196b8c78 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.356488 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a176537-5ae6-4281-9bca-8303196b8c78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:48.357017 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a176537-5ae6-4281-9bca-8303196b8c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:48.358615 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a176537-5ae6-4281-9bca-8303196b8c78 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:48.371659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 186/364] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:48.374607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a176537-5ae6-4281-9bca-8303196b8c78 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.414784 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff6acb-4fbf-4bc4-b4bb-df0455bb597e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.472655 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea748fe0-8eca-424b-9389-8b049eff3c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.474372 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea748fe0-8eca-424b-9389-8b049eff3c18 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.474900 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea748fe0-8eca-424b-9389-8b049eff3c18 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.475411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea748fe0-8eca-424b-9389-8b049eff3c18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.491217 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea748fe0-8eca-424b-9389-8b049eff3c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:48.500106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a176537-5ae6-4281-9bca-8303196b8c78 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.501683 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-ea748fe0-8eca-424b-9389-8b049eff3c18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:38:48.503203 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 179/365] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:38:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:48.505460 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95b779-4a57-4652-bc4e-a523ad850b50 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.505914 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95b779-4a57-4652-bc4e-a523ad850b50 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.506331 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95b779-4a57-4652-bc4e-a523ad850b50 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.509694 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 180/366] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:48.510607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95b779-4a57-4652-bc4e-a523ad850b50 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.558373 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f4e1d-f4f7-4f55-ae42-b6deb67ba778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.559746 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f4e1d-f4f7-4f55-ae42-b6deb67ba778 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.560173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f4e1d-f4f7-4f55-ae42-b6deb67ba778 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.560665 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f4e1d-f4f7-4f55-ae42-b6deb67ba778 None admin] PATH_INFO: `/v3/users/ba3ab35516ad451b88afeb28fa04ef04` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.562125 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f4e1d-f4f7-4f55-ae42-b6deb67ba778 None admin] RBAC: Authorizing `identity:get_user(user_id=ba3ab35516ad451b88afeb28fa04ef04)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:48.563957 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f4e1d-f4f7-4f55-ae42-b6deb67ba778 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:48.567893 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 187/367] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:38:48 2022] GET /identity/v3/users/ba3ab35516ad451b88afeb28fa04ef04 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:48.569668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043ec73-5326-4a38-adef-74348d0e95dc None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.570233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043ec73-5326-4a38-adef-74348d0e95dc None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.570727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043ec73-5326-4a38-adef-74348d0e95dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.595143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-d043ec73-5326-4a38-adef-74348d0e95dc None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:48.596593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-d043ec73-5326-4a38-adef-74348d0e95dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:48.652668 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95b779-4a57-4652-bc4e-a523ad850b50 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.672160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 188/368] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:48.677294 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043ec73-5326-4a38-adef-74348d0e95dc None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.697797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8abb1d-d712-4ba0-9b83-19e0cb5f1a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.698492 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8abb1d-d712-4ba0-9b83-19e0cb5f1a68 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.698929 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8abb1d-d712-4ba0-9b83-19e0cb5f1a68 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.699201 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8abb1d-d712-4ba0-9b83-19e0cb5f1a68 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.704249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8abb1d-d712-4ba0-9b83-19e0cb5f1a68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:48.704249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8abb1d-d712-4ba0-9b83-19e0cb5f1a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:48.704249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8abb1d-d712-4ba0-9b83-19e0cb5f1a68 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:48.712351 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 181/369] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:38:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:48.718033 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8abb1d-d712-4ba0-9b83-19e0cb5f1a68 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.817272 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043ec73-5326-4a38-adef-74348d0e95dc None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.841151 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8abb1d-d712-4ba0-9b83-19e0cb5f1a68 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.861989 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944fc9d-866b-4f2c-a150-acac10d72d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.862837 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944fc9d-866b-4f2c-a150-acac10d72d2a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.863125 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944fc9d-866b-4f2c-a150-acac10d72d2a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.863402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944fc9d-866b-4f2c-a150-acac10d72d2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.864610 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944fc9d-866b-4f2c-a150-acac10d72d2a None admin] RBAC: Adding query filter params (role.id=0174fdbdbb3946bdb17aded65287dd75, user.id=ba3ab35516ad451b88afeb28fa04ef04, scope.system=all) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:48.867767 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944fc9d-866b-4f2c-a150-acac10d72d2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:48.869626 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944fc9d-866b-4f2c-a150-acac10d72d2a None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:48.892148 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab7f0a-fa0e-48c7-9089-ddb91b33784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.893994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 189/370] 10.222.0.90 () {56 vars in 1308 bytes} [Wed Nov 2 12:38:48 2022] GET /identity/v3/role_assignments?user.id=ba3ab35516ad451b88afeb28fa04ef04&scope.system=all&role.id=0174fdbdbb3946bdb17aded65287dd75 => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:48.895051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944fc9d-866b-4f2c-a150-acac10d72d2a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.895749 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab7f0a-fa0e-48c7-9089-ddb91b33784f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.896362 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab7f0a-fa0e-48c7-9089-ddb91b33784f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.897335 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab7f0a-fa0e-48c7-9089-ddb91b33784f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:49.037570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab7f0a-fa0e-48c7-9089-ddb91b33784f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:49.041058 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab7f0a-fa0e-48c7-9089-ddb91b33784f None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:49.096587 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944fc9d-866b-4f2c-a150-acac10d72d2a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:49.162146 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04d8e7-f801-4ecd-aa2a-b69551b4ee4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:49.164090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04d8e7-f801-4ecd-aa2a-b69551b4ee4d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:49.166944 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04d8e7-f801-4ecd-aa2a-b69551b4ee4d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:49.167463 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04d8e7-f801-4ecd-aa2a-b69551b4ee4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:49.193653 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04d8e7-f801-4ecd-aa2a-b69551b4ee4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:49.203967 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-7a04d8e7-f801-4ecd-aa2a-b69551b4ee4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:38:49.206584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 190/371] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:38:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:49.214605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04d8e7-f801-4ecd-aa2a-b69551b4ee4d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:49.254450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 182/372] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:49.261907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab7f0a-fa0e-48c7-9089-ddb91b33784f None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:49.396643 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04d8e7-f801-4ecd-aa2a-b69551b4ee4d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:49.436258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8034f61-fa62-43ed-8d2d-9eff9b9ea767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:49.437414 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8034f61-fa62-43ed-8d2d-9eff9b9ea767 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:49.437940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8034f61-fa62-43ed-8d2d-9eff9b9ea767 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:49.438410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8034f61-fa62-43ed-8d2d-9eff9b9ea767 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:49.439370 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8034f61-fa62-43ed-8d2d-9eff9b9ea767 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:49.439897 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8034f61-fa62-43ed-8d2d-9eff9b9ea767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:49.441561 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8034f61-fa62-43ed-8d2d-9eff9b9ea767 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:49.451172 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 191/373] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:49.457119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8034f61-fa62-43ed-8d2d-9eff9b9ea767 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:49.457717 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab7f0a-fa0e-48c7-9089-ddb91b33784f None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:49.557503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00d80c-51d9-4d77-a2d0-a58aaa255061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:49.558417 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00d80c-51d9-4d77-a2d0-a58aaa255061 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:49.558828 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00d80c-51d9-4d77-a2d0-a58aaa255061 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:49.559106 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00d80c-51d9-4d77-a2d0-a58aaa255061 None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:49.564975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00d80c-51d9-4d77-a2d0-a58aaa255061 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:49.566483 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00d80c-51d9-4d77-a2d0-a58aaa255061 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:49.568608 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 183/374] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:49 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:49.571978 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8034f61-fa62-43ed-8d2d-9eff9b9ea767 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:49.573888 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00d80c-51d9-4d77-a2d0-a58aaa255061 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:49.610291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245443d8-6746-4838-8667-a4f18b518eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:49.611123 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245443d8-6746-4838-8667-a4f18b518eb3 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:49.611410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245443d8-6746-4838-8667-a4f18b518eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:49.611695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245443d8-6746-4838-8667-a4f18b518eb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:49.689927 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245443d8-6746-4838-8667-a4f18b518eb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:49.691595 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245443d8-6746-4838-8667-a4f18b518eb3 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:49.807944 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 192/375] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:49.817362 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245443d8-6746-4838-8667-a4f18b518eb3 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:49.827950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00d80c-51d9-4d77-a2d0-a58aaa255061 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:49.916941 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d33276-1943-4cc6-aea3-812029b6ee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:49.917881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d33276-1943-4cc6-aea3-812029b6ee23 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:49.918226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d33276-1943-4cc6-aea3-812029b6ee23 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:49.918499 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d33276-1943-4cc6-aea3-812029b6ee23 None admin] PATH_INFO: `/v3/groups/0b13c92dc684456fbcf49617d04ab31b` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:49.919727 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d33276-1943-4cc6-aea3-812029b6ee23 None admin] RBAC: Authorizing `identity:get_group(group_id=0b13c92dc684456fbcf49617d04ab31b)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:49.921231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d33276-1943-4cc6-aea3-812029b6ee23 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:49.924037 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 184/376] 10.222.0.90 () {56 vars in 1180 bytes} [Wed Nov 2 12:38:49 2022] GET /identity/v3/groups/0b13c92dc684456fbcf49617d04ab31b => generated 226 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:49.928501 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245443d8-6746-4838-8667-a4f18b518eb3 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:49.928797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d33276-1943-4cc6-aea3-812029b6ee23 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:49.966006 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105af653-385e-439e-925b-090f3ba9ceed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:49.967112 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105af653-385e-439e-925b-090f3ba9ceed None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:49.967396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105af653-385e-439e-925b-090f3ba9ceed None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:49.967718 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105af653-385e-439e-925b-090f3ba9ceed None admin] PATH_INFO: `/v3/projects/b31a529f322f43dfa78c0719df9a66db` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:49.969099 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105af653-385e-439e-925b-090f3ba9ceed None admin] RBAC: Authorizing `identity:get_project(project_id=b31a529f322f43dfa78c0719df9a66db)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:49.970602 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105af653-385e-439e-925b-090f3ba9ceed None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:49.972738 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 193/377] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:49 2022] GET /identity/v3/projects/b31a529f322f43dfa78c0719df9a66db => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:49.978867 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105af653-385e-439e-925b-090f3ba9ceed None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:50.114283 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105af653-385e-439e-925b-090f3ba9ceed None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:50.152085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c10157-cac3-4afb-8c31-b125a8446839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:50.153189 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c10157-cac3-4afb-8c31-b125a8446839 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:50.153482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c10157-cac3-4afb-8c31-b125a8446839 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:50.153815 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c10157-cac3-4afb-8c31-b125a8446839 None admin] PATH_INFO: `/v3/groups/f0d24683ecea4d168004f111c36b82ab` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:50.159575 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c10157-cac3-4afb-8c31-b125a8446839 None admin] RBAC: Authorizing `identity:get_group(group_id=f0d24683ecea4d168004f111c36b82ab)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:50.161606 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c10157-cac3-4afb-8c31-b125a8446839 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:50.163616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 194/378] 10.222.0.90 () {56 vars in 1180 bytes} [Wed Nov 2 12:38:49 2022] GET /identity/v3/groups/f0d24683ecea4d168004f111c36b82ab => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:50.169511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c10157-cac3-4afb-8c31-b125a8446839 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:50.175644 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d33276-1943-4cc6-aea3-812029b6ee23 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:50.225985 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7ae27-4cb7-4dd6-bf4c-8442aac2bbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:50.226599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7ae27-4cb7-4dd6-bf4c-8442aac2bbdb None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:50.226880 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7ae27-4cb7-4dd6-bf4c-8442aac2bbdb None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:50.227153 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7ae27-4cb7-4dd6-bf4c-8442aac2bbdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:50.228009 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7ae27-4cb7-4dd6-bf4c-8442aac2bbdb None admin] RBAC: Adding query filter params (group.id=0b13c92dc684456fbcf49617d04ab31b, role.id=7b4e238c731941f18493cd62e30b1e4f, scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:50.228384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7ae27-4cb7-4dd6-bf4c-8442aac2bbdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:50.229856 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7ae27-4cb7-4dd6-bf4c-8442aac2bbdb None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:50.240717 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 185/379] 10.222.0.90 () {56 vars in 1376 bytes} [Wed Nov 2 12:38:49 2022] GET /identity/v3/role_assignments?group.id=0b13c92dc684456fbcf49617d04ab31b&scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8&role.id=7b4e238c731941f18493cd62e30b1e4f => generated 260 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:50.292301 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c10157-cac3-4afb-8c31-b125a8446839 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:50.331797 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abba9fa-9bbe-4693-9bfc-23bfff072795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:50.332528 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abba9fa-9bbe-4693-9bfc-23bfff072795 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:50.332883 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abba9fa-9bbe-4693-9bfc-23bfff072795 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:50.333164 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abba9fa-9bbe-4693-9bfc-23bfff072795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:50.334032 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abba9fa-9bbe-4693-9bfc-23bfff072795 None admin] RBAC: Adding query filter params (group.id=f0d24683ecea4d168004f111c36b82ab, role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=b31a529f322f43dfa78c0719df9a66db) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:50.334352 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abba9fa-9bbe-4693-9bfc-23bfff072795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:50.335835 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abba9fa-9bbe-4693-9bfc-23bfff072795 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:50.342733 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 195/380] 10.222.0.90 () {56 vars in 1376 bytes} [Wed Nov 2 12:38:50 2022] GET /identity/v3/role_assignments?group.id=f0d24683ecea4d168004f111c36b82ab&scope.project.id=b31a529f322f43dfa78c0719df9a66db&role.id=85136c55809b4d9db97c263a72392ad1 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:50.692074 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a6d47-f672-4494-a8ed-74e1d61df806 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:50.692427 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a6d47-f672-4494-a8ed-74e1d61df806 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:50.692702 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a6d47-f672-4494-a8ed-74e1d61df806 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:50.694893 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 186/381] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:50.701406 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ef732-4e97-48a6-9d93-ce17c62e6a96 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:50.701707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ef732-4e97-48a6-9d93-ce17c62e6a96 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:50.701965 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ef732-4e97-48a6-9d93-ce17c62e6a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:50.721872 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-0e0ef732-4e97-48a6-9d93-ce17c62e6a96 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:50.723428 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0e0ef732-4e97-48a6-9d93-ce17c62e6a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:50.801809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 196/382] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:50.837761 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a6d47-f672-4494-a8ed-74e1d61df806 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:50.964148 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a6d47-f672-4494-a8ed-74e1d61df806 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:50.999874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693f089-138a-4c24-bb3a-1d376f372ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:51.000868 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693f089-138a-4c24-bb3a-1d376f372ed7 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.001200 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693f089-138a-4c24-bb3a-1d376f372ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.001480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693f089-138a-4c24-bb3a-1d376f372ed7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.014434 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693f089-138a-4c24-bb3a-1d376f372ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:51.022305 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-5693f089-138a-4c24-bb3a-1d376f372ed7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:38:51.023741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 187/383] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:38:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:51.030163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ef732-4e97-48a6-9d93-ce17c62e6a96 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:51.084232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb78319-d060-4736-9f27-db63936835b1 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.084573 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb78319-d060-4736-9f27-db63936835b1 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.084796 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb78319-d060-4736-9f27-db63936835b1 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.086893 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 188/384] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:51.092016 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57f88b-a723-42d0-bfb3-f4a7ad5beb4f None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.092332 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57f88b-a723-42d0-bfb3-f4a7ad5beb4f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.092605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57f88b-a723-42d0-bfb3-f4a7ad5beb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.113646 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-fc57f88b-a723-42d0-bfb3-f4a7ad5beb4f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:51.115226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-fc57f88b-a723-42d0-bfb3-f4a7ad5beb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:51.161358 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ef732-4e97-48a6-9d93-ce17c62e6a96 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:51.200652 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770760a-e803-4b85-a097-7baba099a7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:51.201758 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770760a-e803-4b85-a097-7baba099a7f3 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.202579 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770760a-e803-4b85-a097-7baba099a7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.204000 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770760a-e803-4b85-a097-7baba099a7f3 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.205189 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770760a-e803-4b85-a097-7baba099a7f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:51.206901 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770760a-e803-4b85-a097-7baba099a7f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:51.208568 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770760a-e803-4b85-a097-7baba099a7f3 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:51.226945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 197/385] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:38:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:51.233861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770760a-e803-4b85-a097-7baba099a7f3 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:51.235822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 189/386] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:51.268094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57f88b-a723-42d0-bfb3-f4a7ad5beb4f None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:51.358681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770760a-e803-4b85-a097-7baba099a7f3 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:51.404608 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02333c-b635-47ec-bbc5-fc7be8ae22f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:51.405633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02333c-b635-47ec-bbc5-fc7be8ae22f8 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.405740 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02333c-b635-47ec-bbc5-fc7be8ae22f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.406017 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02333c-b635-47ec-bbc5-fc7be8ae22f8 None admin] PATH_INFO: `/v3/groups/0b13c92dc684456fbcf49617d04ab31b` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.410136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02333c-b635-47ec-bbc5-fc7be8ae22f8 None admin] RBAC: Authorizing `identity:get_group(group_id=0b13c92dc684456fbcf49617d04ab31b)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:51.411662 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02333c-b635-47ec-bbc5-fc7be8ae22f8 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:51.413815 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 198/387] 10.222.0.90 () {56 vars in 1180 bytes} [Wed Nov 2 12:38:51 2022] GET /identity/v3/groups/0b13c92dc684456fbcf49617d04ab31b => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:51.415278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57f88b-a723-42d0-bfb3-f4a7ad5beb4f None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:51.419110 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02333c-b635-47ec-bbc5-fc7be8ae22f8 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:51.454694 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b0c20-716e-4ba0-b140-383e290a1a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:51.455894 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b0c20-716e-4ba0-b140-383e290a1a22 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.457895 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b0c20-716e-4ba0-b140-383e290a1a22 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.459063 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b0c20-716e-4ba0-b140-383e290a1a22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.483310 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b0c20-716e-4ba0-b140-383e290a1a22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:51.496979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-b25b0c20-716e-4ba0-b140-383e290a1a22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:51.498361 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 190/388] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:38:51.509548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b0c20-716e-4ba0-b140-383e290a1a22 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:51.597349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02333c-b635-47ec-bbc5-fc7be8ae22f8 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:51.665156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0feb6-9fb6-4d47-b225-8be70007368d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:51.666070 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0feb6-9fb6-4d47-b225-8be70007368d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.666354 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0feb6-9fb6-4d47-b225-8be70007368d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.666634 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0feb6-9fb6-4d47-b225-8be70007368d None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.669148 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0feb6-9fb6-4d47-b225-8be70007368d None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:51.670627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0feb6-9fb6-4d47-b225-8be70007368d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:51.681071 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 199/389] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:51 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:51.682542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0feb6-9fb6-4d47-b225-8be70007368d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:51.701892 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b0c20-716e-4ba0-b140-383e290a1a22 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:51.753027 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8168e9-38fd-4f7e-9a85-4e87364a620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:51.753677 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8168e9-38fd-4f7e-9a85-4e87364a620f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.753955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8168e9-38fd-4f7e-9a85-4e87364a620f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.754227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8168e9-38fd-4f7e-9a85-4e87364a620f None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.755002 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8168e9-38fd-4f7e-9a85-4e87364a620f None admin] RBAC: Adding query filter params (name=member) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:51.755308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8168e9-38fd-4f7e-9a85-4e87364a620f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:51.758195 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8168e9-38fd-4f7e-9a85-4e87364a620f None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:51.770133 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 191/390] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:51.771490 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06138136-1f58-41a3-a672-c343ba3c3dcd None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.771773 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06138136-1f58-41a3-a672-c343ba3c3dcd None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.772049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06138136-1f58-41a3-a672-c343ba3c3dcd None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.773800 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 192/391] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:51.776565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06138136-1f58-41a3-a672-c343ba3c3dcd None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:51.831134 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0feb6-9fb6-4d47-b225-8be70007368d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:51.866579 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc842986-7ad0-4241-9e1d-e8da3d1caa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:51.867475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842986-7ad0-4241-9e1d-e8da3d1caa78 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.867979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842986-7ad0-4241-9e1d-e8da3d1caa78 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.868432 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc842986-7ad0-4241-9e1d-e8da3d1caa78 None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0/groups/0b13c92dc684456fbcf49617d04ab31b/roles/7b4e238c731941f18493cd62e30b1e4f` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.870887 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc842986-7ad0-4241-9e1d-e8da3d1caa78 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ec8dbf812ab46129e7de7e927d484f0, group_id=0b13c92dc684456fbcf49617d04ab31b, role_id=7b4e238c731941f18493cd62e30b1e4f)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:51.872740 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc842986-7ad0-4241-9e1d-e8da3d1caa78 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:51.896350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 200/392] 10.222.0.90 () {58 vars in 1442 bytes} [Wed Nov 2 12:38:51 2022] PUT /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0/groups/0b13c92dc684456fbcf49617d04ab31b/roles/7b4e238c731941f18493cd62e30b1e4f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:51.898148 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4693077-9a3c-4e71-8fea-c5acdb70b798 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.898611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4693077-9a3c-4e71-8fea-c5acdb70b798 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.899043 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4693077-9a3c-4e71-8fea-c5acdb70b798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.900434 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06138136-1f58-41a3-a672-c343ba3c3dcd None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:51.929502 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-c4693077-9a3c-4e71-8fea-c5acdb70b798 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:51.931024 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-c4693077-9a3c-4e71-8fea-c5acdb70b798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:51.944268 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102decdf-c62d-439a-a742-500da3da4962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:51.944268 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102decdf-c62d-439a-a742-500da3da4962 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.944268 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102decdf-c62d-439a-a742-500da3da4962 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.944268 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102decdf-c62d-439a-a742-500da3da4962 None admin] PATH_INFO: `/v3/groups/0b13c92dc684456fbcf49617d04ab31b` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.944748 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102decdf-c62d-439a-a742-500da3da4962 None admin] RBAC: Authorizing `identity:get_group(group_id=0b13c92dc684456fbcf49617d04ab31b)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:51.944748 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102decdf-c62d-439a-a742-500da3da4962 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:51.946356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 193/393] 10.222.0.90 () {56 vars in 1180 bytes} [Wed Nov 2 12:38:51 2022] GET /identity/v3/groups/0b13c92dc684456fbcf49617d04ab31b => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:51.958144 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102decdf-c62d-439a-a742-500da3da4962 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:52.084030 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102decdf-c62d-439a-a742-500da3da4962 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:52.100819 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 201/394] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:52.121549 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed495-706f-470e-8c59-25acb8aa1c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:52.122619 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed495-706f-470e-8c59-25acb8aa1c8a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:52.122991 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed495-706f-470e-8c59-25acb8aa1c8a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:52.123416 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed495-706f-470e-8c59-25acb8aa1c8a None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:52.124822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eed495-706f-470e-8c59-25acb8aa1c8a None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:52.126827 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eed495-706f-470e-8c59-25acb8aa1c8a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:52.129107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 194/395] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:51 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:52.135074 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4693077-9a3c-4e71-8fea-c5acdb70b798 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:52.138893 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed495-706f-470e-8c59-25acb8aa1c8a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:52.293292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed495-706f-470e-8c59-25acb8aa1c8a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:52.299508 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4693077-9a3c-4e71-8fea-c5acdb70b798 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:52.343227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c06fef-af46-4a8a-a57d-1ec02f9dc598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:52.344259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c06fef-af46-4a8a-a57d-1ec02f9dc598 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:52.344536 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c06fef-af46-4a8a-a57d-1ec02f9dc598 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:52.344803 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c06fef-af46-4a8a-a57d-1ec02f9dc598 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:52.344961 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5704171-94de-4b21-874d-f429807ef2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:52.346010 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5704171-94de-4b21-874d-f429807ef2d3 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:52.346289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5704171-94de-4b21-874d-f429807ef2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:52.346760 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5704171-94de-4b21-874d-f429807ef2d3 None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0/groups/0b13c92dc684456fbcf49617d04ab31b/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:52.349208 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5704171-94de-4b21-874d-f429807ef2d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ec8dbf812ab46129e7de7e927d484f0, group_id=0b13c92dc684456fbcf49617d04ab31b, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:52.351086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5704171-94de-4b21-874d-f429807ef2d3 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:52.358600 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c06fef-af46-4a8a-a57d-1ec02f9dc598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:52.366722 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 202/396] 10.222.0.90 () {58 vars in 1442 bytes} [Wed Nov 2 12:38:52 2022] PUT /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0/groups/0b13c92dc684456fbcf49617d04ab31b/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:52.367250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-d5c06fef-af46-4a8a-a57d-1ec02f9dc598 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:52.372361 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 195/397] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:38:52.374947 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5704171-94de-4b21-874d-f429807ef2d3 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:52.499538 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5704171-94de-4b21-874d-f429807ef2d3 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:52.543564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a074dcd-0c56-4dee-a84b-0a6266e1d143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:52.544645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a074dcd-0c56-4dee-a84b-0a6266e1d143 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:52.545141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a074dcd-0c56-4dee-a84b-0a6266e1d143 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:52.545611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a074dcd-0c56-4dee-a84b-0a6266e1d143 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:52.546583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a074dcd-0c56-4dee-a84b-0a6266e1d143 None admin] RBAC: Adding query filter params (name=member) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:52.547198 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a074dcd-0c56-4dee-a84b-0a6266e1d143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:52.548917 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a074dcd-0c56-4dee-a84b-0a6266e1d143 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:52.559193 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 203/398] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:52.566335 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c06fef-af46-4a8a-a57d-1ec02f9dc598 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:52.682172 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c06fef-af46-4a8a-a57d-1ec02f9dc598 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:52.741364 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38635221-e24d-41e1-9779-0f496ae2bdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:52.742837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38635221-e24d-41e1-9779-0f496ae2bdc0 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:52.743323 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38635221-e24d-41e1-9779-0f496ae2bdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:52.743808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38635221-e24d-41e1-9779-0f496ae2bdc0 None admin] PATH_INFO: `/v3/groups/0b13c92dc684456fbcf49617d04ab31b` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:52.745884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38635221-e24d-41e1-9779-0f496ae2bdc0 None admin] RBAC: Authorizing `identity:get_group(group_id=0b13c92dc684456fbcf49617d04ab31b)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:52.748607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38635221-e24d-41e1-9779-0f496ae2bdc0 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:52.751577 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 196/399] 10.222.0.90 () {56 vars in 1180 bytes} [Wed Nov 2 12:38:52 2022] GET /identity/v3/groups/0b13c92dc684456fbcf49617d04ab31b => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:52.760578 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a074dcd-0c56-4dee-a84b-0a6266e1d143 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:52.932953 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a074dcd-0c56-4dee-a84b-0a6266e1d143 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:52.989068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db25aec-464d-4614-8454-a5861c2af50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:52.990607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db25aec-464d-4614-8454-a5861c2af50b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:52.991101 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db25aec-464d-4614-8454-a5861c2af50b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:52.991591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db25aec-464d-4614-8454-a5861c2af50b None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:52.993658 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db25aec-464d-4614-8454-a5861c2af50b None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:52.996371 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db25aec-464d-4614-8454-a5861c2af50b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:52.999907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 204/400] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:52 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:53.009334 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38635221-e24d-41e1-9779-0f496ae2bdc0 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:53.185960 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38635221-e24d-41e1-9779-0f496ae2bdc0 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:53.243406 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69df5df-cf0c-4bb1-9d79-b54cead360cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:53.245031 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69df5df-cf0c-4bb1-9d79-b54cead360cd None admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:53.245522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69df5df-cf0c-4bb1-9d79-b54cead360cd None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:53.246055 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69df5df-cf0c-4bb1-9d79-b54cead360cd None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8/groups/0b13c92dc684456fbcf49617d04ab31b/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:53.249592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69df5df-cf0c-4bb1-9d79-b54cead360cd None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd1e0280cf34f23ae68adb0de691bc8, group_id=0b13c92dc684456fbcf49617d04ab31b, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:53.252228 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69df5df-cf0c-4bb1-9d79-b54cead360cd None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:53.276588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 197/401] 10.222.0.90 () {58 vars in 1442 bytes} [Wed Nov 2 12:38:53 2022] PUT /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8/groups/0b13c92dc684456fbcf49617d04ab31b/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:53.607258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d435ab4-6b59-4502-ae7d-bf8fd9557e45 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:53.607772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d435ab4-6b59-4502-ae7d-bf8fd9557e45 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:53.607846 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d435ab4-6b59-4502-ae7d-bf8fd9557e45 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:53.610085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 205/402] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:53.615830 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd7df8-3ad4-48ea-8fcf-3bb0768d5a82 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:53.616143 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd7df8-3ad4-48ea-8fcf-3bb0768d5a82 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:53.616448 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd7df8-3ad4-48ea-8fcf-3bb0768d5a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:53.628396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6563f9-5d5a-4d9d-a49d-d628b651059e None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:53.628738 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6563f9-5d5a-4d9d-a49d-d628b651059e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:53.628949 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6563f9-5d5a-4d9d-a49d-d628b651059e None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:53.631788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 206/403] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:53.637727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d84560-1789-4883-8a71-c65319c857f6 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:53.638015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d84560-1789-4883-8a71-c65319c857f6 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:53.638293 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d84560-1789-4883-8a71-c65319c857f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:53.639031 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-4ddd7df8-3ad4-48ea-8fcf-3bb0768d5a82 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:53.640253 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4ddd7df8-3ad4-48ea-8fcf-3bb0768d5a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:53.669275 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-a6d84560-1789-4883-8a71-c65319c857f6 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:53.670475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-a6d84560-1789-4883-8a71-c65319c857f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:53.735853 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 198/404] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:53.757084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 207/405] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:53.769165 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd7df8-3ad4-48ea-8fcf-3bb0768d5a82 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:53.785258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d84560-1789-4883-8a71-c65319c857f6 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:53.914790 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d84560-1789-4883-8a71-c65319c857f6 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:53.955582 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9cf43-7dc2-43b3-8275-1a37835a44a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:53.956475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9cf43-7dc2-43b3-8275-1a37835a44a4 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:53.956756 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9cf43-7dc2-43b3-8275-1a37835a44a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:53.957029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9cf43-7dc2-43b3-8275-1a37835a44a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:53.968302 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd7df8-3ad4-48ea-8fcf-3bb0768d5a82 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:53.974106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9cf43-7dc2-43b3-8275-1a37835a44a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:53.981746 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-8bf9cf43-7dc2-43b3-8275-1a37835a44a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:38:53.983327 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 208/406] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:38:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:38:53.989248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9cf43-7dc2-43b3-8275-1a37835a44a4 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:54.039599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df691b5-1ffb-4b52-bff8-c40ecb4888d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:54.040679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df691b5-1ffb-4b52-bff8-c40ecb4888d5 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:54.040679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df691b5-1ffb-4b52-bff8-c40ecb4888d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:54.040975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df691b5-1ffb-4b52-bff8-c40ecb4888d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:54.062130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df691b5-1ffb-4b52-bff8-c40ecb4888d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:54.072951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-6df691b5-1ffb-4b52-bff8-c40ecb4888d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:38:54.074500 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 199/407] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:38:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:54.080699 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df691b5-1ffb-4b52-bff8-c40ecb4888d5 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:54.104498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9cf43-7dc2-43b3-8275-1a37835a44a4 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:54.143094 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e3749-0c7b-4de2-b62c-13fafa91ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:54.144185 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e3749-0c7b-4de2-b62c-13fafa91ec03 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:54.144692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e3749-0c7b-4de2-b62c-13fafa91ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:54.145178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e3749-0c7b-4de2-b62c-13fafa91ec03 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:54.146118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e3749-0c7b-4de2-b62c-13fafa91ec03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:54.146613 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e3749-0c7b-4de2-b62c-13fafa91ec03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:54.148289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e3749-0c7b-4de2-b62c-13fafa91ec03 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:54.158304 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 209/408] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:38:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:54.171278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e3749-0c7b-4de2-b62c-13fafa91ec03 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:54.242927 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df691b5-1ffb-4b52-bff8-c40ecb4888d5 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:54.291415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef8e7b-28f3-4ebd-9625-f9f33e8db5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:54.292119 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef8e7b-28f3-4ebd-9625-f9f33e8db5f5 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:54.292613 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef8e7b-28f3-4ebd-9625-f9f33e8db5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:54.292930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef8e7b-28f3-4ebd-9625-f9f33e8db5f5 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:54.293723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef8e7b-28f3-4ebd-9625-f9f33e8db5f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:54.294028 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef8e7b-28f3-4ebd-9625-f9f33e8db5f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:54.295425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef8e7b-28f3-4ebd-9625-f9f33e8db5f5 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:54.307723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 200/409] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:54.314424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef8e7b-28f3-4ebd-9625-f9f33e8db5f5 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:54.364610 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e3749-0c7b-4de2-b62c-13fafa91ec03 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:54.427652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef8e7b-28f3-4ebd-9625-f9f33e8db5f5 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:54.451914 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8bae-7d13-4933-a73d-2f0d3f129a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:54.452945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8bae-7d13-4933-a73d-2f0d3f129a4e None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:54.453343 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8bae-7d13-4933-a73d-2f0d3f129a4e None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:54.453520 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8bae-7d13-4933-a73d-2f0d3f129a4e None admin] PATH_INFO: `/v3/groups/0b13c92dc684456fbcf49617d04ab31b` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:54.454843 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a8bae-7d13-4933-a73d-2f0d3f129a4e None admin] RBAC: Authorizing `identity:get_group(group_id=0b13c92dc684456fbcf49617d04ab31b)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:54.456338 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a8bae-7d13-4933-a73d-2f0d3f129a4e None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:54.458354 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 210/410] 10.222.0.90 () {56 vars in 1180 bytes} [Wed Nov 2 12:38:54 2022] GET /identity/v3/groups/0b13c92dc684456fbcf49617d04ab31b => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:54.465367 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8bae-7d13-4933-a73d-2f0d3f129a4e None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:54.485282 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f33b5f-34a8-4f00-bf57-454bf1481ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:54.486194 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f33b5f-34a8-4f00-bf57-454bf1481ad7 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:54.486480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f33b5f-34a8-4f00-bf57-454bf1481ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:54.486752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f33b5f-34a8-4f00-bf57-454bf1481ad7 None admin] PATH_INFO: `/v3/groups/f0d24683ecea4d168004f111c36b82ab` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:54.488628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f33b5f-34a8-4f00-bf57-454bf1481ad7 None admin] RBAC: Authorizing `identity:get_group(group_id=f0d24683ecea4d168004f111c36b82ab)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:54.490327 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f33b5f-34a8-4f00-bf57-454bf1481ad7 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:54.491987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 201/411] 10.222.0.90 () {56 vars in 1180 bytes} [Wed Nov 2 12:38:54 2022] GET /identity/v3/groups/f0d24683ecea4d168004f111c36b82ab => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:54.505566 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f33b5f-34a8-4f00-bf57-454bf1481ad7 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:54.608456 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8bae-7d13-4933-a73d-2f0d3f129a4e None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:54.649145 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55389a85-3838-4145-a8b9-f4f580c6d691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:54.650221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55389a85-3838-4145-a8b9-f4f580c6d691 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:54.650516 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55389a85-3838-4145-a8b9-f4f580c6d691 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:54.650794 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55389a85-3838-4145-a8b9-f4f580c6d691 None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:54.652950 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55389a85-3838-4145-a8b9-f4f580c6d691 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:54.654928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55389a85-3838-4145-a8b9-f4f580c6d691 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:54.657098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 211/412] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:54 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:54.663397 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55389a85-3838-4145-a8b9-f4f580c6d691 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:54.699554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f33b5f-34a8-4f00-bf57-454bf1481ad7 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:54.733856 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4408066-546b-4358-86ef-bc542de044ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:54.734740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408066-546b-4358-86ef-bc542de044ae None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:54.735021 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408066-546b-4358-86ef-bc542de044ae None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:54.735302 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408066-546b-4358-86ef-bc542de044ae None admin] PATH_INFO: `/v3/projects/b31a529f322f43dfa78c0719df9a66db` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:54.736560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4408066-546b-4358-86ef-bc542de044ae None admin] RBAC: Authorizing `identity:get_project(project_id=b31a529f322f43dfa78c0719df9a66db)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:54.738029 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4408066-546b-4358-86ef-bc542de044ae None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:54.739771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 202/413] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:54 2022] GET /identity/v3/projects/b31a529f322f43dfa78c0719df9a66db => generated 344 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:54.755680 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4408066-546b-4358-86ef-bc542de044ae None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:54.798535 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55389a85-3838-4145-a8b9-f4f580c6d691 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:54.836071 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1594ad-7c9c-4b78-8887-6d4576a3478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:54.837138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1594ad-7c9c-4b78-8887-6d4576a3478f None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:54.837393 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1594ad-7c9c-4b78-8887-6d4576a3478f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:54.837665 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1594ad-7c9c-4b78-8887-6d4576a3478f None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8/groups/0b13c92dc684456fbcf49617d04ab31b/roles/7b4e238c731941f18493cd62e30b1e4f` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:54.839965 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1594ad-7c9c-4b78-8887-6d4576a3478f None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd1e0280cf34f23ae68adb0de691bc8, group_id=0b13c92dc684456fbcf49617d04ab31b, role_id=7b4e238c731941f18493cd62e30b1e4f)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:54.841579 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1594ad-7c9c-4b78-8887-6d4576a3478f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:54.869635 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 212/414] 10.222.0.90 () {58 vars in 1442 bytes} [Wed Nov 2 12:38:54 2022] PUT /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8/groups/0b13c92dc684456fbcf49617d04ab31b/roles/7b4e238c731941f18493cd62e30b1e4f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:54.924544 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4408066-546b-4358-86ef-bc542de044ae None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:54.967258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36158fdf-dacc-4102-8472-2bfb1f67d8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:54.968856 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36158fdf-dacc-4102-8472-2bfb1f67d8c7 None admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:54.969418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36158fdf-dacc-4102-8472-2bfb1f67d8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:54.969914 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36158fdf-dacc-4102-8472-2bfb1f67d8c7 None admin] PATH_INFO: `/v3/projects/b31a529f322f43dfa78c0719df9a66db/groups/f0d24683ecea4d168004f111c36b82ab/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:54.974252 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36158fdf-dacc-4102-8472-2bfb1f67d8c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b31a529f322f43dfa78c0719df9a66db, group_id=f0d24683ecea4d168004f111c36b82ab, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:54.976081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36158fdf-dacc-4102-8472-2bfb1f67d8c7 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:54.999360 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 203/415] 10.222.0.90 () {58 vars in 1442 bytes} [Wed Nov 2 12:38:54 2022] PUT /identity/v3/projects/b31a529f322f43dfa78c0719df9a66db/groups/f0d24683ecea4d168004f111c36b82ab/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:38:55.407004 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2ca41-c8c6-48c4-9fc6-9af8ac933a18 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:55.407530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2ca41-c8c6-48c4-9fc6-9af8ac933a18 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:55.407949 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2ca41-c8c6-48c4-9fc6-9af8ac933a18 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:55.410270 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 213/416] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:55.416106 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527304f-20e2-4337-8150-56b0016eb72a None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:55.416602 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527304f-20e2-4337-8150-56b0016eb72a None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:55.416796 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527304f-20e2-4337-8150-56b0016eb72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:55.439123 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e527304f-20e2-4337-8150-56b0016eb72a None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:55.440346 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e527304f-20e2-4337-8150-56b0016eb72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:55.522658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 204/417] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:55.565971 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2ca41-c8c6-48c4-9fc6-9af8ac933a18 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:55.675421 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b5b41-c3e8-47f2-b4f3-0cfbbb468031 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:55.675757 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b5b41-c3e8-47f2-b4f3-0cfbbb468031 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:55.675971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b5b41-c3e8-47f2-b4f3-0cfbbb468031 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:55.678046 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 205/418] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:38:55.685486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98b0a3-b493-4478-ab26-bdb879b97d80 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:55.685766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98b0a3-b493-4478-ab26-bdb879b97d80 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:55.686038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98b0a3-b493-4478-ab26-bdb879b97d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:55.711364 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2ca41-c8c6-48c4-9fc6-9af8ac933a18 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:55.714313 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-2c98b0a3-b493-4478-ab26-bdb879b97d80 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:55.715555 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-2c98b0a3-b493-4478-ab26-bdb879b97d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:55.772276 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cd08e-ef78-4bce-b62e-01ea28369233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:55.773105 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cd08e-ef78-4bce-b62e-01ea28369233 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:55.773381 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cd08e-ef78-4bce-b62e-01ea28369233 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:55.779593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cd08e-ef78-4bce-b62e-01ea28369233 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:55.797668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cd08e-ef78-4bce-b62e-01ea28369233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:55.816253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-014cd08e-ef78-4bce-b62e-01ea28369233 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:38:55.817555 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 214/419] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:38:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:55.823812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cd08e-ef78-4bce-b62e-01ea28369233 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:55.841423 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 206/420] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:55.874911 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98b0a3-b493-4478-ab26-bdb879b97d80 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:55.938246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cd08e-ef78-4bce-b62e-01ea28369233 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:55.980524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c46d42-9a4e-4c6c-8452-195f57df70ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:55.981208 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c46d42-9a4e-4c6c-8452-195f57df70ff None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:55.981488 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c46d42-9a4e-4c6c-8452-195f57df70ff None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:55.981762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c46d42-9a4e-4c6c-8452-195f57df70ff None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:55.982508 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c46d42-9a4e-4c6c-8452-195f57df70ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:55.982825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c46d42-9a4e-4c6c-8452-195f57df70ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:55.984236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c46d42-9a4e-4c6c-8452-195f57df70ff None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:56.005836 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 215/421] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:38:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:56.011947 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c46d42-9a4e-4c6c-8452-195f57df70ff None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:56.110436 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98b0a3-b493-4478-ab26-bdb879b97d80 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:56.124987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c46d42-9a4e-4c6c-8452-195f57df70ff None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:56.163131 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcad8e2-ad18-4c8c-9dee-4d438f5f505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:56.163794 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcad8e2-ad18-4c8c-9dee-4d438f5f505f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:56.164072 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcad8e2-ad18-4c8c-9dee-4d438f5f505f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:56.164389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcad8e2-ad18-4c8c-9dee-4d438f5f505f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:56.181395 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34a062-a9b6-416f-a6c5-ccd3f25b5f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:56.182202 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34a062-a9b6-416f-a6c5-ccd3f25b5f11 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:56.182479 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34a062-a9b6-416f-a6c5-ccd3f25b5f11 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:56.182751 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34a062-a9b6-416f-a6c5-ccd3f25b5f11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:56.202767 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34a062-a9b6-416f-a6c5-ccd3f25b5f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:56.210018 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-ec34a062-a9b6-416f-a6c5-ccd3f25b5f11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:56.211259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 207/422] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:38:56.220833 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34a062-a9b6-416f-a6c5-ccd3f25b5f11 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:56.305097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcad8e2-ad18-4c8c-9dee-4d438f5f505f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:56.306605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcad8e2-ad18-4c8c-9dee-4d438f5f505f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:56.351796 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34a062-a9b6-416f-a6c5-ccd3f25b5f11 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:56.410367 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f048c-aba2-4ac6-a07e-9dbc3a047e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:56.411054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f048c-aba2-4ac6-a07e-9dbc3a047e5d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:56.411333 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f048c-aba2-4ac6-a07e-9dbc3a047e5d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:56.411599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f048c-aba2-4ac6-a07e-9dbc3a047e5d None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:56.412375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f048c-aba2-4ac6-a07e-9dbc3a047e5d None admin] RBAC: Adding query filter params (name=member) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:56.412681 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f048c-aba2-4ac6-a07e-9dbc3a047e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:56.414099 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f048c-aba2-4ac6-a07e-9dbc3a047e5d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:56.434950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 208/423] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:56.440761 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f048c-aba2-4ac6-a07e-9dbc3a047e5d None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:56.498514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 216/424] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:56.500180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91579d7-9dc7-4e58-99cd-36b1a66ef189 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:56.500637 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91579d7-9dc7-4e58-99cd-36b1a66ef189 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:56.501051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91579d7-9dc7-4e58-99cd-36b1a66ef189 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:56.507056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 217/425] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:56.508116 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91579d7-9dc7-4e58-99cd-36b1a66ef189 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:56.585266 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f048c-aba2-4ac6-a07e-9dbc3a047e5d None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:56.608901 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91579d7-9dc7-4e58-99cd-36b1a66ef189 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:56.627356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e948e-4b29-410a-bdbb-9cb9bb456aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:56.628085 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e948e-4b29-410a-bdbb-9cb9bb456aae None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:56.628388 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e948e-4b29-410a-bdbb-9cb9bb456aae None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:56.628661 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e948e-4b29-410a-bdbb-9cb9bb456aae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:56.643622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013fd29-3c39-4791-8136-ab82e14f40c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:56.644777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013fd29-3c39-4791-8136-ab82e14f40c0 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:56.645229 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013fd29-3c39-4791-8136-ab82e14f40c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:56.645676 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013fd29-3c39-4791-8136-ab82e14f40c0 None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:56.647059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013fd29-3c39-4791-8136-ab82e14f40c0 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:56.648754 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013fd29-3c39-4791-8136-ab82e14f40c0 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:56.650954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 218/426] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:56 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:56.652362 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a260d-f90d-4eca-8c28-9af2351abe72 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:56.652830 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a260d-f90d-4eca-8c28-9af2351abe72 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:56.653308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a260d-f90d-4eca-8c28-9af2351abe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:56.670564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-3e4a260d-f90d-4eca-8c28-9af2351abe72 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:56.672154 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-3e4a260d-f90d-4eca-8c28-9af2351abe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:56.710880 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e948e-4b29-410a-bdbb-9cb9bb456aae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:56.712482 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e948e-4b29-410a-bdbb-9cb9bb456aae None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:56.741008 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 219/427] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:56.742451 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a260d-f90d-4eca-8c28-9af2351abe72 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:56.839979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 209/428] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:56.839979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e948e-4b29-410a-bdbb-9cb9bb456aae None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:56.844603 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a260d-f90d-4eca-8c28-9af2351abe72 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:56.878855 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70321c28-60d4-4ddc-b036-7bb506e29923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:56.879968 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70321c28-60d4-4ddc-b036-7bb506e29923 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:56.880427 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70321c28-60d4-4ddc-b036-7bb506e29923 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:56.880835 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70321c28-60d4-4ddc-b036-7bb506e29923 None admin] PATH_INFO: `/v3/groups/0b13c92dc684456fbcf49617d04ab31b` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:56.882148 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70321c28-60d4-4ddc-b036-7bb506e29923 None admin] RBAC: Authorizing `identity:get_group(group_id=0b13c92dc684456fbcf49617d04ab31b)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:56.883782 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70321c28-60d4-4ddc-b036-7bb506e29923 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:56.885999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 220/429] 10.222.0.90 () {56 vars in 1180 bytes} [Wed Nov 2 12:38:56 2022] GET /identity/v3/groups/0b13c92dc684456fbcf49617d04ab31b => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:56.887101 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70321c28-60d4-4ddc-b036-7bb506e29923 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:56.957814 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e948e-4b29-410a-bdbb-9cb9bb456aae None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:56.999445 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a7050-9c97-47ab-aa6d-c1b15bcc1e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:57.000799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a7050-9c97-47ab-aa6d-c1b15bcc1e32 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.001223 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a7050-9c97-47ab-aa6d-c1b15bcc1e32 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.001636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a7050-9c97-47ab-aa6d-c1b15bcc1e32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.002013 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70321c28-60d4-4ddc-b036-7bb506e29923 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:57.013876 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a7050-9c97-47ab-aa6d-c1b15bcc1e32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:57.023217 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-502a7050-9c97-47ab-aa6d-c1b15bcc1e32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:38:57.025735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 210/430] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:57.026706 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a7050-9c97-47ab-aa6d-c1b15bcc1e32 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:57.044977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1509db-4cee-4312-8138-faacb57812db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:57.046648 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1509db-4cee-4312-8138-faacb57812db None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.047074 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1509db-4cee-4312-8138-faacb57812db None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.047723 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1509db-4cee-4312-8138-faacb57812db None admin] PATH_INFO: `/v3/projects/5ec8dbf812ab46129e7de7e927d484f0` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.049266 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1509db-4cee-4312-8138-faacb57812db None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8dbf812ab46129e7de7e927d484f0)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:57.051186 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1509db-4cee-4312-8138-faacb57812db None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:57.053948 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 221/431] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:56 2022] GET /identity/v3/projects/5ec8dbf812ab46129e7de7e927d484f0 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:57.054998 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1509db-4cee-4312-8138-faacb57812db None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:57.138011 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a7050-9c97-47ab-aa6d-c1b15bcc1e32 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:57.163890 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1509db-4cee-4312-8138-faacb57812db None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:57.173858 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d0895-e41a-44b2-b541-e424f76278b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:57.174803 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d0895-e41a-44b2-b541-e424f76278b0 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.175232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d0895-e41a-44b2-b541-e424f76278b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.175640 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d0895-e41a-44b2-b541-e424f76278b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.176638 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d0895-e41a-44b2-b541-e424f76278b0 None admin] RBAC: Adding query filter params (group.id=0b13c92dc684456fbcf49617d04ab31b, role.id=7b4e238c731941f18493cd62e30b1e4f, scope.project.id=5ec8dbf812ab46129e7de7e927d484f0) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:57.177083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d0895-e41a-44b2-b541-e424f76278b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:57.178690 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d0895-e41a-44b2-b541-e424f76278b0 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:57.185151 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 211/432] 10.222.0.90 () {56 vars in 1376 bytes} [Wed Nov 2 12:38:57 2022] GET /identity/v3/role_assignments?group.id=0b13c92dc684456fbcf49617d04ab31b&scope.project.id=5ec8dbf812ab46129e7de7e927d484f0&role.id=7b4e238c731941f18493cd62e30b1e4f => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:57.186226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d0895-e41a-44b2-b541-e424f76278b0 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:57.199745 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7d85d-d21d-4f53-938d-872a9bf07ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:57.200585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7d85d-d21d-4f53-938d-872a9bf07ebb None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.200874 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7d85d-d21d-4f53-938d-872a9bf07ebb None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.201153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7d85d-d21d-4f53-938d-872a9bf07ebb None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.201934 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7d85d-d21d-4f53-938d-872a9bf07ebb None admin] RBAC: Adding query filter params (name=member) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:57.202411 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7d85d-d21d-4f53-938d-872a9bf07ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:57.204094 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7d85d-d21d-4f53-938d-872a9bf07ebb None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:57.213848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 222/433] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:38:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:57.228320 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7d85d-d21d-4f53-938d-872a9bf07ebb None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:57.304320 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d0895-e41a-44b2-b541-e424f76278b0 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:57.341123 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9c98c-1323-440b-acec-532b249d8bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:57.342419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9c98c-1323-440b-acec-532b249d8bdc None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.342928 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9c98c-1323-440b-acec-532b249d8bdc None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.343395 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9c98c-1323-440b-acec-532b249d8bdc None admin] PATH_INFO: `/v3/groups/0b13c92dc684456fbcf49617d04ab31b` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.345090 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9c98c-1323-440b-acec-532b249d8bdc None admin] RBAC: Authorizing `identity:get_group(group_id=0b13c92dc684456fbcf49617d04ab31b)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:57.346838 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9c98c-1323-440b-acec-532b249d8bdc None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:57.348902 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 212/434] 10.222.0.90 () {56 vars in 1180 bytes} [Wed Nov 2 12:38:57 2022] GET /identity/v3/groups/0b13c92dc684456fbcf49617d04ab31b => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:57.355316 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9c98c-1323-440b-acec-532b249d8bdc None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:57.389439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7d85d-d21d-4f53-938d-872a9bf07ebb None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:57.438130 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c62d2a-41ec-4ae1-b4ca-a51e5ce4af53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:57.440444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c62d2a-41ec-4ae1-b4ca-a51e5ce4af53 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.440888 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c62d2a-41ec-4ae1-b4ca-a51e5ce4af53 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.441320 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c62d2a-41ec-4ae1-b4ca-a51e5ce4af53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.504483 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9c98c-1323-440b-acec-532b249d8bdc None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:57.533783 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c62d2a-41ec-4ae1-b4ca-a51e5ce4af53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:57.535508 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c62d2a-41ec-4ae1-b4ca-a51e5ce4af53 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:57.547799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e70fe9-bec5-404c-9606-e06c29de79a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:57.548927 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e70fe9-bec5-404c-9606-e06c29de79a1 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.549300 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e70fe9-bec5-404c-9606-e06c29de79a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.549671 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e70fe9-bec5-404c-9606-e06c29de79a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.550774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e70fe9-bec5-404c-9606-e06c29de79a1 None admin] RBAC: Adding query filter params (group.id=0b13c92dc684456fbcf49617d04ab31b, role.id=ab7ac47ce77b490b8868c79a13a2a0aa, scope.project.id=5ec8dbf812ab46129e7de7e927d484f0) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:57.551179 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e70fe9-bec5-404c-9606-e06c29de79a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:57.553438 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e70fe9-bec5-404c-9606-e06c29de79a1 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:57.561756 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 213/435] 10.222.0.90 () {56 vars in 1376 bytes} [Wed Nov 2 12:38:57 2022] GET /identity/v3/role_assignments?group.id=0b13c92dc684456fbcf49617d04ab31b&scope.project.id=5ec8dbf812ab46129e7de7e927d484f0&role.id=ab7ac47ce77b490b8868c79a13a2a0aa => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:57.649473 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 223/436] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:57.655696 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e70fe9-bec5-404c-9606-e06c29de79a1 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:57.766641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e70fe9-bec5-404c-9606-e06c29de79a1 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:57.799941 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424a2e5-718a-400d-aae7-a3eb658b8dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:57.800844 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424a2e5-718a-400d-aae7-a3eb658b8dde None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.801121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424a2e5-718a-400d-aae7-a3eb658b8dde None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.801393 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424a2e5-718a-400d-aae7-a3eb658b8dde None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.802577 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424a2e5-718a-400d-aae7-a3eb658b8dde None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:57.804067 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424a2e5-718a-400d-aae7-a3eb658b8dde None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:57.806119 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 214/437] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:57 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:57.811880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c62d2a-41ec-4ae1-b4ca-a51e5ce4af53 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:57.817981 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8d4a3-92fb-4263-b883-2ee8d14cc44a None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.818269 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8d4a3-92fb-4263-b883-2ee8d14cc44a None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.818548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8d4a3-92fb-4263-b883-2ee8d14cc44a None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.820620 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 215/438] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:57.825887 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98e18a-0163-4ba2-9de0-8e57fe57c6d5 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.826175 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98e18a-0163-4ba2-9de0-8e57fe57c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.826453 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98e18a-0163-4ba2-9de0-8e57fe57c6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.847549 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-fd98e18a-0163-4ba2-9de0-8e57fe57c6d5 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:57.848521 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-fd98e18a-0163-4ba2-9de0-8e57fe57c6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:57.927477 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c62d2a-41ec-4ae1-b4ca-a51e5ce4af53 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:57.929515 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 216/439] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:57.931634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6c369-6d32-4e17-8ba7-4d1065faa11f None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.931917 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6c369-6d32-4e17-8ba7-4d1065faa11f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.932225 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6c369-6d32-4e17-8ba7-4d1065faa11f None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.934102 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 217/440] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:57.940184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031be486-60f5-4c39-9825-c8172428d211 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.942277 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031be486-60f5-4c39-9825-c8172428d211 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.942578 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031be486-60f5-4c39-9825-c8172428d211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.963174 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-031be486-60f5-4c39-9825-c8172428d211 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:57.964396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-031be486-60f5-4c39-9825-c8172428d211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:57.973027 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb14d1e-161d-4f40-a9f8-03c4de1ea639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:57.973934 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb14d1e-161d-4f40-a9f8-03c4de1ea639 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.974538 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb14d1e-161d-4f40-a9f8-03c4de1ea639 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.974838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb14d1e-161d-4f40-a9f8-03c4de1ea639 None admin] PATH_INFO: `/v3/groups/0b13c92dc684456fbcf49617d04ab31b` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.976247 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb14d1e-161d-4f40-a9f8-03c4de1ea639 None admin] RBAC: Authorizing `identity:get_group(group_id=0b13c92dc684456fbcf49617d04ab31b)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:57.977514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb14d1e-161d-4f40-a9f8-03c4de1ea639 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:57.979452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 224/441] 10.222.0.90 () {56 vars in 1180 bytes} [Wed Nov 2 12:38:57 2022] GET /identity/v3/groups/0b13c92dc684456fbcf49617d04ab31b => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:57.980745 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb14d1e-161d-4f40-a9f8-03c4de1ea639 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:58.037997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 218/442] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:58.040045 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031be486-60f5-4c39-9825-c8172428d211 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:58.100450 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb14d1e-161d-4f40-a9f8-03c4de1ea639 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:58.144559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9884e76-ff03-4b21-80a1-06b9d97374f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:58.145415 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9884e76-ff03-4b21-80a1-06b9d97374f9 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.145697 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9884e76-ff03-4b21-80a1-06b9d97374f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.145981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9884e76-ff03-4b21-80a1-06b9d97374f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.152477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031be486-60f5-4c39-9825-c8172428d211 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:58.161184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9884e76-ff03-4b21-80a1-06b9d97374f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:58.168781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-d9884e76-ff03-4b21-80a1-06b9d97374f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:38:58.170234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 225/443] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:38:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:58.171173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9884e76-ff03-4b21-80a1-06b9d97374f9 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:58.195682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969c22f-4686-43e4-a6a5-36de4976d0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:58.196440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969c22f-4686-43e4-a6a5-36de4976d0cd None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.196721 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969c22f-4686-43e4-a6a5-36de4976d0cd None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.196992 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969c22f-4686-43e4-a6a5-36de4976d0cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.197839 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969c22f-4686-43e4-a6a5-36de4976d0cd None admin] RBAC: Adding query filter params (group.id=0b13c92dc684456fbcf49617d04ab31b, role.id=ab7ac47ce77b490b8868c79a13a2a0aa, scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:58.198153 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969c22f-4686-43e4-a6a5-36de4976d0cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:58.199667 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969c22f-4686-43e4-a6a5-36de4976d0cd None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:58.205759 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 219/444] 10.222.0.90 () {56 vars in 1376 bytes} [Wed Nov 2 12:38:58 2022] GET /identity/v3/role_assignments?group.id=0b13c92dc684456fbcf49617d04ab31b&scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8&role.id=ab7ac47ce77b490b8868c79a13a2a0aa => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:58.206548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969c22f-4686-43e4-a6a5-36de4976d0cd None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:58.277743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9884e76-ff03-4b21-80a1-06b9d97374f9 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:58.313842 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63198a7-f140-4f8d-b83b-ce4c6f2c0ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:58.314652 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63198a7-f140-4f8d-b83b-ce4c6f2c0ffb None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.314937 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63198a7-f140-4f8d-b83b-ce4c6f2c0ffb None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.315210 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63198a7-f140-4f8d-b83b-ce4c6f2c0ffb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.315633 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969c22f-4686-43e4-a6a5-36de4976d0cd None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:58.326467 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63198a7-f140-4f8d-b83b-ce4c6f2c0ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:38:58.333644 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-e63198a7-f140-4f8d-b83b-ce4c6f2c0ffb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:38:58.334886 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 226/445] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:38:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:38:58.341168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63198a7-f140-4f8d-b83b-ce4c6f2c0ffb None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:58.352717 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e277d7-a401-473a-8b89-fae776e6da59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:58.353339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e277d7-a401-473a-8b89-fae776e6da59 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.353618 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e277d7-a401-473a-8b89-fae776e6da59 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.353889 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e277d7-a401-473a-8b89-fae776e6da59 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.354687 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e277d7-a401-473a-8b89-fae776e6da59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:58.354958 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e277d7-a401-473a-8b89-fae776e6da59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:58.356460 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e277d7-a401-473a-8b89-fae776e6da59 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:58.365505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 220/446] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:38:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:58.371258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e277d7-a401-473a-8b89-fae776e6da59 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:58.458316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63198a7-f140-4f8d-b83b-ce4c6f2c0ffb None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:58.481020 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e277d7-a401-473a-8b89-fae776e6da59 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:58.498822 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f35d9-8526-46b1-b030-088ff6e20942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:58.499485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f35d9-8526-46b1-b030-088ff6e20942 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.499763 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f35d9-8526-46b1-b030-088ff6e20942 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.500341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f35d9-8526-46b1-b030-088ff6e20942 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.501357 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f35d9-8526-46b1-b030-088ff6e20942 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:58.501818 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f35d9-8526-46b1-b030-088ff6e20942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:58.503230 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f35d9-8526-46b1-b030-088ff6e20942 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:58.511852 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 227/447] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:38:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:58.517659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f35d9-8526-46b1-b030-088ff6e20942 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:58.521326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d518e2-e815-49f4-aad6-408a4903c609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:58.521986 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d518e2-e815-49f4-aad6-408a4903c609 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.522294 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d518e2-e815-49f4-aad6-408a4903c609 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.522570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d518e2-e815-49f4-aad6-408a4903c609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.599169 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d518e2-e815-49f4-aad6-408a4903c609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:58.600760 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d518e2-e815-49f4-aad6-408a4903c609 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:58.630666 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f35d9-8526-46b1-b030-088ff6e20942 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:58.662219 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed972e-f0e1-43c5-971a-727a0189e3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:58.662879 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed972e-f0e1-43c5-971a-727a0189e3f7 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.663160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed972e-f0e1-43c5-971a-727a0189e3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.663435 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed972e-f0e1-43c5-971a-727a0189e3f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.696501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 221/448] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:58.702284 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d518e2-e815-49f4-aad6-408a4903c609 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:58.728731 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed972e-f0e1-43c5-971a-727a0189e3f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:58.730260 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed972e-f0e1-43c5-971a-727a0189e3f7 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:58.798981 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d518e2-e815-49f4-aad6-408a4903c609 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:58.827014 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 228/449] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:38:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:58.832724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d5682-c9bc-4d7d-9c2a-4090c87ffabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:58.832997 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed972e-f0e1-43c5-971a-727a0189e3f7 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:58.833603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d5682-c9bc-4d7d-9c2a-4090c87ffabb None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.833882 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d5682-c9bc-4d7d-9c2a-4090c87ffabb None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.834155 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d5682-c9bc-4d7d-9c2a-4090c87ffabb None admin] PATH_INFO: `/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.835344 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d5682-c9bc-4d7d-9c2a-4090c87ffabb None admin] RBAC: Authorizing `identity:get_project(project_id=9fd1e0280cf34f23ae68adb0de691bc8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:58.836826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d5682-c9bc-4d7d-9c2a-4090c87ffabb None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:58.838697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 222/450] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:58 2022] GET /identity/v3/projects/9fd1e0280cf34f23ae68adb0de691bc8 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:58.844094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d5682-c9bc-4d7d-9c2a-4090c87ffabb None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:58.927277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed972e-f0e1-43c5-971a-727a0189e3f7 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:58.936660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d5682-c9bc-4d7d-9c2a-4090c87ffabb None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:58.962013 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e8217-8b74-41eb-b1cc-62c906ab9e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:58.962903 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e8217-8b74-41eb-b1cc-62c906ab9e23 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.963179 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e8217-8b74-41eb-b1cc-62c906ab9e23 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.963445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e8217-8b74-41eb-b1cc-62c906ab9e23 None admin] PATH_INFO: `/v3/projects/b31a529f322f43dfa78c0719df9a66db` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.964721 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e8217-8b74-41eb-b1cc-62c906ab9e23 None admin] RBAC: Authorizing `identity:get_project(project_id=b31a529f322f43dfa78c0719df9a66db)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:58.966198 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e8217-8b74-41eb-b1cc-62c906ab9e23 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:58.967884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 229/451] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:38:58 2022] GET /identity/v3/projects/b31a529f322f43dfa78c0719df9a66db => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:58.968107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682dff1-2d15-4fb7-a22b-9b9afad2b5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:58.969143 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682dff1-2d15-4fb7-a22b-9b9afad2b5a6 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.969421 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682dff1-2d15-4fb7-a22b-9b9afad2b5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.969693 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682dff1-2d15-4fb7-a22b-9b9afad2b5a6 None admin] PATH_INFO: `/v3/groups/0b13c92dc684456fbcf49617d04ab31b` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.970858 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682dff1-2d15-4fb7-a22b-9b9afad2b5a6 None admin] RBAC: Authorizing `identity:get_group(group_id=0b13c92dc684456fbcf49617d04ab31b)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:58.972350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682dff1-2d15-4fb7-a22b-9b9afad2b5a6 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:58.973459 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e8217-8b74-41eb-b1cc-62c906ab9e23 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:58.974212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 223/452] 10.222.0.90 () {56 vars in 1180 bytes} [Wed Nov 2 12:38:58 2022] GET /identity/v3/groups/0b13c92dc684456fbcf49617d04ab31b => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:58.979718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682dff1-2d15-4fb7-a22b-9b9afad2b5a6 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:59.067612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e8217-8b74-41eb-b1cc-62c906ab9e23 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:59.074496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682dff1-2d15-4fb7-a22b-9b9afad2b5a6 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:59.101413 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72549015-783c-46f0-af64-3072766c1bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:59.102271 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72549015-783c-46f0-af64-3072766c1bb4 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:59.102544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72549015-783c-46f0-af64-3072766c1bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:59.102833 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72549015-783c-46f0-af64-3072766c1bb4 None admin] PATH_INFO: `/v3/groups/f0d24683ecea4d168004f111c36b82ab` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:59.104021 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72549015-783c-46f0-af64-3072766c1bb4 None admin] RBAC: Authorizing `identity:get_group(group_id=f0d24683ecea4d168004f111c36b82ab)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:59.105614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72549015-783c-46f0-af64-3072766c1bb4 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:59.107033 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ab55c-ad5a-4dde-a82f-6813208386e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:59.107487 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 230/453] 10.222.0.90 () {56 vars in 1180 bytes} [Wed Nov 2 12:38:58 2022] GET /identity/v3/groups/f0d24683ecea4d168004f111c36b82ab => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:59.107709 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ab55c-ad5a-4dde-a82f-6813208386e9 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:59.107994 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ab55c-ad5a-4dde-a82f-6813208386e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:59.108345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ab55c-ad5a-4dde-a82f-6813208386e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:59.109114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ab55c-ad5a-4dde-a82f-6813208386e9 None admin] RBAC: Adding query filter params (group.id=0b13c92dc684456fbcf49617d04ab31b, role.id=7b4e238c731941f18493cd62e30b1e4f, scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:59.109424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ab55c-ad5a-4dde-a82f-6813208386e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:59.110840 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ab55c-ad5a-4dde-a82f-6813208386e9 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:59.113355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72549015-783c-46f0-af64-3072766c1bb4 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:59.116786 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 224/454] 10.222.0.90 () {56 vars in 1376 bytes} [Wed Nov 2 12:38:58 2022] GET /identity/v3/role_assignments?group.id=0b13c92dc684456fbcf49617d04ab31b&scope.project.id=9fd1e0280cf34f23ae68adb0de691bc8&role.id=7b4e238c731941f18493cd62e30b1e4f => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:59.222506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72549015-783c-46f0-af64-3072766c1bb4 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:59.259062 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481e7fb-b0db-4905-b96b-ac0d28c7b8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:59.259709 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481e7fb-b0db-4905-b96b-ac0d28c7b8c1 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:59.259998 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481e7fb-b0db-4905-b96b-ac0d28c7b8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:59.260303 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481e7fb-b0db-4905-b96b-ac0d28c7b8c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:59.261171 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481e7fb-b0db-4905-b96b-ac0d28c7b8c1 None admin] RBAC: Adding query filter params (group.id=f0d24683ecea4d168004f111c36b82ab, role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=b31a529f322f43dfa78c0719df9a66db) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:59.261552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481e7fb-b0db-4905-b96b-ac0d28c7b8c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:59.263105 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481e7fb-b0db-4905-b96b-ac0d28c7b8c1 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:59.269653 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 231/455] 10.222.0.90 () {56 vars in 1376 bytes} [Wed Nov 2 12:38:59 2022] GET /identity/v3/role_assignments?group.id=f0d24683ecea4d168004f111c36b82ab&scope.project.id=b31a529f322f43dfa78c0719df9a66db&role.id=85136c55809b4d9db97c263a72392ad1 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:02.438129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e87110-e1b2-4277-a82a-97530ec44cc7 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.439018 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e87110-e1b2-4277-a82a-97530ec44cc7 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.439431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e87110-e1b2-4277-a82a-97530ec44cc7 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.441721 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 225/456] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:02.442646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9239b9-1a7f-4aa5-bdc3-a0a99a6517bd None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.442646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9239b9-1a7f-4aa5-bdc3-a0a99a6517bd None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.442646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9239b9-1a7f-4aa5-bdc3-a0a99a6517bd None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.444447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 232/457] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:02.445399 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92895d24-c09d-492f-80c9-0987633ceb76 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.445929 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92895d24-c09d-492f-80c9-0987633ceb76 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.446406 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92895d24-c09d-492f-80c9-0987633ceb76 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.448157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c490c-43ec-49d1-ac17-139951c70741 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.448460 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c490c-43ec-49d1-ac17-139951c70741 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.448571 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 226/458] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:02.449000 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c490c-43ec-49d1-ac17-139951c70741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.453561 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a3a4-70fa-4592-b78f-326f67053c59 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.454070 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a3a4-70fa-4592-b78f-326f67053c59 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.454530 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a3a4-70fa-4592-b78f-326f67053c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.466946 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-e92c490c-43ec-49d1-ac17-139951c70741 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:02.468398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e92c490c-43ec-49d1-ac17-139951c70741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:02.478191 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-9bd4a3a4-70fa-4592-b78f-326f67053c59 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:02.479623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-9bd4a3a4-70fa-4592-b78f-326f67053c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:02.537761 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 233/459] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:02.539071 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09228fa-fcdc-4c0c-a616-702687f73649 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.539639 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09228fa-fcdc-4c0c-a616-702687f73649 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.540108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09228fa-fcdc-4c0c-a616-702687f73649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.553105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 227/460] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:39:02.565305 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-e09228fa-fcdc-4c0c-a616-702687f73649 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:02.566667 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e09228fa-fcdc-4c0c-a616-702687f73649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:02.570660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a3a4-70fa-4592-b78f-326f67053c59 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:02.651843 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 234/461] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:02.653354 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09228fa-fcdc-4c0c-a616-702687f73649 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:02.684479 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a3a4-70fa-4592-b78f-326f67053c59 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:02.723236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d168b52-1ae1-4bf9-8923-680fe2efa359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:02.724016 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d168b52-1ae1-4bf9-8923-680fe2efa359 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.724761 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d168b52-1ae1-4bf9-8923-680fe2efa359 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.725039 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d168b52-1ae1-4bf9-8923-680fe2efa359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.738429 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d168b52-1ae1-4bf9-8923-680fe2efa359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:02.741537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d168b52-1ae1-4bf9-8923-680fe2efa359 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:02.769288 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-5d168b52-1ae1-4bf9-8923-680fe2efa359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:02.773022 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 228/462] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:02.773022 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d168b52-1ae1-4bf9-8923-680fe2efa359 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:02.781765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09228fa-fcdc-4c0c-a616-702687f73649 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:02.816502 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c9e15-53d5-41f0-8828-0d46c0503eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:02.817612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c9e15-53d5-41f0-8828-0d46c0503eea None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.818046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c9e15-53d5-41f0-8828-0d46c0503eea None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.818464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c9e15-53d5-41f0-8828-0d46c0503eea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.829764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c9e15-53d5-41f0-8828-0d46c0503eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:02.831429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c9e15-53d5-41f0-8828-0d46c0503eea None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:02.853854 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-620c9e15-53d5-41f0-8828-0d46c0503eea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:02.855290 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 235/463] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:02.856300 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c9e15-53d5-41f0-8828-0d46c0503eea None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:02.886948 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d168b52-1ae1-4bf9-8923-680fe2efa359 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:02.922129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be5346-f89a-46ed-858c-c0b25c08a003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:02.923207 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be5346-f89a-46ed-858c-c0b25c08a003 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.923630 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be5346-f89a-46ed-858c-c0b25c08a003 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.924533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be5346-f89a-46ed-858c-c0b25c08a003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.937412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be5346-f89a-46ed-858c-c0b25c08a003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:02.939798 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be5346-f89a-46ed-858c-c0b25c08a003 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:02.962613 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c2be5346-f89a-46ed-858c-c0b25c08a003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:02.963976 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 229/464] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:02.964669 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be5346-f89a-46ed-858c-c0b25c08a003 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:02.975978 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c9e15-53d5-41f0-8828-0d46c0503eea None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.010189 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5350db6-d87d-4c23-9098-257fc4c8be92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.010850 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5350db6-d87d-4c23-9098-257fc4c8be92 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.011127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5350db6-d87d-4c23-9098-257fc4c8be92 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.011397 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5350db6-d87d-4c23-9098-257fc4c8be92 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.012159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5350db6-d87d-4c23-9098-257fc4c8be92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:03.012489 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5350db6-d87d-4c23-9098-257fc4c8be92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:03.013859 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5350db6-d87d-4c23-9098-257fc4c8be92 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:03.025444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 236/465] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:03.026714 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c2844-2e59-4039-bebd-4b971ec2019d None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.027000 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c2844-2e59-4039-bebd-4b971ec2019d None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.027268 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c2844-2e59-4039-bebd-4b971ec2019d None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.032664 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 237/466] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:03.032664 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c2844-2e59-4039-bebd-4b971ec2019d None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:03.065563 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be5346-f89a-46ed-858c-c0b25c08a003 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.097650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018e75b-fa0e-4604-9e18-b0b85fc6814a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.098323 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018e75b-fa0e-4604-9e18-b0b85fc6814a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.098605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018e75b-fa0e-4604-9e18-b0b85fc6814a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.098883 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018e75b-fa0e-4604-9e18-b0b85fc6814a None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.099603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018e75b-fa0e-4604-9e18-b0b85fc6814a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:03.099912 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018e75b-fa0e-4604-9e18-b0b85fc6814a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:03.101337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018e75b-fa0e-4604-9e18-b0b85fc6814a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:03.115883 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 230/467] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:03.115883 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018e75b-fa0e-4604-9e18-b0b85fc6814a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:03.136926 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c2844-2e59-4039-bebd-4b971ec2019d None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.169128 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b03a5-cf71-4323-b688-62b0f0cf34de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.169795 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b03a5-cf71-4323-b688-62b0f0cf34de None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.170075 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b03a5-cf71-4323-b688-62b0f0cf34de None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.170348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b03a5-cf71-4323-b688-62b0f0cf34de None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.171101 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b03a5-cf71-4323-b688-62b0f0cf34de None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:03.171406 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b03a5-cf71-4323-b688-62b0f0cf34de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:03.172831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b03a5-cf71-4323-b688-62b0f0cf34de None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:03.183947 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 238/468] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:03.185154 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7571e1-09f1-4a93-9f93-395e02059715 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.185440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7571e1-09f1-4a93-9f93-395e02059715 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.185724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7571e1-09f1-4a93-9f93-395e02059715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.201748 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-2d7571e1-09f1-4a93-9f93-395e02059715 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:03.202909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2d7571e1-09f1-4a93-9f93-395e02059715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:03.212333 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018e75b-fa0e-4604-9e18-b0b85fc6814a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.245325 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8d74c-5ab9-4007-bf22-f3b7f3aefa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.245928 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8d74c-5ab9-4007-bf22-f3b7f3aefa50 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.246318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8d74c-5ab9-4007-bf22-f3b7f3aefa50 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.246595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8d74c-5ab9-4007-bf22-f3b7f3aefa50 None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.247300 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8d74c-5ab9-4007-bf22-f3b7f3aefa50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:03.248781 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8d74c-5ab9-4007-bf22-f3b7f3aefa50 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:03.267734 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 239/469] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:03.267916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 231/470] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:39:03 2022] POST /identity/v3/users => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:03.268584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7571e1-09f1-4a93-9f93-395e02059715 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:03.269140 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210732c5-f02a-4a2e-bab4-59fe2ef1a557 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.269430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210732c5-f02a-4a2e-bab4-59fe2ef1a557 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.269707 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210732c5-f02a-4a2e-bab4-59fe2ef1a557 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.271418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 232/471] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:03.272129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210732c5-f02a-4a2e-bab4-59fe2ef1a557 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:03.386021 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210732c5-f02a-4a2e-bab4-59fe2ef1a557 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.396433 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7571e1-09f1-4a93-9f93-395e02059715 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.422582 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce202617-a9dd-4287-b570-826810ad847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.423356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce202617-a9dd-4287-b570-826810ad847a None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.423644 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce202617-a9dd-4287-b570-826810ad847a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.423916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce202617-a9dd-4287-b570-826810ad847a None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.424711 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce202617-a9dd-4287-b570-826810ad847a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:03.426193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce202617-a9dd-4287-b570-826810ad847a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:03.435769 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2598f-e73a-4172-a07a-9c27dcfe0cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.436660 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2598f-e73a-4172-a07a-9c27dcfe0cae None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.436913 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2598f-e73a-4172-a07a-9c27dcfe0cae None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.437284 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2598f-e73a-4172-a07a-9c27dcfe0cae None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.438035 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2598f-e73a-4172-a07a-9c27dcfe0cae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:03.439726 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2598f-e73a-4172-a07a-9c27dcfe0cae None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:03.452552 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 233/472] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:39:03 2022] POST /identity/v3/users => generated 248 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:03.454324 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606846c-7458-47fd-b33d-8c5f4c05ea6e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.454753 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606846c-7458-47fd-b33d-8c5f4c05ea6e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.455032 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606846c-7458-47fd-b33d-8c5f4c05ea6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.472296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 240/473] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:39:03 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:03.472296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2598f-e73a-4172-a07a-9c27dcfe0cae None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:03.481886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-b606846c-7458-47fd-b33d-8c5f4c05ea6e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:03.483277 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-b606846c-7458-47fd-b33d-8c5f4c05ea6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:03.572232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 234/474] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:03.596506 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606846c-7458-47fd-b33d-8c5f4c05ea6e None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:03.610937 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2598f-e73a-4172-a07a-9c27dcfe0cae None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.661046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1f1b0-6ebe-4250-983f-4de6d103a605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.662534 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1f1b0-6ebe-4250-983f-4de6d103a605 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.663162 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1f1b0-6ebe-4250-983f-4de6d103a605 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.663653 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1f1b0-6ebe-4250-983f-4de6d103a605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.678269 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1f1b0-6ebe-4250-983f-4de6d103a605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:03.679780 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1f1b0-6ebe-4250-983f-4de6d103a605 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:03.702537 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-8ab1f1b0-6ebe-4250-983f-4de6d103a605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:03.704063 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 241/475] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:03.709931 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1f1b0-6ebe-4250-983f-4de6d103a605 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:03.718627 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606846c-7458-47fd-b33d-8c5f4c05ea6e None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.761950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2ac35-d962-48ad-88e6-1d267e411a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.762961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2ac35-d962-48ad-88e6-1d267e411a9e None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.763244 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2ac35-d962-48ad-88e6-1d267e411a9e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.763570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2ac35-d962-48ad-88e6-1d267e411a9e None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.764371 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2ac35-d962-48ad-88e6-1d267e411a9e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:03.766305 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2ac35-d962-48ad-88e6-1d267e411a9e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:03.774424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.sql.core [None req-c1a2ac35-d962-48ad-88e6-1d267e411a9e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 12:39:03.774424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 12:39:03.774424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [parameters: {'id': '97beb5061b5949dd8cb7a4c313fd5135', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 12:39:03.774424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86736) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 12:39:03.792865 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c1a2ac35-d962-48ad-88e6-1d267e411a9e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 12:39:03.796851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 235/476] 10.222.0.90 () {60 vars in 1131 bytes} [Wed Nov 2 12:39:03 2022] POST /identity/v3/roles => generated 144 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:03.804302 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2ac35-d962-48ad-88e6-1d267e411a9e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:03.827084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1f1b0-6ebe-4250-983f-4de6d103a605 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.872935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba80b82-1a62-4dba-88e8-4d6957628ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.873612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba80b82-1a62-4dba-88e8-4d6957628ace None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.874054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba80b82-1a62-4dba-88e8-4d6957628ace None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.874430 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba80b82-1a62-4dba-88e8-4d6957628ace None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.875168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba80b82-1a62-4dba-88e8-4d6957628ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:03.875522 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba80b82-1a62-4dba-88e8-4d6957628ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:03.877318 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba80b82-1a62-4dba-88e8-4d6957628ace None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:03.892617 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 242/477] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:03.904080 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba80b82-1a62-4dba-88e8-4d6957628ace None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:03.939856 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2ac35-d962-48ad-88e6-1d267e411a9e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.974395 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434f97c-9004-4ee0-ae6d-6c7f18026f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.975318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434f97c-9004-4ee0-ae6d-6c7f18026f71 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.975596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434f97c-9004-4ee0-ae6d-6c7f18026f71 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.975863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434f97c-9004-4ee0-ae6d-6c7f18026f71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.986793 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434f97c-9004-4ee0-ae6d-6c7f18026f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:03.994380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-1434f97c-9004-4ee0-ae6d-6c7f18026f71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:39:03.996089 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 236/478] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:39:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:04.001673 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434f97c-9004-4ee0-ae6d-6c7f18026f71 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:04.069260 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba80b82-1a62-4dba-88e8-4d6957628ace None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:04.099882 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434f97c-9004-4ee0-ae6d-6c7f18026f71 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:04.132922 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a6e90-57f7-4df1-b064-a49db597c0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:04.133429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584829fe-0817-4b2e-9675-a859a5c0b6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:04.133633 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a6e90-57f7-4df1-b064-a49db597c0d8 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:04.133913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a6e90-57f7-4df1-b064-a49db597c0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:04.134110 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584829fe-0817-4b2e-9675-a859a5c0b6ab None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:04.134279 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a6e90-57f7-4df1-b064-a49db597c0d8 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:04.134421 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584829fe-0817-4b2e-9675-a859a5c0b6ab None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:04.134656 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584829fe-0817-4b2e-9675-a859a5c0b6ab None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:04.134953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a6e90-57f7-4df1-b064-a49db597c0d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:04.135259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a6e90-57f7-4df1-b064-a49db597c0d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:04.135420 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584829fe-0817-4b2e-9675-a859a5c0b6ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:04.136693 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a6e90-57f7-4df1-b064-a49db597c0d8 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:04.136899 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584829fe-0817-4b2e-9675-a859a5c0b6ab None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:04.145221 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 237/479] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:04.171841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 243/480] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:39:03 2022] POST /identity/v3/users => generated 249 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:06.090180 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eedf9-415d-4339-bbe1-8c318db9737d None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:06.090867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eedf9-415d-4339-bbe1-8c318db9737d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:06.090867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eedf9-415d-4339-bbe1-8c318db9737d None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:06.092828 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 238/481] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:06.098054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a064bf-60a9-4f78-84f3-581d423dd1a3 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:06.098610 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a064bf-60a9-4f78-84f3-581d423dd1a3 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:06.098610 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a064bf-60a9-4f78-84f3-581d423dd1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:06.122224 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-56a064bf-60a9-4f78-84f3-581d423dd1a3 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:06.123403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-56a064bf-60a9-4f78-84f3-581d423dd1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:06.206829 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 244/482] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:06.239878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eedf9-415d-4339-bbe1-8c318db9737d None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:06.357601 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eedf9-415d-4339-bbe1-8c318db9737d None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:06.375638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017419a-04ce-403c-8b04-bf3be669c66e None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:06.375941 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017419a-04ce-403c-8b04-bf3be669c66e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:06.376182 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017419a-04ce-403c-8b04-bf3be669c66e None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:06.378156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 245/483] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:39:06.383001 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7f2f4-efb6-4d54-8237-10524a7b8276 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:06.383290 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7f2f4-efb6-4d54-8237-10524a7b8276 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:06.383570 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7f2f4-efb6-4d54-8237-10524a7b8276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:06.396299 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3aea61-9a72-4351-aa80-c52b5a351a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:06.397175 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3aea61-9a72-4351-aa80-c52b5a351a9c None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:06.397452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3aea61-9a72-4351-aa80-c52b5a351a9c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:06.397757 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3aea61-9a72-4351-aa80-c52b5a351a9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:06.411604 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3aea61-9a72-4351-aa80-c52b5a351a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:06.419246 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-1e3aea61-9a72-4351-aa80-c52b5a351a9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:06.420861 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 239/484] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:06.421410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-60c7f2f4-efb6-4d54-8237-10524a7b8276 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:06.422916 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-60c7f2f4-efb6-4d54-8237-10524a7b8276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:06.426907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3aea61-9a72-4351-aa80-c52b5a351a9c None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:06.543970 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 246/485] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:06.567642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7f2f4-efb6-4d54-8237-10524a7b8276 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:06.596314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3aea61-9a72-4351-aa80-c52b5a351a9c None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:06.629920 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5adfe1-4573-47a2-99c3-e5633f9383c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:06.630519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5adfe1-4573-47a2-99c3-e5633f9383c6 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:06.630806 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5adfe1-4573-47a2-99c3-e5633f9383c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:06.631082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5adfe1-4573-47a2-99c3-e5633f9383c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:06.631835 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5adfe1-4573-47a2-99c3-e5633f9383c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:06.632145 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5adfe1-4573-47a2-99c3-e5633f9383c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:06.633535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5adfe1-4573-47a2-99c3-e5633f9383c6 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:06.642254 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 240/486] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:06.649171 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5adfe1-4573-47a2-99c3-e5633f9383c6 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:06.697421 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7f2f4-efb6-4d54-8237-10524a7b8276 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:06.733226 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf7374-cf52-47d8-9997-0f48ca60a7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:06.734083 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf7374-cf52-47d8-9997-0f48ca60a7ff None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:06.734420 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf7374-cf52-47d8-9997-0f48ca60a7ff None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:06.734692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf7374-cf52-47d8-9997-0f48ca60a7ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:06.745029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf7374-cf52-47d8-9997-0f48ca60a7ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:06.752148 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-dcaf7374-cf52-47d8-9997-0f48ca60a7ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:06.753731 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 247/487] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:06.758961 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf7374-cf52-47d8-9997-0f48ca60a7ff None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:06.834355 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5adfe1-4573-47a2-99c3-e5633f9383c6 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:06.868973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4d95c-93a9-4092-b4bb-0ddefdcfc780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:06.869788 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4d95c-93a9-4092-b4bb-0ddefdcfc780 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:06.870066 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4d95c-93a9-4092-b4bb-0ddefdcfc780 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:06.870339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4d95c-93a9-4092-b4bb-0ddefdcfc780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:06.875106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf7374-cf52-47d8-9997-0f48ca60a7ff None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:06.883385 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4d95c-93a9-4092-b4bb-0ddefdcfc780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:06.885391 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4d95c-93a9-4092-b4bb-0ddefdcfc780 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:06.909927 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-4cc4d95c-93a9-4092-b4bb-0ddefdcfc780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:06.911173 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 241/488] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:06.913291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d37b6-e889-44d7-ba43-9bd0ab862e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:06.914021 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d37b6-e889-44d7-ba43-9bd0ab862e9b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:06.914299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d37b6-e889-44d7-ba43-9bd0ab862e9b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:06.914565 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d37b6-e889-44d7-ba43-9bd0ab862e9b None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:06.915312 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d37b6-e889-44d7-ba43-9bd0ab862e9b None admin] RBAC: Adding query filter params (name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:06.915979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d37b6-e889-44d7-ba43-9bd0ab862e9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:06.916930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f8c04-5727-4be8-b416-e21d2726bc94 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:06.917259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f8c04-5727-4be8-b416-e21d2726bc94 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:06.917373 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d37b6-e889-44d7-ba43-9bd0ab862e9b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:06.917613 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f8c04-5727-4be8-b416-e21d2726bc94 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:06.920375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 242/489] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:06.921107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f8c04-5727-4be8-b416-e21d2726bc94 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:06.935122 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 248/490] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:06.941843 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ef5cc-0c49-4173-bc0c-0511525682a5 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:06.942133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ef5cc-0c49-4173-bc0c-0511525682a5 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:06.942416 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ef5cc-0c49-4173-bc0c-0511525682a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:06.965709 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-0f5ef5cc-0c49-4173-bc0c-0511525682a5 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:06.966931 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0f5ef5cc-0c49-4173-bc0c-0511525682a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:07.036300 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f8c04-5727-4be8-b416-e21d2726bc94 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:07.052232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 249/491] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:07.052232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ef5cc-0c49-4173-bc0c-0511525682a5 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:07.080883 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208586c2-5151-4375-81b8-504c6b5015f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:07.081556 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208586c2-5151-4375-81b8-504c6b5015f6 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.081841 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208586c2-5151-4375-81b8-504c6b5015f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.082111 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208586c2-5151-4375-81b8-504c6b5015f6 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.082834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208586c2-5151-4375-81b8-504c6b5015f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:07.083142 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208586c2-5151-4375-81b8-504c6b5015f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:07.084540 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208586c2-5151-4375-81b8-504c6b5015f6 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:07.097306 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 243/492] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:07.098515 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db6dfb-124d-4f4b-b644-cca463bc8a4a None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.098836 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db6dfb-124d-4f4b-b644-cca463bc8a4a None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.099068 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db6dfb-124d-4f4b-b644-cca463bc8a4a None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.100950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 244/493] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:07.105227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db6dfb-124d-4f4b-b644-cca463bc8a4a None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:07.147063 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ef5cc-0c49-4173-bc0c-0511525682a5 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:07.180530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa110-1c00-4636-b801-a59166996f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:07.181411 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa110-1c00-4636-b801-a59166996f5e None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.181777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa110-1c00-4636-b801-a59166996f5e None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.182112 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa110-1c00-4636-b801-a59166996f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.192663 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fa110-1c00-4636-b801-a59166996f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:07.194111 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fa110-1c00-4636-b801-a59166996f5e None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:07.207043 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db6dfb-124d-4f4b-b644-cca463bc8a4a None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:07.210716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-e74fa110-1c00-4636-b801-a59166996f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:07.216528 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 250/494] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:07.216528 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa110-1c00-4636-b801-a59166996f5e None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:07.240904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dad75-6d5d-4ba0-acf5-b18a7f81a7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:07.241700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dad75-6d5d-4ba0-acf5-b18a7f81a7f9 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.241973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dad75-6d5d-4ba0-acf5-b18a7f81a7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.242252 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dad75-6d5d-4ba0-acf5-b18a7f81a7f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.252534 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dad75-6d5d-4ba0-acf5-b18a7f81a7f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:07.259425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-bb5dad75-6d5d-4ba0-acf5-b18a7f81a7f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:07.265475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 245/495] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:07.265475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1e724-56a6-484e-9fb3-12309cd70bb8 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.265475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1e724-56a6-484e-9fb3-12309cd70bb8 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.265475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1e724-56a6-484e-9fb3-12309cd70bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.281740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-c8a1e724-56a6-484e-9fb3-12309cd70bb8 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:07.283114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c8a1e724-56a6-484e-9fb3-12309cd70bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:07.321824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa110-1c00-4636-b801-a59166996f5e None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:07.348747 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 246/496] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:07.349614 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1e724-56a6-484e-9fb3-12309cd70bb8 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:07.363463 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182561a6-96e0-4125-9e9f-eb5de0f0c8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:07.365105 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182561a6-96e0-4125-9e9f-eb5de0f0c8ee None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.365841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182561a6-96e0-4125-9e9f-eb5de0f0c8ee None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.366307 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182561a6-96e0-4125-9e9f-eb5de0f0c8ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.375881 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182561a6-96e0-4125-9e9f-eb5de0f0c8ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:07.377373 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182561a6-96e0-4125-9e9f-eb5de0f0c8ee None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:07.391151 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-182561a6-96e0-4125-9e9f-eb5de0f0c8ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:39:07.397256 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 251/497] 10.222.0.90 () {56 vars in 1093 bytes} [Wed Nov 2 12:39:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:07.397256 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182561a6-96e0-4125-9e9f-eb5de0f0c8ee None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:07.452642 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1e724-56a6-484e-9fb3-12309cd70bb8 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:07.487413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2480c7-1acc-4ffb-8333-c5de17e85ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:07.488064 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2480c7-1acc-4ffb-8333-c5de17e85ead None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.488373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2480c7-1acc-4ffb-8333-c5de17e85ead None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.488646 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2480c7-1acc-4ffb-8333-c5de17e85ead None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.489357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2480c7-1acc-4ffb-8333-c5de17e85ead None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:07.489664 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2480c7-1acc-4ffb-8333-c5de17e85ead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:07.489750 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182561a6-96e0-4125-9e9f-eb5de0f0c8ee None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:07.491046 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2480c7-1acc-4ffb-8333-c5de17e85ead None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:07.503396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 247/498] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:07.503396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2480c7-1acc-4ffb-8333-c5de17e85ead None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:07.528112 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997b9b7-172e-45da-9a06-76247ca513dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:07.529118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997b9b7-172e-45da-9a06-76247ca513dd None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.529402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997b9b7-172e-45da-9a06-76247ca513dd None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.529666 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997b9b7-172e-45da-9a06-76247ca513dd None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.530426 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997b9b7-172e-45da-9a06-76247ca513dd None admin] RBAC: Adding query filter params (name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:07.530735 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997b9b7-172e-45da-9a06-76247ca513dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:07.532110 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997b9b7-172e-45da-9a06-76247ca513dd None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:07.539857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 252/499] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:07.540652 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997b9b7-172e-45da-9a06-76247ca513dd None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:07.599947 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2480c7-1acc-4ffb-8333-c5de17e85ead None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:07.632184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b167f-8c72-47f3-91a5-9d1c50afb20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:07.633012 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b167f-8c72-47f3-91a5-9d1c50afb20d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.633287 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b167f-8c72-47f3-91a5-9d1c50afb20d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.633556 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b167f-8c72-47f3-91a5-9d1c50afb20d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.638056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997b9b7-172e-45da-9a06-76247ca513dd None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:07.643986 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b167f-8c72-47f3-91a5-9d1c50afb20d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:07.645472 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b167f-8c72-47f3-91a5-9d1c50afb20d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:07.661911 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-4f3b167f-8c72-47f3-91a5-9d1c50afb20d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:07.663029 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 248/500] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:07.664232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a94b06-243d-4814-9b1c-48ef0b0397dd None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.664503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a94b06-243d-4814-9b1c-48ef0b0397dd None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.664771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a94b06-243d-4814-9b1c-48ef0b0397dd None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.668315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 249/501] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:07.668315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a94b06-243d-4814-9b1c-48ef0b0397dd None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:07.673206 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb98a7f-fb36-4852-9005-5d7482c73988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:07.673883 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb98a7f-fb36-4852-9005-5d7482c73988 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.674163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb98a7f-fb36-4852-9005-5d7482c73988 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.674434 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb98a7f-fb36-4852-9005-5d7482c73988 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.675277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb98a7f-fb36-4852-9005-5d7482c73988 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:07.675588 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb98a7f-fb36-4852-9005-5d7482c73988 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:07.677074 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb98a7f-fb36-4852-9005-5d7482c73988 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:07.713846 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 253/502] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Nov 2 12:39:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:07.714690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb98a7f-fb36-4852-9005-5d7482c73988 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:07.767349 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a94b06-243d-4814-9b1c-48ef0b0397dd None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:07.799930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ab273-5fec-4fb7-9bfa-5c9bd4af4b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:07.800742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab273-5fec-4fb7-9bfa-5c9bd4af4b4c None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.801017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab273-5fec-4fb7-9bfa-5c9bd4af4b4c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.801284 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab273-5fec-4fb7-9bfa-5c9bd4af4b4c None admin] PATH_INFO: `/v3/users/glance` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.808695 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ab273-5fec-4fb7-9bfa-5c9bd4af4b4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:07.810179 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ab273-5fec-4fb7-9bfa-5c9bd4af4b4c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:07.813010 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb98a7f-fb36-4852-9005-5d7482c73988 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:07.823083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c47ab273-5fec-4fb7-9bfa-5c9bd4af4b4c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 12:39:07.824576 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 250/503] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:39:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:07.825186 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ab273-5fec-4fb7-9bfa-5c9bd4af4b4c None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:07.848448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb1443-e7dd-41de-bee8-ae509a4ccf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:07.849246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb1443-e7dd-41de-bee8-ae509a4ccf75 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.849569 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb1443-e7dd-41de-bee8-ae509a4ccf75 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.849821 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb1443-e7dd-41de-bee8-ae509a4ccf75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.859534 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb1443-e7dd-41de-bee8-ae509a4ccf75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:07.860993 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb1443-e7dd-41de-bee8-ae509a4ccf75 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:07.877253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-34fb1443-e7dd-41de-bee8-ae509a4ccf75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:07.878392 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 254/504] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:07.879591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a24b6-5221-4892-ae63-ecbe7bb27b1b None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.879875 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a24b6-5221-4892-ae63-ecbe7bb27b1b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.880118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a24b6-5221-4892-ae63-ecbe7bb27b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.895935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-736a24b6-5221-4892-ae63-ecbe7bb27b1b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:07.897168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-736a24b6-5221-4892-ae63-ecbe7bb27b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:07.920374 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ab273-5fec-4fb7-9bfa-5c9bd4af4b4c None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:07.954343 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76291c99-fb0d-468f-9bec-e6dabce72f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:07.955003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76291c99-fb0d-468f-9bec-e6dabce72f34 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.955278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76291c99-fb0d-468f-9bec-e6dabce72f34 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.955546 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76291c99-fb0d-468f-9bec-e6dabce72f34 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.956288 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76291c99-fb0d-468f-9bec-e6dabce72f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:07.956583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76291c99-fb0d-468f-9bec-e6dabce72f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:07.957966 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76291c99-fb0d-468f-9bec-e6dabce72f34 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:07.959891 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 255/505] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:07.960835 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a24b6-5221-4892-ae63-ecbe7bb27b1b None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:07.970448 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 251/506] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:07.971151 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76291c99-fb0d-468f-9bec-e6dabce72f34 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:08.070002 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a24b6-5221-4892-ae63-ecbe7bb27b1b None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:08.071329 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76291c99-fb0d-468f-9bec-e6dabce72f34 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:08.103345 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b411a-9094-4c8f-b6d8-2390f419a500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:08.103982 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b411a-9094-4c8f-b6d8-2390f419a500 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:08.104291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b411a-9094-4c8f-b6d8-2390f419a500 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:08.104558 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b411a-9094-4c8f-b6d8-2390f419a500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:08.106723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084c0d4-941f-4a2f-906f-dee45b31e79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:08.107391 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084c0d4-941f-4a2f-906f-dee45b31e79e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:08.107671 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084c0d4-941f-4a2f-906f-dee45b31e79e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:08.107941 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084c0d4-941f-4a2f-906f-dee45b31e79e None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:08.108833 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084c0d4-941f-4a2f-906f-dee45b31e79e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:08.109141 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084c0d4-941f-4a2f-906f-dee45b31e79e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:08.110607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084c0d4-941f-4a2f-906f-dee45b31e79e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:08.146078 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 252/507] 10.222.0.90 () {56 vars in 1137 bytes} [Wed Nov 2 12:39:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:08.146905 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084c0d4-941f-4a2f-906f-dee45b31e79e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:08.170015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b411a-9094-4c8f-b6d8-2390f419a500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:08.171545 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b411a-9094-4c8f-b6d8-2390f419a500 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:08.245190 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084c0d4-941f-4a2f-906f-dee45b31e79e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:08.272741 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 256/508] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:08.273385 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b411a-9094-4c8f-b6d8-2390f419a500 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:08.279410 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff741e4f-cc13-4ffe-bbb6-3273030b4978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:08.280071 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff741e4f-cc13-4ffe-bbb6-3273030b4978 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:08.280383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff741e4f-cc13-4ffe-bbb6-3273030b4978 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:08.280650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff741e4f-cc13-4ffe-bbb6-3273030b4978 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:08.281369 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff741e4f-cc13-4ffe-bbb6-3273030b4978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:08.281683 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff741e4f-cc13-4ffe-bbb6-3273030b4978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:08.283062 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff741e4f-cc13-4ffe-bbb6-3273030b4978 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:08.294418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 253/509] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:08.295196 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff741e4f-cc13-4ffe-bbb6-3273030b4978 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:08.370772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b411a-9094-4c8f-b6d8-2390f419a500 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:08.393102 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff741e4f-cc13-4ffe-bbb6-3273030b4978 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:08.404453 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21d0da-54d2-4f20-80e1-437d334ff811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:08.405118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21d0da-54d2-4f20-80e1-437d334ff811 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:08.405399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21d0da-54d2-4f20-80e1-437d334ff811 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:08.405717 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21d0da-54d2-4f20-80e1-437d334ff811 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:08.406370 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21d0da-54d2-4f20-80e1-437d334ff811 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:08.407813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21d0da-54d2-4f20-80e1-437d334ff811 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:08.427083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5c954-a8d5-42f2-9a73-1164bb19a1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:08.427433 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 257/510] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:39:08 2022] POST /identity/v3/users => generated 247 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:08.427807 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5c954-a8d5-42f2-9a73-1164bb19a1c7 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:08.428085 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5c954-a8d5-42f2-9a73-1164bb19a1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:08.428262 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21d0da-54d2-4f20-80e1-437d334ff811 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:08.428382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5c954-a8d5-42f2-9a73-1164bb19a1c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:08.439645 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5c954-a8d5-42f2-9a73-1164bb19a1c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:08.447038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-cec5c954-a8d5-42f2-9a73-1164bb19a1c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:08.453366 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 254/511] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:08.453366 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5c954-a8d5-42f2-9a73-1164bb19a1c7 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:08.553976 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21d0da-54d2-4f20-80e1-437d334ff811 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:08.557212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5c954-a8d5-42f2-9a73-1164bb19a1c7 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:08.594722 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579b43e-eae8-4c1b-807b-cdf8b5fec6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:08.595404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579b43e-eae8-4c1b-807b-cdf8b5fec6e5 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:08.595684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579b43e-eae8-4c1b-807b-cdf8b5fec6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:08.595949 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579b43e-eae8-4c1b-807b-cdf8b5fec6e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:08.597303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea5f48-4b49-478d-9cfb-3706f005c19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:08.598115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea5f48-4b49-478d-9cfb-3706f005c19d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:08.598391 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea5f48-4b49-478d-9cfb-3706f005c19d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:08.598662 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea5f48-4b49-478d-9cfb-3706f005c19d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:08.612081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea5f48-4b49-478d-9cfb-3706f005c19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:08.612081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea5f48-4b49-478d-9cfb-3706f005c19d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:08.629061 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-47ea5f48-4b49-478d-9cfb-3706f005c19d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:08.630457 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 255/512] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:08.631072 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea5f48-4b49-478d-9cfb-3706f005c19d None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:08.676682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579b43e-eae8-4c1b-807b-cdf8b5fec6e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:08.678225 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579b43e-eae8-4c1b-807b-cdf8b5fec6e5 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:08.733609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea5f48-4b49-478d-9cfb-3706f005c19d None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:08.767052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6d51c-88ed-4c4e-ad1e-c10dcd9797ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:08.767963 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d51c-88ed-4c4e-ad1e-c10dcd9797ac None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:08.768226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d51c-88ed-4c4e-ad1e-c10dcd9797ac None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:08.768505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d51c-88ed-4c4e-ad1e-c10dcd9797ac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:08.779130 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 258/513] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:08.779130 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579b43e-eae8-4c1b-807b-cdf8b5fec6e5 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:08.780918 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6d51c-88ed-4c4e-ad1e-c10dcd9797ac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:08.782580 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6d51c-88ed-4c4e-ad1e-c10dcd9797ac None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:08.798238 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-2ca6d51c-88ed-4c4e-ad1e-c10dcd9797ac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 12:39:08.799657 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 256/514] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:39:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:08.803962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6d51c-88ed-4c4e-ad1e-c10dcd9797ac None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:08.878159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579b43e-eae8-4c1b-807b-cdf8b5fec6e5 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:08.900893 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6d51c-88ed-4c4e-ad1e-c10dcd9797ac None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:08.910765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5867375-5988-4ee0-8da8-0505f0f2c942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:08.911428 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5867375-5988-4ee0-8da8-0505f0f2c942 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:08.911701 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5867375-5988-4ee0-8da8-0505f0f2c942 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:08.911963 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5867375-5988-4ee0-8da8-0505f0f2c942 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:08.912727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5867375-5988-4ee0-8da8-0505f0f2c942 None admin] RBAC: Adding query filter params (name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:08.913027 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5867375-5988-4ee0-8da8-0505f0f2c942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:08.914395 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5867375-5988-4ee0-8da8-0505f0f2c942 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:08.926889 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 259/515] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:08.927738 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5867375-5988-4ee0-8da8-0505f0f2c942 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:08.934266 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f438bb-2df7-4eb9-9274-52be4fbe788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:08.935114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f438bb-2df7-4eb9-9274-52be4fbe788a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:08.935569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f438bb-2df7-4eb9-9274-52be4fbe788a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:08.935979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f438bb-2df7-4eb9-9274-52be4fbe788a None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:08.937283 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f438bb-2df7-4eb9-9274-52be4fbe788a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:08.937733 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f438bb-2df7-4eb9-9274-52be4fbe788a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:08.939610 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f438bb-2df7-4eb9-9274-52be4fbe788a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:08.951599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 257/516] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:08.953326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f438bb-2df7-4eb9-9274-52be4fbe788a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:09.029241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5867375-5988-4ee0-8da8-0505f0f2c942 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:09.048161 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f438bb-2df7-4eb9-9274-52be4fbe788a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:09.062287 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59a54e-a0f4-436c-bbd1-605074d23812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:09.063053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59a54e-a0f4-436c-bbd1-605074d23812 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:09.063332 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59a54e-a0f4-436c-bbd1-605074d23812 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:09.063603 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59a54e-a0f4-436c-bbd1-605074d23812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:09.074106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59a54e-a0f4-436c-bbd1-605074d23812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:09.075578 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59a54e-a0f4-436c-bbd1-605074d23812 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:09.080811 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f362d-faf2-498c-ab84-f128425fffda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:09.081471 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f362d-faf2-498c-ab84-f128425fffda None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:09.081747 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f362d-faf2-498c-ab84-f128425fffda None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:09.082019 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f362d-faf2-498c-ab84-f128425fffda None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:09.082862 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f362d-faf2-498c-ab84-f128425fffda None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:09.083167 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f362d-faf2-498c-ab84-f128425fffda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:09.084613 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f362d-faf2-498c-ab84-f128425fffda None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:09.091980 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-3d59a54e-a0f4-436c-bbd1-605074d23812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:09.093398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 260/517] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:09.094105 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59a54e-a0f4-436c-bbd1-605074d23812 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:09.107205 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 258/518] 10.222.0.90 () {56 vars in 1137 bytes} [Wed Nov 2 12:39:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:09.107205 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f362d-faf2-498c-ab84-f128425fffda None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:09.196193 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59a54e-a0f4-436c-bbd1-605074d23812 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:09.205311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f362d-faf2-498c-ab84-f128425fffda None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:09.228845 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1378739-93f4-4dbf-ab4f-4c0ce206378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:09.229641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1378739-93f4-4dbf-ab4f-4c0ce206378f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:09.229917 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1378739-93f4-4dbf-ab4f-4c0ce206378f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:09.230183 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1378739-93f4-4dbf-ab4f-4c0ce206378f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:09.239422 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b57ff-0a81-4dfb-a9f0-251b49deb65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:09.240239 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b57ff-0a81-4dfb-a9f0-251b49deb65a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:09.240526 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b57ff-0a81-4dfb-a9f0-251b49deb65a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:09.240801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b57ff-0a81-4dfb-a9f0-251b49deb65a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:09.241084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1378739-93f4-4dbf-ab4f-4c0ce206378f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:09.242625 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1378739-93f4-4dbf-ab4f-4c0ce206378f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:09.247590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b57ff-0a81-4dfb-a9f0-251b49deb65a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:09.249066 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b57ff-0a81-4dfb-a9f0-251b49deb65a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:09.258804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-e1378739-93f4-4dbf-ab4f-4c0ce206378f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:09.260013 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 261/519] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:09.260809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1378739-93f4-4dbf-ab4f-4c0ce206378f None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:09.263041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-945b57ff-0a81-4dfb-a9f0-251b49deb65a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:09.265377 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 259/520] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:09.265377 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b57ff-0a81-4dfb-a9f0-251b49deb65a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:09.361080 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b57ff-0a81-4dfb-a9f0-251b49deb65a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:09.363170 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1378739-93f4-4dbf-ab4f-4c0ce206378f None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:09.395053 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a098b-2a8d-4dce-a17c-89d0b3d952c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:09.395246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b1466-05c1-41be-961a-a9752f073e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:09.395703 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a098b-2a8d-4dce-a17c-89d0b3d952c0 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:09.395802 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b1466-05c1-41be-961a-a9752f073e4f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:09.395974 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a098b-2a8d-4dce-a17c-89d0b3d952c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:09.396079 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b1466-05c1-41be-961a-a9752f073e4f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:09.396280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a098b-2a8d-4dce-a17c-89d0b3d952c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:09.396384 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b1466-05c1-41be-961a-a9752f073e4f None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:09.396994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b1466-05c1-41be-961a-a9752f073e4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:09.397300 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b1466-05c1-41be-961a-a9752f073e4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:09.398671 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b1466-05c1-41be-961a-a9752f073e4f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:09.415111 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 262/521] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:09.415111 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b1466-05c1-41be-961a-a9752f073e4f None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:09.467510 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a098b-2a8d-4dce-a17c-89d0b3d952c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:09.469157 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a098b-2a8d-4dce-a17c-89d0b3d952c0 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:09.516311 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b1466-05c1-41be-961a-a9752f073e4f None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:09.551861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d08dc7-e650-4827-bb52-c7b5151f1559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:09.552556 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d08dc7-e650-4827-bb52-c7b5151f1559 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:09.552834 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d08dc7-e650-4827-bb52-c7b5151f1559 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:09.553132 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d08dc7-e650-4827-bb52-c7b5151f1559 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:09.553875 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d08dc7-e650-4827-bb52-c7b5151f1559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:09.554180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d08dc7-e650-4827-bb52-c7b5151f1559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:09.555598 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d08dc7-e650-4827-bb52-c7b5151f1559 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:09.568253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 263/522] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:09.568253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d08dc7-e650-4827-bb52-c7b5151f1559 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:09.580508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 260/523] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:09.582154 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a098b-2a8d-4dce-a17c-89d0b3d952c0 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:09.666582 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d08dc7-e650-4827-bb52-c7b5151f1559 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:09.680044 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a098b-2a8d-4dce-a17c-89d0b3d952c0 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:09.701396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9467b6-7651-412a-b04d-883f98dcf51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:09.702041 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9467b6-7651-412a-b04d-883f98dcf51a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:09.702325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9467b6-7651-412a-b04d-883f98dcf51a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:09.702605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9467b6-7651-412a-b04d-883f98dcf51a None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:09.703393 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9467b6-7651-412a-b04d-883f98dcf51a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:09.703701 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9467b6-7651-412a-b04d-883f98dcf51a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:09.705192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9467b6-7651-412a-b04d-883f98dcf51a None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:09.716058 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb4d0b-7766-4e64-880a-1e08f852083d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:09.716824 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb4d0b-7766-4e64-880a-1e08f852083d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:09.717101 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb4d0b-7766-4e64-880a-1e08f852083d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:09.717374 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb4d0b-7766-4e64-880a-1e08f852083d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:09.722816 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 264/524] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:09.723901 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9467b6-7651-412a-b04d-883f98dcf51a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:09.733012 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb4d0b-7766-4e64-880a-1e08f852083d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:09.734494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb4d0b-7766-4e64-880a-1e08f852083d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:09.747586 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-cbeb4d0b-7766-4e64-880a-1e08f852083d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:09.748797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 261/525] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:09.749560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb4d0b-7766-4e64-880a-1e08f852083d None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:09.825867 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9467b6-7651-412a-b04d-883f98dcf51a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:09.847992 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb4d0b-7766-4e64-880a-1e08f852083d None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:09.859603 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3962600-e681-4a56-955d-46e02c148911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:09.860425 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3962600-e681-4a56-955d-46e02c148911 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:09.860700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3962600-e681-4a56-955d-46e02c148911 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:09.860965 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3962600-e681-4a56-955d-46e02c148911 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:09.868090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3962600-e681-4a56-955d-46e02c148911 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:09.869724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3962600-e681-4a56-955d-46e02c148911 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:09.880340 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752eb440-984f-4248-8622-b101e4f0da19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:09.881131 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752eb440-984f-4248-8622-b101e4f0da19 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:09.881411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752eb440-984f-4248-8622-b101e4f0da19 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:09.881677 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752eb440-984f-4248-8622-b101e4f0da19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:09.883211 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-e3962600-e681-4a56-955d-46e02c148911 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 12:39:09.884656 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 265/526] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:09.885296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3962600-e681-4a56-955d-46e02c148911 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:09.895899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752eb440-984f-4248-8622-b101e4f0da19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:09.897399 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752eb440-984f-4248-8622-b101e4f0da19 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:09.914598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-752eb440-984f-4248-8622-b101e4f0da19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:09.920525 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 262/527] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:09.920525 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752eb440-984f-4248-8622-b101e4f0da19 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:10.004508 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3962600-e681-4a56-955d-46e02c148911 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:10.011479 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752eb440-984f-4248-8622-b101e4f0da19 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:10.042443 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0d266-b843-4a14-a3df-4b7bb7397bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:10.043237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d266-b843-4a14-a3df-4b7bb7397bf3 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.043559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d266-b843-4a14-a3df-4b7bb7397bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.043787 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d266-b843-4a14-a3df-4b7bb7397bf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.044648 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0d266-b843-4a14-a3df-4b7bb7397bf3 None admin] RBAC: Adding query filter params (role.id=63df47d6fc0740e6bc54a845c3f8a257, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=fbcda58f298444eebf4f08ce01deffc0) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:10.045013 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0d266-b843-4a14-a3df-4b7bb7397bf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:10.046407 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0d266-b843-4a14-a3df-4b7bb7397bf3 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:10.046837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bce54-4a9d-4355-8fed-5685cf768f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:10.047501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bce54-4a9d-4355-8fed-5685cf768f4a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.047780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bce54-4a9d-4355-8fed-5685cf768f4a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.048061 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bce54-4a9d-4355-8fed-5685cf768f4a None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.048876 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bce54-4a9d-4355-8fed-5685cf768f4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:10.049185 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bce54-4a9d-4355-8fed-5685cf768f4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:10.050619 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bce54-4a9d-4355-8fed-5685cf768f4a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:10.064566 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 266/528] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:09 2022] GET /identity/v3/role_assignments?user.id=fbcda58f298444eebf4f08ce01deffc0&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=63df47d6fc0740e6bc54a845c3f8a257 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:10.064566 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0d266-b843-4a14-a3df-4b7bb7397bf3 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:10.075485 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 263/529] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:10.076653 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bce54-4a9d-4355-8fed-5685cf768f4a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:10.176349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0d266-b843-4a14-a3df-4b7bb7397bf3 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:10.181801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bce54-4a9d-4355-8fed-5685cf768f4a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:10.212858 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbde78e-a93d-4a5e-b960-b306eff6d8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:10.213548 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbde78e-a93d-4a5e-b960-b306eff6d8dd None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.213828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbde78e-a93d-4a5e-b960-b306eff6d8dd None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.214098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbde78e-a93d-4a5e-b960-b306eff6d8dd None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.214991 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbde78e-a93d-4a5e-b960-b306eff6d8dd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:10.215339 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbde78e-a93d-4a5e-b960-b306eff6d8dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:10.216778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbde78e-a93d-4a5e-b960-b306eff6d8dd None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:10.217713 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7ff99-d0a6-4a56-92fc-a0f71f8f0b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:10.218392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7ff99-d0a6-4a56-92fc-a0f71f8f0b5b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.218670 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7ff99-d0a6-4a56-92fc-a0f71f8f0b5b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.218943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7ff99-d0a6-4a56-92fc-a0f71f8f0b5b None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.219671 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7ff99-d0a6-4a56-92fc-a0f71f8f0b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:10.219984 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7ff99-d0a6-4a56-92fc-a0f71f8f0b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:10.221531 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7ff99-d0a6-4a56-92fc-a0f71f8f0b5b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:10.234419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 264/530] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:10.235093 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7ff99-d0a6-4a56-92fc-a0f71f8f0b5b None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:10.240406 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 267/531] 10.222.0.90 () {56 vars in 1139 bytes} [Wed Nov 2 12:39:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:10.241160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbde78e-a93d-4a5e-b960-b306eff6d8dd None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:10.341119 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7ff99-d0a6-4a56-92fc-a0f71f8f0b5b None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:10.341516 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbde78e-a93d-4a5e-b960-b306eff6d8dd None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:10.374567 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff72cf-7b19-42ef-9bfa-3db83b64475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:10.375229 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff72cf-7b19-42ef-9bfa-3db83b64475b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.375505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff72cf-7b19-42ef-9bfa-3db83b64475b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.375622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2be13-feda-4bbb-a0a8-e17963ff6b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:10.375800 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff72cf-7b19-42ef-9bfa-3db83b64475b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.376455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2be13-feda-4bbb-a0a8-e17963ff6b3c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.376700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff72cf-7b19-42ef-9bfa-3db83b64475b None admin] RBAC: Adding query filter params (role.id=63df47d6fc0740e6bc54a845c3f8a257, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=0303312c6cec4067a4a92d38edb59086) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:10.376796 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2be13-feda-4bbb-a0a8-e17963ff6b3c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.376992 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2be13-feda-4bbb-a0a8-e17963ff6b3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.377148 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff72cf-7b19-42ef-9bfa-3db83b64475b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:10.378443 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff72cf-7b19-42ef-9bfa-3db83b64475b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:10.383926 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2be13-feda-4bbb-a0a8-e17963ff6b3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:10.385427 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2be13-feda-4bbb-a0a8-e17963ff6b3c None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:10.388635 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 265/532] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:10 2022] GET /identity/v3/role_assignments?user.id=0303312c6cec4067a4a92d38edb59086&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=63df47d6fc0740e6bc54a845c3f8a257 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:10.389639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff72cf-7b19-42ef-9bfa-3db83b64475b None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:10.399416 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-48d2be13-feda-4bbb-a0a8-e17963ff6b3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:10.401011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 268/533] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:10.407036 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2be13-feda-4bbb-a0a8-e17963ff6b3c None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:10.515386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2be13-feda-4bbb-a0a8-e17963ff6b3c None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:10.550327 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088adf8a-cfe8-4c85-bb55-7d5a1f5abce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:10.551014 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088adf8a-cfe8-4c85-bb55-7d5a1f5abce5 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.551295 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088adf8a-cfe8-4c85-bb55-7d5a1f5abce5 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.556232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088adf8a-cfe8-4c85-bb55-7d5a1f5abce5 None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.556232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088adf8a-cfe8-4c85-bb55-7d5a1f5abce5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:10.556232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088adf8a-cfe8-4c85-bb55-7d5a1f5abce5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:10.556799 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088adf8a-cfe8-4c85-bb55-7d5a1f5abce5 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:10.571593 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff72cf-7b19-42ef-9bfa-3db83b64475b None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:10.587535 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 269/534] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:10.594507 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088adf8a-cfe8-4c85-bb55-7d5a1f5abce5 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:10.644559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568ebba-7a5b-41c5-8f99-3f9b70e0aaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:10.645235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568ebba-7a5b-41c5-8f99-3f9b70e0aaef None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.645517 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568ebba-7a5b-41c5-8f99-3f9b70e0aaef None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.645969 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568ebba-7a5b-41c5-8f99-3f9b70e0aaef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.744614 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568ebba-7a5b-41c5-8f99-3f9b70e0aaef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:10.746131 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568ebba-7a5b-41c5-8f99-3f9b70e0aaef None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:10.774335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088adf8a-cfe8-4c85-bb55-7d5a1f5abce5 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:10.831413 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a278a-3cd3-490f-a5af-f3e9e7eb3acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:10.832075 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a278a-3cd3-490f-a5af-f3e9e7eb3acc None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.832383 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a278a-3cd3-490f-a5af-f3e9e7eb3acc None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.832654 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a278a-3cd3-490f-a5af-f3e9e7eb3acc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.833936 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a278a-3cd3-490f-a5af-f3e9e7eb3acc None admin] RBAC: Adding query filter params (role.id=63df47d6fc0740e6bc54a845c3f8a257, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=2a6d1ff8ac3b408f87c4a9b8d7363e86) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:10.834521 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a278a-3cd3-490f-a5af-f3e9e7eb3acc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:10.836448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a278a-3cd3-490f-a5af-f3e9e7eb3acc None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:10.844309 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 270/535] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:10 2022] GET /identity/v3/role_assignments?user.id=2a6d1ff8ac3b408f87c4a9b8d7363e86&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=63df47d6fc0740e6bc54a845c3f8a257 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:10.845193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 266/536] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:10.845775 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdbde0-77eb-4937-8bf0-5e928fd3c9eb None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.846106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdbde0-77eb-4937-8bf0-5e928fd3c9eb None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.846386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdbde0-77eb-4937-8bf0-5e928fd3c9eb None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.850730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568ebba-7a5b-41c5-8f99-3f9b70e0aaef None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:10.852387 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 271/537] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:10.854459 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cb39d-a068-40fb-a785-46263e7f01c2 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.855876 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cb39d-a068-40fb-a785-46263e7f01c2 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.856153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cb39d-a068-40fb-a785-46263e7f01c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.876680 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-759cb39d-a068-40fb-a785-46263e7f01c2 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:10.878202 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-759cb39d-a068-40fb-a785-46263e7f01c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:10.963633 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568ebba-7a5b-41c5-8f99-3f9b70e0aaef None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:11.007463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41ccc5-b92e-46d4-9b68-b9eec9327817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:11.008450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41ccc5-b92e-46d4-9b68-b9eec9327817 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:11.008730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41ccc5-b92e-46d4-9b68-b9eec9327817 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:11.009026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41ccc5-b92e-46d4-9b68-b9eec9327817 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:11.016284 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 272/538] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:39:11.023480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41ccc5-b92e-46d4-9b68-b9eec9327817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:11.025061 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41ccc5-b92e-46d4-9b68-b9eec9327817 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:11.044051 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-ac41ccc5-b92e-46d4-9b68-b9eec9327817 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:11.045729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 267/539] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:11.051363 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cb39d-a068-40fb-a785-46263e7f01c2 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:11.058003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41ccc5-b92e-46d4-9b68-b9eec9327817 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:11.158729 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cb39d-a068-40fb-a785-46263e7f01c2 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:11.193303 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3fc30-45f1-4efc-a04c-c9a2bfb091ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:11.194337 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3fc30-45f1-4efc-a04c-c9a2bfb091ca None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:11.194818 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3fc30-45f1-4efc-a04c-c9a2bfb091ca None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:11.195312 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3fc30-45f1-4efc-a04c-c9a2bfb091ca None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:11.196289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3fc30-45f1-4efc-a04c-c9a2bfb091ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:11.196788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3fc30-45f1-4efc-a04c-c9a2bfb091ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:11.198440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3fc30-45f1-4efc-a04c-c9a2bfb091ca None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:11.211002 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 273/540] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:11.216869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3fc30-45f1-4efc-a04c-c9a2bfb091ca None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:11.238617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41ccc5-b92e-46d4-9b68-b9eec9327817 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:11.301868 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a89953-a084-490b-a49f-50096d3615c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:11.302729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a89953-a084-490b-a49f-50096d3615c5 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:11.303004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a89953-a084-490b-a49f-50096d3615c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:11.303279 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a89953-a084-490b-a49f-50096d3615c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:11.318829 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3fc30-45f1-4efc-a04c-c9a2bfb091ca None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:11.325187 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a89953-a084-490b-a49f-50096d3615c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:11.332147 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-e7a89953-a084-490b-a49f-50096d3615c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:11.341869 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 268/541] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:11.347605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a89953-a084-490b-a49f-50096d3615c5 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:11.353681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19b51e-0fcb-42da-857a-f9fe53f93915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:11.354716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19b51e-0fcb-42da-857a-f9fe53f93915 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:11.355222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19b51e-0fcb-42da-857a-f9fe53f93915 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:11.355720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19b51e-0fcb-42da-857a-f9fe53f93915 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:11.363020 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19b51e-0fcb-42da-857a-f9fe53f93915 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:11.364827 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19b51e-0fcb-42da-857a-f9fe53f93915 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:11.379266 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-ba19b51e-0fcb-42da-857a-f9fe53f93915 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:11.381090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 274/542] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:11.386907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19b51e-0fcb-42da-857a-f9fe53f93915 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:11.517974 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19b51e-0fcb-42da-857a-f9fe53f93915 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:11.534913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a89953-a084-490b-a49f-50096d3615c5 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:11.574059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace1246-20c5-4239-9cf4-9dee773712d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:11.574785 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace1246-20c5-4239-9cf4-9dee773712d8 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:11.575064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace1246-20c5-4239-9cf4-9dee773712d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:11.575328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace1246-20c5-4239-9cf4-9dee773712d8 None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:11.576151 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace1246-20c5-4239-9cf4-9dee773712d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:11.576488 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace1246-20c5-4239-9cf4-9dee773712d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:11.578298 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace1246-20c5-4239-9cf4-9dee773712d8 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:11.592930 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 275/543] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:11.603094 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace1246-20c5-4239-9cf4-9dee773712d8 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:11.623588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e863-a3fe-47da-823f-bcd22b77ccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:11.624338 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e863-a3fe-47da-823f-bcd22b77ccea None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:11.624624 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e863-a3fe-47da-823f-bcd22b77ccea None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:11.624887 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e863-a3fe-47da-823f-bcd22b77ccea None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:11.625635 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44e863-a3fe-47da-823f-bcd22b77ccea None admin] RBAC: Adding query filter params (name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:11.625931 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44e863-a3fe-47da-823f-bcd22b77ccea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:11.627319 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44e863-a3fe-47da-823f-bcd22b77ccea None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:11.646663 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 269/544] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:11.652442 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e863-a3fe-47da-823f-bcd22b77ccea None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:11.711256 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace1246-20c5-4239-9cf4-9dee773712d8 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:11.746838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f4ae2-93bd-4cad-a8e6-0c02a1003739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:11.747411 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f4ae2-93bd-4cad-a8e6-0c02a1003739 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:11.747685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f4ae2-93bd-4cad-a8e6-0c02a1003739 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:11.747951 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f4ae2-93bd-4cad-a8e6-0c02a1003739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:11.748796 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f4ae2-93bd-4cad-a8e6-0c02a1003739 None admin] RBAC: Adding query filter params (role.id=63df47d6fc0740e6bc54a845c3f8a257, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=89a11da83d84467ca9ae04b9693beede) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:11.749101 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f4ae2-93bd-4cad-a8e6-0c02a1003739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:11.750748 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f4ae2-93bd-4cad-a8e6-0c02a1003739 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:11.757506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 276/545] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:11 2022] GET /identity/v3/role_assignments?user.id=89a11da83d84467ca9ae04b9693beede&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=63df47d6fc0740e6bc54a845c3f8a257 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:11.837533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e863-a3fe-47da-823f-bcd22b77ccea None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:11.887970 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b17495-fcd9-4464-b45b-9bdd21c496b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:11.888824 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b17495-fcd9-4464-b45b-9bdd21c496b2 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:11.889098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b17495-fcd9-4464-b45b-9bdd21c496b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:11.889370 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b17495-fcd9-4464-b45b-9bdd21c496b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:11.905534 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b17495-fcd9-4464-b45b-9bdd21c496b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:11.907072 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b17495-fcd9-4464-b45b-9bdd21c496b2 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:11.927138 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c2b17495-fcd9-4464-b45b-9bdd21c496b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:11.928777 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 270/546] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:11.934482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f4ae2-93bd-4cad-a8e6-0c02a1003739 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:12.094657 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f4ae2-93bd-4cad-a8e6-0c02a1003739 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:12.132524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769f7ea-0369-4184-877e-921d522aeae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:12.133202 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769f7ea-0369-4184-877e-921d522aeae6 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:12.133482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769f7ea-0369-4184-877e-921d522aeae6 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:12.133753 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769f7ea-0369-4184-877e-921d522aeae6 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:12.134484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769f7ea-0369-4184-877e-921d522aeae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:12.134788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769f7ea-0369-4184-877e-921d522aeae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:12.136159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769f7ea-0369-4184-877e-921d522aeae6 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:12.148683 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 277/547] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:12.154459 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b17495-fcd9-4464-b45b-9bdd21c496b2 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:12.293089 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b17495-fcd9-4464-b45b-9bdd21c496b2 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:12.340740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb33744-26c8-433c-bd61-ce787da02cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:12.341545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb33744-26c8-433c-bd61-ce787da02cbd None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:12.341826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb33744-26c8-433c-bd61-ce787da02cbd None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:12.342101 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb33744-26c8-433c-bd61-ce787da02cbd None admin] PATH_INFO: `/v3/users/swift` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:12.351178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb33744-26c8-433c-bd61-ce787da02cbd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:12.352601 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb33744-26c8-433c-bd61-ce787da02cbd None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:12.369123 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-efb33744-26c8-433c-bd61-ce787da02cbd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 12:39:12.370689 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 271/548] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:39:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:12.376474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769f7ea-0369-4184-877e-921d522aeae6 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:12.490252 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769f7ea-0369-4184-877e-921d522aeae6 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:12.529222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001502b-bd77-4649-a8bd-256ae50dd5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:12.529903 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001502b-bd77-4649-a8bd-256ae50dd5f3 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:12.530178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001502b-bd77-4649-a8bd-256ae50dd5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:12.530444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001502b-bd77-4649-a8bd-256ae50dd5f3 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:12.531419 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001502b-bd77-4649-a8bd-256ae50dd5f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:12.531724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001502b-bd77-4649-a8bd-256ae50dd5f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:12.533181 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001502b-bd77-4649-a8bd-256ae50dd5f3 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:12.553843 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 278/549] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Nov 2 12:39:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:12.559702 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb33744-26c8-433c-bd61-ce787da02cbd None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:12.686918 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb33744-26c8-433c-bd61-ce787da02cbd None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:12.728977 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da852533-f435-4469-b131-ea2cac98fdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:12.730023 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da852533-f435-4469-b131-ea2cac98fdb8 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:12.730562 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da852533-f435-4469-b131-ea2cac98fdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:12.731046 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da852533-f435-4469-b131-ea2cac98fdb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:12.801876 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da852533-f435-4469-b131-ea2cac98fdb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:12.803349 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da852533-f435-4469-b131-ea2cac98fdb8 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:12.862892 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfa33d-06f1-461f-a39c-5039473f8750 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:12.863248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfa33d-06f1-461f-a39c-5039473f8750 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:12.863455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfa33d-06f1-461f-a39c-5039473f8750 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:12.865279 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 279/550] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:12.870624 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e40af-dcbf-442b-9dfe-fb67b4e198ed None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:12.871023 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e40af-dcbf-442b-9dfe-fb67b4e198ed None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:12.871333 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e40af-dcbf-442b-9dfe-fb67b4e198ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:12.907743 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 272/551] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:12.908509 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-725e40af-dcbf-442b-9dfe-fb67b4e198ed None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:12.909700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-725e40af-dcbf-442b-9dfe-fb67b4e198ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:12.913836 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da852533-f435-4469-b131-ea2cac98fdb8 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:13.012964 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da852533-f435-4469-b131-ea2cac98fdb8 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:13.049335 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879894c4-cc20-4f83-ae7c-943fafd9454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:13.050182 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879894c4-cc20-4f83-ae7c-943fafd9454f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:13.050469 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879894c4-cc20-4f83-ae7c-943fafd9454f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:13.050739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879894c4-cc20-4f83-ae7c-943fafd9454f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:13.061255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879894c4-cc20-4f83-ae7c-943fafd9454f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:13.062826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879894c4-cc20-4f83-ae7c-943fafd9454f None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:13.073016 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 280/552] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:13.083330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-879894c4-cc20-4f83-ae7c-943fafd9454f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:13.084896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 273/553] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:13.090365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e40af-dcbf-442b-9dfe-fb67b4e198ed None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:13.113419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879894c4-cc20-4f83-ae7c-943fafd9454f None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:13.241115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879894c4-cc20-4f83-ae7c-943fafd9454f None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:13.282890 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e40af-dcbf-442b-9dfe-fb67b4e198ed None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:13.303777 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13c492-a8e7-4a96-9af8-e36dffe3e0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:13.304659 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13c492-a8e7-4a96-9af8-e36dffe3e0b4 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:13.304942 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13c492-a8e7-4a96-9af8-e36dffe3e0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:13.305216 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13c492-a8e7-4a96-9af8-e36dffe3e0b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:13.317824 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13c492-a8e7-4a96-9af8-e36dffe3e0b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:13.325404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-7f13c492-a8e7-4a96-9af8-e36dffe3e0b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:13.327029 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 274/554] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:13.332730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13c492-a8e7-4a96-9af8-e36dffe3e0b4 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:13.367579 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e264813-f2d5-4c07-971f-c190912639bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:13.368617 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e264813-f2d5-4c07-971f-c190912639bb None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:13.369085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e264813-f2d5-4c07-971f-c190912639bb None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:13.369540 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e264813-f2d5-4c07-971f-c190912639bb None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:13.370440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e264813-f2d5-4c07-971f-c190912639bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:13.371945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e264813-f2d5-4c07-971f-c190912639bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:13.373559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e264813-f2d5-4c07-971f-c190912639bb None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:13.391502 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 281/555] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:13.405008 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e264813-f2d5-4c07-971f-c190912639bb None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:13.494017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13c492-a8e7-4a96-9af8-e36dffe3e0b4 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:13.556522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d456f3-1522-4ec2-92a7-482661d36bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:13.557130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d456f3-1522-4ec2-92a7-482661d36bc1 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:13.557424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d456f3-1522-4ec2-92a7-482661d36bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:13.557993 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d456f3-1522-4ec2-92a7-482661d36bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:13.559213 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d456f3-1522-4ec2-92a7-482661d36bc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:13.559519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d456f3-1522-4ec2-92a7-482661d36bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:13.561189 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d456f3-1522-4ec2-92a7-482661d36bc1 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:13.576025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 275/556] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:13.576025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e3f99-1d4b-49fa-aa24-f9240444ccc2 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:13.576025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e3f99-1d4b-49fa-aa24-f9240444ccc2 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:13.576025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e3f99-1d4b-49fa-aa24-f9240444ccc2 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:13.580115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 276/557] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:13.580983 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e3f99-1d4b-49fa-aa24-f9240444ccc2 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:13.588527 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e264813-f2d5-4c07-971f-c190912639bb None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:13.626424 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7df35f-8c6d-4590-8090-6d419343b617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:13.627689 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7df35f-8c6d-4590-8090-6d419343b617 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:13.628177 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7df35f-8c6d-4590-8090-6d419343b617 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:13.628671 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7df35f-8c6d-4590-8090-6d419343b617 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:13.637296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7df35f-8c6d-4590-8090-6d419343b617 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:13.639596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7df35f-8c6d-4590-8090-6d419343b617 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:13.658292 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-2f7df35f-8c6d-4590-8090-6d419343b617 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:13.664880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 282/558] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:13.666791 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfa066-b146-45c6-a410-4aa63d10f9f0 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:13.666929 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfa066-b146-45c6-a410-4aa63d10f9f0 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:13.667143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfa066-b146-45c6-a410-4aa63d10f9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:13.691307 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-40cfa066-b146-45c6-a410-4aa63d10f9f0 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:13.692580 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-40cfa066-b146-45c6-a410-4aa63d10f9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:13.707095 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e3f99-1d4b-49fa-aa24-f9240444ccc2 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:13.740384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2320a-7551-49cd-8c22-abf59a9bfc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:13.741216 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2320a-7551-49cd-8c22-abf59a9bfc48 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:13.741492 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2320a-7551-49cd-8c22-abf59a9bfc48 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:13.741762 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2320a-7551-49cd-8c22-abf59a9bfc48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:13.752591 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2320a-7551-49cd-8c22-abf59a9bfc48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:13.754150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2320a-7551-49cd-8c22-abf59a9bfc48 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:13.758125 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 283/559] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:13.758812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfa066-b146-45c6-a410-4aa63d10f9f0 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:13.776237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c8c2320a-7551-49cd-8c22-abf59a9bfc48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:13.776237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 277/560] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:13.776237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ffeb8-d237-4114-93a3-a095ed895828 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:13.776237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ffeb8-d237-4114-93a3-a095ed895828 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:13.776237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ffeb8-d237-4114-93a3-a095ed895828 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:13.777179 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 278/561] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:13.780847 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ffeb8-d237-4114-93a3-a095ed895828 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:13.867234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfa066-b146-45c6-a410-4aa63d10f9f0 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:13.883610 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ffeb8-d237-4114-93a3-a095ed895828 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:13.902040 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35b52a-e246-4d19-9641-a34b2acdb487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:13.902752 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35b52a-e246-4d19-9641-a34b2acdb487 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:13.903027 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35b52a-e246-4d19-9641-a34b2acdb487 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:13.903651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35b52a-e246-4d19-9641-a34b2acdb487 None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:13.904504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35b52a-e246-4d19-9641-a34b2acdb487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:13.904812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35b52a-e246-4d19-9641-a34b2acdb487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:13.906341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35b52a-e246-4d19-9641-a34b2acdb487 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:13.923388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 284/562] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:13.923388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21170863-8e80-4990-ab86-bd20a97b72a6 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:13.923388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21170863-8e80-4990-ab86-bd20a97b72a6 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:13.923388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21170863-8e80-4990-ab86-bd20a97b72a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:13.925555 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf44c59-dcc8-4702-a018-f971047402e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:13.926423 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf44c59-dcc8-4702-a018-f971047402e1 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:13.926704 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf44c59-dcc8-4702-a018-f971047402e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:13.927009 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf44c59-dcc8-4702-a018-f971047402e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:13.938160 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf44c59-dcc8-4702-a018-f971047402e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:13.939595 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-21170863-8e80-4990-ab86-bd20a97b72a6 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:13.940813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-21170863-8e80-4990-ab86-bd20a97b72a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:13.945324 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-caf44c59-dcc8-4702-a018-f971047402e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:13.946730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 279/563] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:13.947389 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf44c59-dcc8-4702-a018-f971047402e1 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.012122 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 285/564] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:14.020382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21170863-8e80-4990-ab86-bd20a97b72a6 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.059660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf44c59-dcc8-4702-a018-f971047402e1 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.099261 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee4018-a7da-4d00-b8bc-78964d0aede1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.100084 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee4018-a7da-4d00-b8bc-78964d0aede1 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.100303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee4018-a7da-4d00-b8bc-78964d0aede1 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.100552 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee4018-a7da-4d00-b8bc-78964d0aede1 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.101302 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee4018-a7da-4d00-b8bc-78964d0aede1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:14.101612 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee4018-a7da-4d00-b8bc-78964d0aede1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:14.103100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee4018-a7da-4d00-b8bc-78964d0aede1 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:14.116303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 280/565] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:14.117212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee4018-a7da-4d00-b8bc-78964d0aede1 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.123023 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21170863-8e80-4990-ab86-bd20a97b72a6 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.159220 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7516a-e308-4c1e-a0d8-a2a87850cc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.159910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7516a-e308-4c1e-a0d8-a2a87850cc89 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.160181 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7516a-e308-4c1e-a0d8-a2a87850cc89 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.160480 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7516a-e308-4c1e-a0d8-a2a87850cc89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.161303 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7516a-e308-4c1e-a0d8-a2a87850cc89 None admin] RBAC: Adding query filter params (role.id=63df47d6fc0740e6bc54a845c3f8a257, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=baece5d60fe6407989b460fc6b747f6c) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:14.161612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7516a-e308-4c1e-a0d8-a2a87850cc89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:14.163209 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7516a-e308-4c1e-a0d8-a2a87850cc89 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:14.168923 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 286/566] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:14 2022] GET /identity/v3/role_assignments?user.id=baece5d60fe6407989b460fc6b747f6c&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=63df47d6fc0740e6bc54a845c3f8a257 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:14.169715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7516a-e308-4c1e-a0d8-a2a87850cc89 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.219153 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee4018-a7da-4d00-b8bc-78964d0aede1 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.255261 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d83eb-4107-4122-a738-4248d5db9af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.256381 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d83eb-4107-4122-a738-4248d5db9af6 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.256875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d83eb-4107-4122-a738-4248d5db9af6 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.257355 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d83eb-4107-4122-a738-4248d5db9af6 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.258314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d83eb-4107-4122-a738-4248d5db9af6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:14.258841 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d83eb-4107-4122-a738-4248d5db9af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:14.260499 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d83eb-4107-4122-a738-4248d5db9af6 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:14.270472 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 281/567] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:14.271709 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d83eb-4107-4122-a738-4248d5db9af6 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.290540 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7516a-e308-4c1e-a0d8-a2a87850cc89 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.327293 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2bf53-ac70-4bfd-b524-9d36d85e0b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.328144 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2bf53-ac70-4bfd-b524-9d36d85e0b7a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.328471 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2bf53-ac70-4bfd-b524-9d36d85e0b7a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.328953 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2bf53-ac70-4bfd-b524-9d36d85e0b7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.340575 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2bf53-ac70-4bfd-b524-9d36d85e0b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:14.347993 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-3dc2bf53-ac70-4bfd-b524-9d36d85e0b7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:14.354373 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 287/568] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:14.355389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2bf53-ac70-4bfd-b524-9d36d85e0b7a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.383675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d83eb-4107-4122-a738-4248d5db9af6 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.419027 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d1d19-cb43-45d9-b1a0-3d3fabcb054e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.420285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d1d19-cb43-45d9-b1a0-3d3fabcb054e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.420765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d1d19-cb43-45d9-b1a0-3d3fabcb054e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.421232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d1d19-cb43-45d9-b1a0-3d3fabcb054e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.429426 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d1d19-cb43-45d9-b1a0-3d3fabcb054e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:14.431209 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d1d19-cb43-45d9-b1a0-3d3fabcb054e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:14.445788 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c71d1d19-cb43-45d9-b1a0-3d3fabcb054e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:39:14.447737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 282/569] 10.222.0.90 () {56 vars in 1093 bytes} [Wed Nov 2 12:39:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:14.448899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d1d19-cb43-45d9-b1a0-3d3fabcb054e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.466661 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2bf53-ac70-4bfd-b524-9d36d85e0b7a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.499086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f7453-e3db-4809-a981-928edb281e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.500000 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f7453-e3db-4809-a981-928edb281e50 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.503817 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f7453-e3db-4809-a981-928edb281e50 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.503817 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f7453-e3db-4809-a981-928edb281e50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.517202 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f7453-e3db-4809-a981-928edb281e50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:14.518809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f7453-e3db-4809-a981-928edb281e50 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:14.535637 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-074f7453-e3db-4809-a981-928edb281e50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:14.541351 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 288/570] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:14.541351 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f7453-e3db-4809-a981-928edb281e50 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.557370 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d1d19-cb43-45d9-b1a0-3d3fabcb054e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.590584 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5b8df-8ef0-4d2d-97d7-1ddd9cf668ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.591262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5b8df-8ef0-4d2d-97d7-1ddd9cf668ec None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.591541 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5b8df-8ef0-4d2d-97d7-1ddd9cf668ec None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.591815 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5b8df-8ef0-4d2d-97d7-1ddd9cf668ec None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.592618 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5b8df-8ef0-4d2d-97d7-1ddd9cf668ec None admin] RBAC: Adding query filter params (name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:14.592908 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5b8df-8ef0-4d2d-97d7-1ddd9cf668ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:14.594304 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5b8df-8ef0-4d2d-97d7-1ddd9cf668ec None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:14.602183 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 283/571] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:14.603702 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad439e75-cadb-40ab-bed9-15ad0d029592 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.604192 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad439e75-cadb-40ab-bed9-15ad0d029592 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.604711 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad439e75-cadb-40ab-bed9-15ad0d029592 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.606894 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 284/572] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:14.607786 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad439e75-cadb-40ab-bed9-15ad0d029592 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.640449 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f7453-e3db-4809-a981-928edb281e50 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.674762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf9039-9353-471c-8672-f8a6ee78ab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.676690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf9039-9353-471c-8672-f8a6ee78ab11 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.677191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf9039-9353-471c-8672-f8a6ee78ab11 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.677673 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf9039-9353-471c-8672-f8a6ee78ab11 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.678695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf9039-9353-471c-8672-f8a6ee78ab11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:14.679196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf9039-9353-471c-8672-f8a6ee78ab11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:14.680936 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf9039-9353-471c-8672-f8a6ee78ab11 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:14.699233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 289/573] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Nov 2 12:39:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:14.700096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf9039-9353-471c-8672-f8a6ee78ab11 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.712969 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad439e75-cadb-40ab-bed9-15ad0d029592 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.745607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af3715-8185-4797-b205-895af18b1e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.746304 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af3715-8185-4797-b205-895af18b1e65 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.746586 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af3715-8185-4797-b205-895af18b1e65 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.746858 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af3715-8185-4797-b205-895af18b1e65 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.747575 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af3715-8185-4797-b205-895af18b1e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:14.747880 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af3715-8185-4797-b205-895af18b1e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:14.749311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af3715-8185-4797-b205-895af18b1e65 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:14.765142 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 285/574] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:14.765142 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f510c-1c0f-46ea-a8b4-1bf0175acae0 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.765142 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f510c-1c0f-46ea-a8b4-1bf0175acae0 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.765142 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f510c-1c0f-46ea-a8b4-1bf0175acae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.781971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-266f510c-1c0f-46ea-a8b4-1bf0175acae0 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:14.783187 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-266f510c-1c0f-46ea-a8b4-1bf0175acae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:14.800534 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf9039-9353-471c-8672-f8a6ee78ab11 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.833454 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d401076-8f5b-4dc8-a5c1-96269c3cfab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.834253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d401076-8f5b-4dc8-a5c1-96269c3cfab7 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.834533 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d401076-8f5b-4dc8-a5c1-96269c3cfab7 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.834806 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d401076-8f5b-4dc8-a5c1-96269c3cfab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.845847 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d401076-8f5b-4dc8-a5c1-96269c3cfab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:14.847309 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d401076-8f5b-4dc8-a5c1-96269c3cfab7 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:14.863340 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 286/575] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:14.863340 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f510c-1c0f-46ea-a8b4-1bf0175acae0 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.874918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-2d401076-8f5b-4dc8-a5c1-96269c3cfab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:14.877506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 290/576] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:14.878521 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d401076-8f5b-4dc8-a5c1-96269c3cfab7 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.956994 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f510c-1c0f-46ea-a8b4-1bf0175acae0 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.980192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d401076-8f5b-4dc8-a5c1-96269c3cfab7 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.992542 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a867d-afde-4adb-9284-b7321e017df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.993332 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a867d-afde-4adb-9284-b7321e017df7 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.993612 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a867d-afde-4adb-9284-b7321e017df7 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.993882 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a867d-afde-4adb-9284-b7321e017df7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.004568 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a867d-afde-4adb-9284-b7321e017df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:15.006094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a867d-afde-4adb-9284-b7321e017df7 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:15.016888 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6079400-4b46-4203-9036-4c2bd3872cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:15.018397 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6079400-4b46-4203-9036-4c2bd3872cc1 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:15.018685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6079400-4b46-4203-9036-4c2bd3872cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:15.018965 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6079400-4b46-4203-9036-4c2bd3872cc1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.023685 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-ac4a867d-afde-4adb-9284-b7321e017df7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:15.030243 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 287/577] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:15.030243 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a867d-afde-4adb-9284-b7321e017df7 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:15.032074 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6079400-4b46-4203-9036-4c2bd3872cc1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:15.033624 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6079400-4b46-4203-9036-4c2bd3872cc1 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:15.048007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-d6079400-4b46-4203-9036-4c2bd3872cc1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 12:39:15.054217 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 291/578] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:39:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:15.054217 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6079400-4b46-4203-9036-4c2bd3872cc1 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:15.133694 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a867d-afde-4adb-9284-b7321e017df7 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:15.148446 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6079400-4b46-4203-9036-4c2bd3872cc1 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:15.166031 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309eeb75-6917-4f33-ae36-73b74180592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:15.166697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eeb75-6917-4f33-ae36-73b74180592f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:15.166977 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eeb75-6917-4f33-ae36-73b74180592f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:15.167252 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eeb75-6917-4f33-ae36-73b74180592f None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.168028 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309eeb75-6917-4f33-ae36-73b74180592f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:15.168363 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309eeb75-6917-4f33-ae36-73b74180592f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:15.169746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309eeb75-6917-4f33-ae36-73b74180592f None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:15.185325 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 288/579] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:15.185325 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309eeb75-6917-4f33-ae36-73b74180592f None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:15.187364 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fe1eb-1140-4e54-abe5-fb7c4cfe69f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:15.188265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fe1eb-1140-4e54-abe5-fb7c4cfe69f8 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:15.188544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fe1eb-1140-4e54-abe5-fb7c4cfe69f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:15.188813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fe1eb-1140-4e54-abe5-fb7c4cfe69f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.198891 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fe1eb-1140-4e54-abe5-fb7c4cfe69f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:15.205912 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-266fe1eb-1140-4e54-abe5-fb7c4cfe69f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:15.211922 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 292/580] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:15.211922 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fe1eb-1140-4e54-abe5-fb7c4cfe69f8 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:15.277844 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309eeb75-6917-4f33-ae36-73b74180592f None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:15.308591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fe1eb-1140-4e54-abe5-fb7c4cfe69f8 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:15.310843 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd702cb-2de0-4f20-9076-8d7062840137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:15.311528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd702cb-2de0-4f20-9076-8d7062840137 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:15.312244 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd702cb-2de0-4f20-9076-8d7062840137 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:15.312244 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd702cb-2de0-4f20-9076-8d7062840137 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.313201 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd702cb-2de0-4f20-9076-8d7062840137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:15.313514 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd702cb-2de0-4f20-9076-8d7062840137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:15.314942 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd702cb-2de0-4f20-9076-8d7062840137 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:15.327810 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 289/581] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:15.328609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd702cb-2de0-4f20-9076-8d7062840137 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:15.345657 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cb3ba-3c44-429a-bc94-56b51d925886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:15.346665 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cb3ba-3c44-429a-bc94-56b51d925886 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:15.346944 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cb3ba-3c44-429a-bc94-56b51d925886 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:15.347238 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cb3ba-3c44-429a-bc94-56b51d925886 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.348057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cb3ba-3c44-429a-bc94-56b51d925886 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:15.348400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cb3ba-3c44-429a-bc94-56b51d925886 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:15.349874 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cb3ba-3c44-429a-bc94-56b51d925886 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:15.366698 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 293/582] 10.222.0.90 () {56 vars in 1137 bytes} [Wed Nov 2 12:39:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:15.366698 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cb3ba-3c44-429a-bc94-56b51d925886 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:15.426769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd702cb-2de0-4f20-9076-8d7062840137 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:15.460658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a87e98-576d-420d-afdb-a217067ec771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:15.461763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a87e98-576d-420d-afdb-a217067ec771 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:15.462257 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a87e98-576d-420d-afdb-a217067ec771 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:15.462682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a87e98-576d-420d-afdb-a217067ec771 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.468801 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cb3ba-3c44-429a-bc94-56b51d925886 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:15.471636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a87e98-576d-420d-afdb-a217067ec771 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:15.472618 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a87e98-576d-420d-afdb-a217067ec771 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:15.487365 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-39a87e98-576d-420d-afdb-a217067ec771 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 12:39:15.493758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 290/583] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:39:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:15.493758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a87e98-576d-420d-afdb-a217067ec771 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:15.512994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a97fa-ea71-4d4d-b45e-2c1207d3d64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:15.513904 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a97fa-ea71-4d4d-b45e-2c1207d3d64e None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:15.514283 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a97fa-ea71-4d4d-b45e-2c1207d3d64e None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:15.514659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a97fa-ea71-4d4d-b45e-2c1207d3d64e None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.515477 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a97fa-ea71-4d4d-b45e-2c1207d3d64e None admin] RBAC: Adding query filter params (name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:15.515845 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a97fa-ea71-4d4d-b45e-2c1207d3d64e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:15.517316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a97fa-ea71-4d4d-b45e-2c1207d3d64e None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:15.530216 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 294/584] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:15.530216 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a97fa-ea71-4d4d-b45e-2c1207d3d64e None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:15.596616 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a87e98-576d-420d-afdb-a217067ec771 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:15.624334 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a97fa-ea71-4d4d-b45e-2c1207d3d64e None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:15.634174 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b62dd-77ca-4090-bd3a-cdec70b3577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:15.635136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b62dd-77ca-4090-bd3a-cdec70b3577f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:15.635403 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b62dd-77ca-4090-bd3a-cdec70b3577f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:15.635677 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b62dd-77ca-4090-bd3a-cdec70b3577f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.642449 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b62dd-77ca-4090-bd3a-cdec70b3577f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:15.643898 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b62dd-77ca-4090-bd3a-cdec70b3577f None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:15.656927 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-9b4b62dd-77ca-4090-bd3a-cdec70b3577f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:15.657241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669b7a1-f947-4001-ba21-c9fd5ea26366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:15.662760 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669b7a1-f947-4001-ba21-c9fd5ea26366 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:15.662904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 291/585] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:15.663003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669b7a1-f947-4001-ba21-c9fd5ea26366 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:15.663003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669b7a1-f947-4001-ba21-c9fd5ea26366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.663158 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b62dd-77ca-4090-bd3a-cdec70b3577f None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:15.673775 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669b7a1-f947-4001-ba21-c9fd5ea26366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:15.675361 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669b7a1-f947-4001-ba21-c9fd5ea26366 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:15.691375 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-0669b7a1-f947-4001-ba21-c9fd5ea26366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:15.697415 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 295/586] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:15.698277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669b7a1-f947-4001-ba21-c9fd5ea26366 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:15.760522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b62dd-77ca-4090-bd3a-cdec70b3577f None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:15.794487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31f06-af12-4702-b9a7-329218cd7d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:15.795187 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31f06-af12-4702-b9a7-329218cd7d0b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:15.795471 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31f06-af12-4702-b9a7-329218cd7d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:15.795747 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31f06-af12-4702-b9a7-329218cd7d0b None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.795845 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669b7a1-f947-4001-ba21-c9fd5ea26366 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:15.796787 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed31f06-af12-4702-b9a7-329218cd7d0b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:15.797094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed31f06-af12-4702-b9a7-329218cd7d0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:15.798538 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed31f06-af12-4702-b9a7-329218cd7d0b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:15.816628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 292/587] 10.222.0.90 () {56 vars in 1137 bytes} [Wed Nov 2 12:39:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:15.817384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31f06-af12-4702-b9a7-329218cd7d0b None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:15.835068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e128a44-a1f2-4879-ac52-fdbda427e33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:15.835872 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e128a44-a1f2-4879-ac52-fdbda427e33d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:15.836149 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e128a44-a1f2-4879-ac52-fdbda427e33d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:15.836464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e128a44-a1f2-4879-ac52-fdbda427e33d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.847631 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e128a44-a1f2-4879-ac52-fdbda427e33d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:15.849127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e128a44-a1f2-4879-ac52-fdbda427e33d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:15.865243 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-4e128a44-a1f2-4879-ac52-fdbda427e33d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:15.871163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 296/588] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:15.871163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e128a44-a1f2-4879-ac52-fdbda427e33d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:15.919288 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31f06-af12-4702-b9a7-329218cd7d0b None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:15.955413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f1fbe-91b7-4883-a269-984c37c4e8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:15.956483 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f1fbe-91b7-4883-a269-984c37c4e8ac None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:15.956907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f1fbe-91b7-4883-a269-984c37c4e8ac None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:15.957335 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f1fbe-91b7-4883-a269-984c37c4e8ac None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.958132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f1fbe-91b7-4883-a269-984c37c4e8ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:15.958441 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f1fbe-91b7-4883-a269-984c37c4e8ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:15.959874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f1fbe-91b7-4883-a269-984c37c4e8ac None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:15.965839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e128a44-a1f2-4879-ac52-fdbda427e33d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:15.976458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 293/589] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:15.976458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f1fbe-91b7-4883-a269-984c37c4e8ac None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:16.002689 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e23c13-3bf0-4475-931c-fc20015508cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:16.003357 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e23c13-3bf0-4475-931c-fc20015508cc None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:16.003636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e23c13-3bf0-4475-931c-fc20015508cc None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:16.003907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e23c13-3bf0-4475-931c-fc20015508cc None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:16.004650 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e23c13-3bf0-4475-931c-fc20015508cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:16.004956 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e23c13-3bf0-4475-931c-fc20015508cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:16.006324 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e23c13-3bf0-4475-931c-fc20015508cc None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:16.022261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 297/590] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:16.022261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e23c13-3bf0-4475-931c-fc20015508cc None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:16.082720 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f1fbe-91b7-4883-a269-984c37c4e8ac None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:16.121242 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e85aee-8810-4848-8835-93326fac5c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:16.122040 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e85aee-8810-4848-8835-93326fac5c4d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:16.122317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e85aee-8810-4848-8835-93326fac5c4d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:16.122587 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e85aee-8810-4848-8835-93326fac5c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:16.122895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e23c13-3bf0-4475-931c-fc20015508cc None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:16.133665 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e85aee-8810-4848-8835-93326fac5c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:16.135145 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e85aee-8810-4848-8835-93326fac5c4d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:16.152046 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-35e85aee-8810-4848-8835-93326fac5c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:16.153675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 294/591] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:16.154453 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e85aee-8810-4848-8835-93326fac5c4d None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:16.163981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9e7c5-d972-45e0-a48e-cd829a364281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:16.164986 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9e7c5-d972-45e0-a48e-cd829a364281 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:16.165432 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9e7c5-d972-45e0-a48e-cd829a364281 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:16.165847 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9e7c5-d972-45e0-a48e-cd829a364281 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:16.166737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9e7c5-d972-45e0-a48e-cd829a364281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:16.167211 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9e7c5-d972-45e0-a48e-cd829a364281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:16.168891 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9e7c5-d972-45e0-a48e-cd829a364281 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:16.181773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 298/592] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:16.182465 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9e7c5-d972-45e0-a48e-cd829a364281 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:16.253651 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e85aee-8810-4848-8835-93326fac5c4d None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:16.282180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9e7c5-d972-45e0-a48e-cd829a364281 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:16.286733 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f088dc-d577-49f5-8d39-40324aef3618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:16.287634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f088dc-d577-49f5-8d39-40324aef3618 None admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:16.287913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f088dc-d577-49f5-8d39-40324aef3618 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:16.288184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f088dc-d577-49f5-8d39-40324aef3618 None admin] PATH_INFO: `/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/fbcda58f298444eebf4f08ce01deffc0/roles/63df47d6fc0740e6bc54a845c3f8a257` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:16.302360 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f088dc-d577-49f5-8d39-40324aef3618 None admin] RBAC: Authorizing `identity:create_grant(project_id=a08ee6d287714297a10248ad8e4522bc, user_id=fbcda58f298444eebf4f08ce01deffc0, role_id=63df47d6fc0740e6bc54a845c3f8a257)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:16.303812 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f088dc-d577-49f5-8d39-40324aef3618 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:16.315446 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca8a37-9d19-4e66-ba04-f2e3759ddd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:16.316410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca8a37-9d19-4e66-ba04-f2e3759ddd51 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:16.316765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca8a37-9d19-4e66-ba04-f2e3759ddd51 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:16.317105 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca8a37-9d19-4e66-ba04-f2e3759ddd51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:16.328480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 295/593] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:39:16 2022] PUT /identity/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/fbcda58f298444eebf4f08ce01deffc0/roles/63df47d6fc0740e6bc54a845c3f8a257 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:16.328480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f088dc-d577-49f5-8d39-40324aef3618 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:16.336668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca8a37-9d19-4e66-ba04-f2e3759ddd51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:16.338344 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca8a37-9d19-4e66-ba04-f2e3759ddd51 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:16.354015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-4fca8a37-9d19-4e66-ba04-f2e3759ddd51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:16.356281 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 299/594] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:16.357348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca8a37-9d19-4e66-ba04-f2e3759ddd51 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:16.436135 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f088dc-d577-49f5-8d39-40324aef3618 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:16.468463 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca8a37-9d19-4e66-ba04-f2e3759ddd51 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:16.474294 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539da233-331d-436a-a31e-199f317edf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:16.474988 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539da233-331d-436a-a31e-199f317edf93 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:16.475264 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539da233-331d-436a-a31e-199f317edf93 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:16.475534 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539da233-331d-436a-a31e-199f317edf93 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:16.476303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539da233-331d-436a-a31e-199f317edf93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:16.476612 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539da233-331d-436a-a31e-199f317edf93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:16.478785 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539da233-331d-436a-a31e-199f317edf93 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:16.492100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 296/595] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:16.493139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539da233-331d-436a-a31e-199f317edf93 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:16.511200 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7487e0b-fd6c-4e21-8182-e59324cce1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:16.512939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7487e0b-fd6c-4e21-8182-e59324cce1cf None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:16.513439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7487e0b-fd6c-4e21-8182-e59324cce1cf None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:16.513934 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7487e0b-fd6c-4e21-8182-e59324cce1cf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:16.522058 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7487e0b-fd6c-4e21-8182-e59324cce1cf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:16.523914 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7487e0b-fd6c-4e21-8182-e59324cce1cf None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:16.545507 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-d7487e0b-fd6c-4e21-8182-e59324cce1cf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 12:39:16.547366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 300/596] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:16.548468 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7487e0b-fd6c-4e21-8182-e59324cce1cf None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:16.595439 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539da233-331d-436a-a31e-199f317edf93 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:16.628301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9be2f-3f3e-4417-a2f2-ec58977c0acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:16.628981 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9be2f-3f3e-4417-a2f2-ec58977c0acd None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:16.629312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9be2f-3f3e-4417-a2f2-ec58977c0acd None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:16.629572 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9be2f-3f3e-4417-a2f2-ec58977c0acd None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:16.630279 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9be2f-3f3e-4417-a2f2-ec58977c0acd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:16.630578 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9be2f-3f3e-4417-a2f2-ec58977c0acd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:16.632002 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9be2f-3f3e-4417-a2f2-ec58977c0acd None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:16.644047 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 297/597] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:16.645380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608bc7e-1301-49a7-bf25-4caf59901466 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:16.645663 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608bc7e-1301-49a7-bf25-4caf59901466 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:16.645933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608bc7e-1301-49a7-bf25-4caf59901466 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:16.651744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 298/598] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:16.651744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608bc7e-1301-49a7-bf25-4caf59901466 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:16.654528 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7487e0b-fd6c-4e21-8182-e59324cce1cf None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:16.687028 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b3cf4-74ea-42d8-b6a9-8b184e956127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:16.687851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b3cf4-74ea-42d8-b6a9-8b184e956127 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:16.688132 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b3cf4-74ea-42d8-b6a9-8b184e956127 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:16.688428 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b3cf4-74ea-42d8-b6a9-8b184e956127 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:16.695027 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b3cf4-74ea-42d8-b6a9-8b184e956127 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:16.696512 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b3cf4-74ea-42d8-b6a9-8b184e956127 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:16.710068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-761b3cf4-74ea-42d8-b6a9-8b184e956127 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:16.711257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 301/599] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:16.711996 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b3cf4-74ea-42d8-b6a9-8b184e956127 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:16.749523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608bc7e-1301-49a7-bf25-4caf59901466 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:16.782779 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20521bb-9c13-4beb-9f66-34b720800b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:16.783519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20521bb-9c13-4beb-9f66-34b720800b04 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:16.783796 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20521bb-9c13-4beb-9f66-34b720800b04 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:16.784071 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20521bb-9c13-4beb-9f66-34b720800b04 None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:16.784972 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20521bb-9c13-4beb-9f66-34b720800b04 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:16.785277 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20521bb-9c13-4beb-9f66-34b720800b04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:16.786808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20521bb-9c13-4beb-9f66-34b720800b04 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:16.809013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 299/600] 10.222.0.90 () {56 vars in 1139 bytes} [Wed Nov 2 12:39:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:16.809013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc8060-66b5-4687-90f9-8907a5f8f466 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:16.809013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc8060-66b5-4687-90f9-8907a5f8f466 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:16.809013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc8060-66b5-4687-90f9-8907a5f8f466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:16.821848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b3cf4-74ea-42d8-b6a9-8b184e956127 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:16.822707 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-acfc8060-66b5-4687-90f9-8907a5f8f466 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:16.823909 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-acfc8060-66b5-4687-90f9-8907a5f8f466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:16.860098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cee26-5cb8-4ed2-bc53-d82e55045a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:16.861011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cee26-5cb8-4ed2-bc53-d82e55045a2d None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:16.861287 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cee26-5cb8-4ed2-bc53-d82e55045a2d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:16.861554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cee26-5cb8-4ed2-bc53-d82e55045a2d None admin] PATH_INFO: `/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/0303312c6cec4067a4a92d38edb59086/roles/63df47d6fc0740e6bc54a845c3f8a257` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:16.876452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cee26-5cb8-4ed2-bc53-d82e55045a2d None admin] RBAC: Authorizing `identity:create_grant(project_id=a08ee6d287714297a10248ad8e4522bc, user_id=0303312c6cec4067a4a92d38edb59086, role_id=63df47d6fc0740e6bc54a845c3f8a257)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:16.877939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cee26-5cb8-4ed2-bc53-d82e55045a2d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:16.887985 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 300/601] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:16.888874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc8060-66b5-4687-90f9-8907a5f8f466 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:16.903348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 302/602] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:39:16 2022] PUT /identity/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/0303312c6cec4067a4a92d38edb59086/roles/63df47d6fc0740e6bc54a845c3f8a257 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:16.904553 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cee26-5cb8-4ed2-bc53-d82e55045a2d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:17.016179 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cee26-5cb8-4ed2-bc53-d82e55045a2d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:17.036800 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc8060-66b5-4687-90f9-8907a5f8f466 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:17.055590 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53e241-0416-4a4e-8909-343a163c8377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:17.056848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53e241-0416-4a4e-8909-343a163c8377 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:17.057326 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53e241-0416-4a4e-8909-343a163c8377 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:17.057807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53e241-0416-4a4e-8909-343a163c8377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:17.069405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53e241-0416-4a4e-8909-343a163c8377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:17.071709 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53e241-0416-4a4e-8909-343a163c8377 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:17.087288 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d2679-c9c9-4a9b-b999-b8c0fc3d9783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:17.088484 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d2679-c9c9-4a9b-b999-b8c0fc3d9783 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:17.088919 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d2679-c9c9-4a9b-b999-b8c0fc3d9783 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:17.089335 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d2679-c9c9-4a9b-b999-b8c0fc3d9783 None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:17.090350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d2679-c9c9-4a9b-b999-b8c0fc3d9783 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:17.090793 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d2679-c9c9-4a9b-b999-b8c0fc3d9783 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:17.093040 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d2679-c9c9-4a9b-b999-b8c0fc3d9783 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:17.095781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-fe53e241-0416-4a4e-8909-343a163c8377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:17.097398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 303/603] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:17.098124 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53e241-0416-4a4e-8909-343a163c8377 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:17.113478 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 301/604] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:17.114667 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d2679-c9c9-4a9b-b999-b8c0fc3d9783 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:17.203921 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53e241-0416-4a4e-8909-343a163c8377 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:17.222060 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d2679-c9c9-4a9b-b999-b8c0fc3d9783 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:17.238703 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb2c97-662b-45e5-80e2-109523ebae9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:17.239872 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2c97-662b-45e5-80e2-109523ebae9f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:17.240319 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2c97-662b-45e5-80e2-109523ebae9f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:17.240751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2c97-662b-45e5-80e2-109523ebae9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:17.251422 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb2c97-662b-45e5-80e2-109523ebae9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:17.256427 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048ab0a-b256-4735-98c1-c87dc3ab8a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:17.257193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048ab0a-b256-4735-98c1-c87dc3ab8a8d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:17.257569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048ab0a-b256-4735-98c1-c87dc3ab8a8d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:17.257939 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048ab0a-b256-4735-98c1-c87dc3ab8a8d None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:17.258750 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048ab0a-b256-4735-98c1-c87dc3ab8a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:17.259150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048ab0a-b256-4735-98c1-c87dc3ab8a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:17.260080 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-2acb2c97-662b-45e5-80e2-109523ebae9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:17.260760 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048ab0a-b256-4735-98c1-c87dc3ab8a8d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:17.262064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 304/605] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:17.267769 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb2c97-662b-45e5-80e2-109523ebae9f None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:17.273723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 302/606] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:17.279184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048ab0a-b256-4735-98c1-c87dc3ab8a8d None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:17.376616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb2c97-662b-45e5-80e2-109523ebae9f None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:17.378085 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048ab0a-b256-4735-98c1-c87dc3ab8a8d None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:17.412154 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a5720-d5f3-416c-b0c9-92efd3b9e4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:17.412545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419a493-9255-471b-89ab-e30e010f395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:17.413317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419a493-9255-471b-89ab-e30e010f395f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:17.413618 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a5720-d5f3-416c-b0c9-92efd3b9e4c9 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:17.413752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419a493-9255-471b-89ab-e30e010f395f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:17.414131 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419a493-9255-471b-89ab-e30e010f395f None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:17.414277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a5720-d5f3-416c-b0c9-92efd3b9e4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:17.414757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a5720-d5f3-416c-b0c9-92efd3b9e4c9 None admin] PATH_INFO: `/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/2a6d1ff8ac3b408f87c4a9b8d7363e86/roles/63df47d6fc0740e6bc54a845c3f8a257` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:17.415555 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419a493-9255-471b-89ab-e30e010f395f None admin] RBAC: Adding query filter params (name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:17.415970 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419a493-9255-471b-89ab-e30e010f395f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:17.417512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419a493-9255-471b-89ab-e30e010f395f None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:17.430863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 303/607] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:17.430863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419a493-9255-471b-89ab-e30e010f395f None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:17.437106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a5720-d5f3-416c-b0c9-92efd3b9e4c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a08ee6d287714297a10248ad8e4522bc, user_id=2a6d1ff8ac3b408f87c4a9b8d7363e86, role_id=63df47d6fc0740e6bc54a845c3f8a257)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:17.438862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a5720-d5f3-416c-b0c9-92efd3b9e4c9 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:17.460567 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 305/608] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:39:17 2022] PUT /identity/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/2a6d1ff8ac3b408f87c4a9b8d7363e86/roles/63df47d6fc0740e6bc54a845c3f8a257 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:17.461926 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a5720-d5f3-416c-b0c9-92efd3b9e4c9 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:17.544285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419a493-9255-471b-89ab-e30e010f395f None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:17.607950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af775b26-e293-4ca6-ace9-6cbc551c6fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:17.608823 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af775b26-e293-4ca6-ace9-6cbc551c6fff None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:17.608939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a5720-d5f3-416c-b0c9-92efd3b9e4c9 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:17.609365 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af775b26-e293-4ca6-ace9-6cbc551c6fff None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:17.609438 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af775b26-e293-4ca6-ace9-6cbc551c6fff None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:17.619579 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af775b26-e293-4ca6-ace9-6cbc551c6fff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:17.629408 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af775b26-e293-4ca6-ace9-6cbc551c6fff None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:17.645878 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d582b07-2348-43d5-8927-f512a6d270c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:17.646696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d582b07-2348-43d5-8927-f512a6d270c1 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:17.646973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d582b07-2348-43d5-8927-f512a6d270c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:17.647240 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d582b07-2348-43d5-8927-f512a6d270c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:17.656508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-af775b26-e293-4ca6-ace9-6cbc551c6fff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:17.658100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 304/609] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:17.659004 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d582b07-2348-43d5-8927-f512a6d270c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:17.660481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d582b07-2348-43d5-8927-f512a6d270c1 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:17.664344 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af775b26-e293-4ca6-ace9-6cbc551c6fff None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:17.678706 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-6d582b07-2348-43d5-8927-f512a6d270c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:17.680147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 306/610] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:17.693253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d582b07-2348-43d5-8927-f512a6d270c1 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:17.788164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af775b26-e293-4ca6-ace9-6cbc551c6fff None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:17.823961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dedfe5-9625-447f-8634-ac0a50f28660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:17.825024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dedfe5-9625-447f-8634-ac0a50f28660 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:17.825502 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dedfe5-9625-447f-8634-ac0a50f28660 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:17.825968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dedfe5-9625-447f-8634-ac0a50f28660 None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:17.827054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dedfe5-9625-447f-8634-ac0a50f28660 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:17.827580 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dedfe5-9625-447f-8634-ac0a50f28660 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:17.829343 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dedfe5-9625-447f-8634-ac0a50f28660 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:17.837090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d582b07-2348-43d5-8927-f512a6d270c1 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:17.842914 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 305/611] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:17.849427 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dedfe5-9625-447f-8634-ac0a50f28660 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:17.871931 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b640c-2216-47e9-b424-36cd86e76bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:17.872631 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b640c-2216-47e9-b424-36cd86e76bd7 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:17.872909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b640c-2216-47e9-b424-36cd86e76bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:17.873182 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b640c-2216-47e9-b424-36cd86e76bd7 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:17.875316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b640c-2216-47e9-b424-36cd86e76bd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:17.875316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b640c-2216-47e9-b424-36cd86e76bd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:17.875750 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b640c-2216-47e9-b424-36cd86e76bd7 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:17.892175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 307/612] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:17.904297 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b640c-2216-47e9-b424-36cd86e76bd7 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:17.999972 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b640c-2216-47e9-b424-36cd86e76bd7 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:18.037012 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedae0d-78fe-4f17-8873-a035303ac2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:18.037819 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedae0d-78fe-4f17-8873-a035303ac2da None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:18.038098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedae0d-78fe-4f17-8873-a035303ac2da None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:18.038373 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedae0d-78fe-4f17-8873-a035303ac2da None admin] PATH_INFO: `/v3/users/swift` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:18.048477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dedfe5-9625-447f-8634-ac0a50f28660 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:18.051712 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dedae0d-78fe-4f17-8873-a035303ac2da None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:18.057376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dedae0d-78fe-4f17-8873-a035303ac2da None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:18.077226 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-9dedae0d-78fe-4f17-8873-a035303ac2da None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 12:39:18.079160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 308/613] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:39:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:18.084930 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedae0d-78fe-4f17-8873-a035303ac2da None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:18.114494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ff2f5-4928-4aec-a00c-ea61d416e319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:18.115503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ff2f5-4928-4aec-a00c-ea61d416e319 None admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:18.115791 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ff2f5-4928-4aec-a00c-ea61d416e319 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:18.116063 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ff2f5-4928-4aec-a00c-ea61d416e319 None admin] PATH_INFO: `/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/89a11da83d84467ca9ae04b9693beede/roles/63df47d6fc0740e6bc54a845c3f8a257` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:18.151960 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ff2f5-4928-4aec-a00c-ea61d416e319 None admin] RBAC: Authorizing `identity:create_grant(project_id=a08ee6d287714297a10248ad8e4522bc, user_id=89a11da83d84467ca9ae04b9693beede, role_id=63df47d6fc0740e6bc54a845c3f8a257)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:18.154211 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ff2f5-4928-4aec-a00c-ea61d416e319 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:18.181723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 306/614] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:39:17 2022] PUT /identity/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/89a11da83d84467ca9ae04b9693beede/roles/63df47d6fc0740e6bc54a845c3f8a257 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:18.199737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedae0d-78fe-4f17-8873-a035303ac2da None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:18.235385 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7977f-f15f-4ad9-a3e2-322e08d52957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:18.236066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7977f-f15f-4ad9-a3e2-322e08d52957 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:18.236377 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7977f-f15f-4ad9-a3e2-322e08d52957 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:18.236640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7977f-f15f-4ad9-a3e2-322e08d52957 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:18.237478 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7977f-f15f-4ad9-a3e2-322e08d52957 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:18.237784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7977f-f15f-4ad9-a3e2-322e08d52957 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:18.239290 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7977f-f15f-4ad9-a3e2-322e08d52957 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:18.259342 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 309/615] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Nov 2 12:39:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:18.265352 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ff2f5-4928-4aec-a00c-ea61d416e319 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:18.400387 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ff2f5-4928-4aec-a00c-ea61d416e319 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:18.443302 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d90b98-e0d4-4604-ac25-f0d9f76e16e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:18.444172 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d90b98-e0d4-4604-ac25-f0d9f76e16e4 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:18.444471 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d90b98-e0d4-4604-ac25-f0d9f76e16e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:18.444743 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d90b98-e0d4-4604-ac25-f0d9f76e16e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:18.455636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d90b98-e0d4-4604-ac25-f0d9f76e16e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:18.457118 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d90b98-e0d4-4604-ac25-f0d9f76e16e4 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:18.474527 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-a3d90b98-e0d4-4604-ac25-f0d9f76e16e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:18.476072 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 307/616] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:18.481853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7977f-f15f-4ad9-a3e2-322e08d52957 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:18.584934 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7977f-f15f-4ad9-a3e2-322e08d52957 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:18.622424 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ff14e-bb26-42e4-9560-a2bd93b5e3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:18.623197 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ff14e-bb26-42e4-9560-a2bd93b5e3f4 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:18.623395 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ff14e-bb26-42e4-9560-a2bd93b5e3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:18.623638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ff14e-bb26-42e4-9560-a2bd93b5e3f4 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:18.624491 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ff14e-bb26-42e4-9560-a2bd93b5e3f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:18.624807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ff14e-bb26-42e4-9560-a2bd93b5e3f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:18.626220 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ff14e-bb26-42e4-9560-a2bd93b5e3f4 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:18.638902 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 310/617] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:18.644554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d90b98-e0d4-4604-ac25-f0d9f76e16e4 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:18.744167 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d90b98-e0d4-4604-ac25-f0d9f76e16e4 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:18.778292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21251ca1-a2ab-4090-9b77-b644bde31721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:18.779096 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21251ca1-a2ab-4090-9b77-b644bde31721 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:18.779378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21251ca1-a2ab-4090-9b77-b644bde31721 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:18.779650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21251ca1-a2ab-4090-9b77-b644bde31721 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:18.786704 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21251ca1-a2ab-4090-9b77-b644bde31721 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:18.788175 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21251ca1-a2ab-4090-9b77-b644bde31721 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:18.801354 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-21251ca1-a2ab-4090-9b77-b644bde31721 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:18.802836 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 308/618] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:18.808536 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ff14e-bb26-42e4-9560-a2bd93b5e3f4 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:18.908489 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ff14e-bb26-42e4-9560-a2bd93b5e3f4 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:18.941438 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c3970-5370-4601-94f6-1eefb7b28e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:18.942102 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c3970-5370-4601-94f6-1eefb7b28e3d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:18.942380 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c3970-5370-4601-94f6-1eefb7b28e3d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:18.942648 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c3970-5370-4601-94f6-1eefb7b28e3d None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:18.943463 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c3970-5370-4601-94f6-1eefb7b28e3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:18.943768 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c3970-5370-4601-94f6-1eefb7b28e3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:18.945221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c3970-5370-4601-94f6-1eefb7b28e3d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:18.957583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 311/619] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:18.963387 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21251ca1-a2ab-4090-9b77-b644bde31721 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:19.020401 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447defa-a824-41f6-afc6-8f10599dc242 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:19.021150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447defa-a824-41f6-afc6-8f10599dc242 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:19.021654 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447defa-a824-41f6-afc6-8f10599dc242 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:19.024057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 312/620] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:19.030070 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c820f6d-abf3-42ad-b190-dd8100b4daf0 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:19.030643 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c820f6d-abf3-42ad-b190-dd8100b4daf0 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:19.031136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c820f6d-abf3-42ad-b190-dd8100b4daf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:19.052905 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-9c820f6d-abf3-42ad-b190-dd8100b4daf0 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:19.055655 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-9c820f6d-abf3-42ad-b190-dd8100b4daf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:19.152636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21251ca1-a2ab-4090-9b77-b644bde31721 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:19.179654 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 313/621] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:19.208884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef4df8-3a1a-427b-b07f-43af874477d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:19.210188 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef4df8-3a1a-427b-b07f-43af874477d6 None admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:19.210680 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef4df8-3a1a-427b-b07f-43af874477d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:19.211148 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef4df8-3a1a-427b-b07f-43af874477d6 None admin] PATH_INFO: `/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/baece5d60fe6407989b460fc6b747f6c/roles/63df47d6fc0740e6bc54a845c3f8a257` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:19.229546 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef4df8-3a1a-427b-b07f-43af874477d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a08ee6d287714297a10248ad8e4522bc, user_id=baece5d60fe6407989b460fc6b747f6c, role_id=63df47d6fc0740e6bc54a845c3f8a257)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:19.231112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef4df8-3a1a-427b-b07f-43af874477d6 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:19.234171 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c820f6d-abf3-42ad-b190-dd8100b4daf0 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:19.254616 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 309/622] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:39:18 2022] PUT /identity/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/baece5d60fe6407989b460fc6b747f6c/roles/63df47d6fc0740e6bc54a845c3f8a257 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:19.350234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c820f6d-abf3-42ad-b190-dd8100b4daf0 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:19.388560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1526e-747f-4640-9946-f80c65b0bbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:19.389759 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1526e-747f-4640-9946-f80c65b0bbe2 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:19.390229 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1526e-747f-4640-9946-f80c65b0bbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:19.390695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1526e-747f-4640-9946-f80c65b0bbe2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:19.402709 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1526e-747f-4640-9946-f80c65b0bbe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:19.410702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-58c1526e-747f-4640-9946-f80c65b0bbe2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:19.412778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 314/623] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:19.421502 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef4df8-3a1a-427b-b07f-43af874477d6 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:19.535115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef4df8-3a1a-427b-b07f-43af874477d6 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:19.571866 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb33f2-717c-44b9-bed6-803a74c82a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:19.572602 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb33f2-717c-44b9-bed6-803a74c82a98 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:19.572882 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb33f2-717c-44b9-bed6-803a74c82a98 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:19.573152 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb33f2-717c-44b9-bed6-803a74c82a98 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:19.573933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb33f2-717c-44b9-bed6-803a74c82a98 None admin] RBAC: Adding query filter params (name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:19.574235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb33f2-717c-44b9-bed6-803a74c82a98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:19.575604 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb33f2-717c-44b9-bed6-803a74c82a98 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:19.587516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 310/624] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:19.593787 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1526e-747f-4640-9946-f80c65b0bbe2 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:19.699968 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1526e-747f-4640-9946-f80c65b0bbe2 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:19.735475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348167fe-13c0-4b26-b793-e7cc58434811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:19.736686 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348167fe-13c0-4b26-b793-e7cc58434811 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:19.737340 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348167fe-13c0-4b26-b793-e7cc58434811 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:19.737802 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348167fe-13c0-4b26-b793-e7cc58434811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:19.749026 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348167fe-13c0-4b26-b793-e7cc58434811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:19.750771 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348167fe-13c0-4b26-b793-e7cc58434811 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:19.767859 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-348167fe-13c0-4b26-b793-e7cc58434811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:19.769794 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 315/625] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:19.775666 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb33f2-717c-44b9-bed6-803a74c82a98 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:19.815270 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563acad-4c7d-4155-b698-3379ea97381b None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:19.815932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563acad-4c7d-4155-b698-3379ea97381b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:19.816448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563acad-4c7d-4155-b698-3379ea97381b None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:19.818607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 316/626] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:19.824251 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c953e8d-0cef-4983-a978-9374efd477c4 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:19.824849 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c953e8d-0cef-4983-a978-9374efd477c4 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:19.825403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c953e8d-0cef-4983-a978-9374efd477c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:19.843180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-2c953e8d-0cef-4983-a978-9374efd477c4 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:19.844779 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2c953e8d-0cef-4983-a978-9374efd477c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:19.913401 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 317/627] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:19.927094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb33f2-717c-44b9-bed6-803a74c82a98 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:19.948382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c953e8d-0cef-4983-a978-9374efd477c4 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:19.982356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4985a7-d553-4a86-b133-e5e068b32941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:19.982987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4985a7-d553-4a86-b133-e5e068b32941 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:19.983220 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4985a7-d553-4a86-b133-e5e068b32941 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:19.983574 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4985a7-d553-4a86-b133-e5e068b32941 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:19.984401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4985a7-d553-4a86-b133-e5e068b32941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:19.984704 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4985a7-d553-4a86-b133-e5e068b32941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:19.986075 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4985a7-d553-4a86-b133-e5e068b32941 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:20.009653 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 311/628] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:20.017127 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4985a7-d553-4a86-b133-e5e068b32941 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:20.067196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c953e8d-0cef-4983-a978-9374efd477c4 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:20.104838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84454b-e7e4-4bb4-bf34-5078260fba2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:20.106658 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84454b-e7e4-4bb4-bf34-5078260fba2f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:20.107147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84454b-e7e4-4bb4-bf34-5078260fba2f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:20.107618 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84454b-e7e4-4bb4-bf34-5078260fba2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:20.119156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84454b-e7e4-4bb4-bf34-5078260fba2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:20.127970 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-3f84454b-e7e4-4bb4-bf34-5078260fba2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:20.130856 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 318/629] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:20.136297 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84454b-e7e4-4bb4-bf34-5078260fba2f None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:20.246559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84454b-e7e4-4bb4-bf34-5078260fba2f None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:20.256423 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4985a7-d553-4a86-b133-e5e068b32941 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:20.302109 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a76c2-5338-415e-b9f5-3c3e3e0a8d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:20.303779 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a76c2-5338-415e-b9f5-3c3e3e0a8d02 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:20.304887 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a76c2-5338-415e-b9f5-3c3e3e0a8d02 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:20.305405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a76c2-5338-415e-b9f5-3c3e3e0a8d02 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:20.306491 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a76c2-5338-415e-b9f5-3c3e3e0a8d02 None admin] RBAC: Adding query filter params (name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:20.308078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a76c2-5338-415e-b9f5-3c3e3e0a8d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:20.311165 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a76c2-5338-415e-b9f5-3c3e3e0a8d02 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:20.326900 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb530b88-654a-4f89-8389-2a3c89b5def8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:20.328169 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb530b88-654a-4f89-8389-2a3c89b5def8 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:20.328666 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb530b88-654a-4f89-8389-2a3c89b5def8 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:20.329150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb530b88-654a-4f89-8389-2a3c89b5def8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:20.330217 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 319/630] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:20.332842 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a76c2-5338-415e-b9f5-3c3e3e0a8d02 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:20.345234 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb530b88-654a-4f89-8389-2a3c89b5def8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:20.346697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb530b88-654a-4f89-8389-2a3c89b5def8 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:20.371713 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-fb530b88-654a-4f89-8389-2a3c89b5def8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:39:20.373345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 312/631] 10.222.0.90 () {56 vars in 1093 bytes} [Wed Nov 2 12:39:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:20.380561 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb530b88-654a-4f89-8389-2a3c89b5def8 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:20.443979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a76c2-5338-415e-b9f5-3c3e3e0a8d02 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:20.478560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47806d22-c4f9-4270-aa96-9e407a6ce110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:20.479393 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47806d22-c4f9-4270-aa96-9e407a6ce110 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:20.479680 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47806d22-c4f9-4270-aa96-9e407a6ce110 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:20.479978 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47806d22-c4f9-4270-aa96-9e407a6ce110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:20.494216 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47806d22-c4f9-4270-aa96-9e407a6ce110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:20.495773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47806d22-c4f9-4270-aa96-9e407a6ce110 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:20.513593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-47806d22-c4f9-4270-aa96-9e407a6ce110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:20.515224 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 320/632] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:20.516641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33cedc-b1bc-4e17-baa3-cdadecd84879 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:20.516922 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33cedc-b1bc-4e17-baa3-cdadecd84879 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:20.517198 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33cedc-b1bc-4e17-baa3-cdadecd84879 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:20.519184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb530b88-654a-4f89-8389-2a3c89b5def8 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:20.519308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 321/633] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:20.524379 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be699efc-f22e-468f-be9f-0a6aebc5f482 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:20.524662 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be699efc-f22e-468f-be9f-0a6aebc5f482 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:20.524968 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be699efc-f22e-468f-be9f-0a6aebc5f482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:20.545079 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-be699efc-f22e-468f-be9f-0a6aebc5f482 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:20.546677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-be699efc-f22e-468f-be9f-0a6aebc5f482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:20.583305 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec0411-66f9-4c70-a7af-b24a714e1e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:20.584507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec0411-66f9-4c70-a7af-b24a714e1e36 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:20.584985 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec0411-66f9-4c70-a7af-b24a714e1e36 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:20.585462 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec0411-66f9-4c70-a7af-b24a714e1e36 None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:20.588908 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec0411-66f9-4c70-a7af-b24a714e1e36 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:20.589735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec0411-66f9-4c70-a7af-b24a714e1e36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:20.592668 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec0411-66f9-4c70-a7af-b24a714e1e36 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:20.622911 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 313/634] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Nov 2 12:39:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:20.623760 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec0411-66f9-4c70-a7af-b24a714e1e36 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:20.637279 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 322/635] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:39:20.644970 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be699efc-f22e-468f-be9f-0a6aebc5f482 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:20.783824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be699efc-f22e-468f-be9f-0a6aebc5f482 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:20.818481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec0411-66f9-4c70-a7af-b24a714e1e36 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:20.820236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae0a4d-4e17-40f5-9450-088a1069913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:20.820906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae0a4d-4e17-40f5-9450-088a1069913f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:20.821188 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae0a4d-4e17-40f5-9450-088a1069913f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:20.821459 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae0a4d-4e17-40f5-9450-088a1069913f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:20.880223 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9119cc7-212b-4588-abd6-85dde515fc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:20.881245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9119cc7-212b-4588-abd6-85dde515fc0a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:20.881579 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9119cc7-212b-4588-abd6-85dde515fc0a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:20.881905 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9119cc7-212b-4588-abd6-85dde515fc0a None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:20.882632 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9119cc7-212b-4588-abd6-85dde515fc0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:20.882933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9119cc7-212b-4588-abd6-85dde515fc0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:20.887579 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9119cc7-212b-4588-abd6-85dde515fc0a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:20.900862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae0a4d-4e17-40f5-9450-088a1069913f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:20.902362 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae0a4d-4e17-40f5-9450-088a1069913f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:20.903326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 314/636] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:20.904191 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9119cc7-212b-4588-abd6-85dde515fc0a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:21.028231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9119cc7-212b-4588-abd6-85dde515fc0a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:21.044515 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 323/637] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:21.045583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae0a4d-4e17-40f5-9450-088a1069913f None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:21.072227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8da8c6-64eb-49bc-8123-2409d21da2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:21.072227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8da8c6-64eb-49bc-8123-2409d21da2b2 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:21.072227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8da8c6-64eb-49bc-8123-2409d21da2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:21.072227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8da8c6-64eb-49bc-8123-2409d21da2b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:21.095011 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8da8c6-64eb-49bc-8123-2409d21da2b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:21.104239 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-4b8da8c6-64eb-49bc-8123-2409d21da2b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:21.116226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 315/638] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:21.116226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8da8c6-64eb-49bc-8123-2409d21da2b2 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:21.203317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae0a4d-4e17-40f5-9450-088a1069913f None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:21.234719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8da8c6-64eb-49bc-8123-2409d21da2b2 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:21.247685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605013fe-23f5-4fa1-ae15-6b2d88a03c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:21.248511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605013fe-23f5-4fa1-ae15-6b2d88a03c42 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:21.248786 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605013fe-23f5-4fa1-ae15-6b2d88a03c42 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:21.249051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605013fe-23f5-4fa1-ae15-6b2d88a03c42 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:21.258142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605013fe-23f5-4fa1-ae15-6b2d88a03c42 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:21.259594 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605013fe-23f5-4fa1-ae15-6b2d88a03c42 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:21.275212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff13d74-835b-4453-b047-1f99f4949fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:21.275394 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-605013fe-23f5-4fa1-ae15-6b2d88a03c42 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 12:39:21.276609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff13d74-835b-4453-b047-1f99f4949fea None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:21.277356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff13d74-835b-4453-b047-1f99f4949fea None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:21.277847 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff13d74-835b-4453-b047-1f99f4949fea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:21.281916 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 324/639] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:39:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:21.282827 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605013fe-23f5-4fa1-ae15-6b2d88a03c42 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:21.298920 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff13d74-835b-4453-b047-1f99f4949fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:21.301607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff13d74-835b-4453-b047-1f99f4949fea None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:21.323110 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-0ff13d74-835b-4453-b047-1f99f4949fea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:21.325694 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 316/640] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:21.327469 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2931e-fc97-42c3-b576-bf4ad62818e9 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:21.328225 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2931e-fc97-42c3-b576-bf4ad62818e9 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:21.328667 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2931e-fc97-42c3-b576-bf4ad62818e9 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:21.331504 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 317/641] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:21.332710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2931e-fc97-42c3-b576-bf4ad62818e9 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:21.400125 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605013fe-23f5-4fa1-ae15-6b2d88a03c42 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:21.442863 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee694c2a-b3bc-4d02-ae4c-78251c631c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:21.443539 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee694c2a-b3bc-4d02-ae4c-78251c631c94 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:21.443862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee694c2a-b3bc-4d02-ae4c-78251c631c94 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:21.444131 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee694c2a-b3bc-4d02-ae4c-78251c631c94 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:21.444924 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee694c2a-b3bc-4d02-ae4c-78251c631c94 None admin] RBAC: Adding query filter params (name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:21.445225 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee694c2a-b3bc-4d02-ae4c-78251c631c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:21.446923 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee694c2a-b3bc-4d02-ae4c-78251c631c94 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:21.456541 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 325/642] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:21.457684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee694c2a-b3bc-4d02-ae4c-78251c631c94 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:21.470477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2931e-fc97-42c3-b576-bf4ad62818e9 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:21.509809 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731a90e-fa1f-4a30-8ff9-e7fc4e32407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:21.510516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731a90e-fa1f-4a30-8ff9-e7fc4e32407d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:21.510792 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731a90e-fa1f-4a30-8ff9-e7fc4e32407d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:21.511062 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731a90e-fa1f-4a30-8ff9-e7fc4e32407d None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:21.511951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731a90e-fa1f-4a30-8ff9-e7fc4e32407d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:21.512388 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731a90e-fa1f-4a30-8ff9-e7fc4e32407d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:21.513826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731a90e-fa1f-4a30-8ff9-e7fc4e32407d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:21.531572 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 318/643] 10.222.0.90 () {56 vars in 1137 bytes} [Wed Nov 2 12:39:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:21.532965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d020c-98a1-4cae-b58c-1a6343f16844 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:21.533305 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d020c-98a1-4cae-b58c-1a6343f16844 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:21.533581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d020c-98a1-4cae-b58c-1a6343f16844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:21.550485 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-c95d020c-98a1-4cae-b58c-1a6343f16844 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:21.551824 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c95d020c-98a1-4cae-b58c-1a6343f16844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:21.566187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee694c2a-b3bc-4d02-ae4c-78251c631c94 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:21.602265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb614df-dd1a-45d8-adae-1b023afb62ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:21.603273 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb614df-dd1a-45d8-adae-1b023afb62ba None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:21.603739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb614df-dd1a-45d8-adae-1b023afb62ba None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:21.604238 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb614df-dd1a-45d8-adae-1b023afb62ba None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:21.605191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb614df-dd1a-45d8-adae-1b023afb62ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:21.605700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb614df-dd1a-45d8-adae-1b023afb62ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:21.607300 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb614df-dd1a-45d8-adae-1b023afb62ba None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:21.617940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 319/644] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:21.618784 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d020c-98a1-4cae-b58c-1a6343f16844 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:21.619893 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 326/645] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:21.621024 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb614df-dd1a-45d8-adae-1b023afb62ba None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:21.720922 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d020c-98a1-4cae-b58c-1a6343f16844 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:21.739651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb614df-dd1a-45d8-adae-1b023afb62ba None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:21.753414 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c046949-c32b-44e1-803b-32d7c93de184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:21.754316 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c046949-c32b-44e1-803b-32d7c93de184 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:21.754594 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c046949-c32b-44e1-803b-32d7c93de184 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:21.754861 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c046949-c32b-44e1-803b-32d7c93de184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:21.765357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c046949-c32b-44e1-803b-32d7c93de184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:21.766881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c046949-c32b-44e1-803b-32d7c93de184 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:21.774735 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968863e-971d-4854-ba39-cdcb85c12c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:21.775312 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968863e-971d-4854-ba39-cdcb85c12c6d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:21.775592 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968863e-971d-4854-ba39-cdcb85c12c6d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:21.775864 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968863e-971d-4854-ba39-cdcb85c12c6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:21.785409 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-9c046949-c32b-44e1-803b-32d7c93de184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:21.791590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 320/646] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:21.791590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c046949-c32b-44e1-803b-32d7c93de184 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:21.851624 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968863e-971d-4854-ba39-cdcb85c12c6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:21.853184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968863e-971d-4854-ba39-cdcb85c12c6d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:21.885297 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c046949-c32b-44e1-803b-32d7c93de184 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:21.918020 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326741b-c517-4b6b-be60-d99843eee7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:21.918815 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326741b-c517-4b6b-be60-d99843eee7ce None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:21.919089 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326741b-c517-4b6b-be60-d99843eee7ce None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:21.919353 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326741b-c517-4b6b-be60-d99843eee7ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:21.926260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326741b-c517-4b6b-be60-d99843eee7ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:21.927675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326741b-c517-4b6b-be60-d99843eee7ce None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:21.940990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c326741b-c517-4b6b-be60-d99843eee7ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:21.942267 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 321/647] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:21.943039 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326741b-c517-4b6b-be60-d99843eee7ce None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:21.960999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 327/648] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:21.960999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968863e-971d-4854-ba39-cdcb85c12c6d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:22.044246 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326741b-c517-4b6b-be60-d99843eee7ce None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:22.057078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968863e-971d-4854-ba39-cdcb85c12c6d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:22.082024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3921ee3-2b96-4914-9152-e6920f506cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:22.082835 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3921ee3-2b96-4914-9152-e6920f506cec None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:22.083110 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3921ee3-2b96-4914-9152-e6920f506cec None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:22.083380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3921ee3-2b96-4914-9152-e6920f506cec None admin] PATH_INFO: `/v3/roles/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:22.093788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bd158-2eba-49d0-87af-25da7eb3eb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:22.094177 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3921ee3-2b96-4914-9152-e6920f506cec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:22.094468 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd158-2eba-49d0-87af-25da7eb3eb2b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:22.094749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd158-2eba-49d0-87af-25da7eb3eb2b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:22.095020 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd158-2eba-49d0-87af-25da7eb3eb2b None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:22.095786 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bd158-2eba-49d0-87af-25da7eb3eb2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:22.096093 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bd158-2eba-49d0-87af-25da7eb3eb2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:22.097504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bd158-2eba-49d0-87af-25da7eb3eb2b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:22.101206 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-b3921ee3-2b96-4914-9152-e6920f506cec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:22.107687 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 322/649] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:22.107687 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3921ee3-2b96-4914-9152-e6920f506cec None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:22.110865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 328/650] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:22.110865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bd158-2eba-49d0-87af-25da7eb3eb2b None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:22.208965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3921ee3-2b96-4914-9152-e6920f506cec None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:22.215614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bd158-2eba-49d0-87af-25da7eb3eb2b None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:22.242968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ddfc9-7f76-4316-ac01-4ce96f0dd17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:22.243682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ddfc9-7f76-4316-ac01-4ce96f0dd17d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:22.243963 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ddfc9-7f76-4316-ac01-4ce96f0dd17d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:22.244230 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ddfc9-7f76-4316-ac01-4ce96f0dd17d None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:22.245100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ddfc9-7f76-4316-ac01-4ce96f0dd17d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:22.245404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ddfc9-7f76-4316-ac01-4ce96f0dd17d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:22.246915 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ddfc9-7f76-4316-ac01-4ce96f0dd17d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:22.249043 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed50bf0-3789-4ac0-9a3c-de05486777a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:22.249851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed50bf0-3789-4ac0-9a3c-de05486777a3 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:22.250127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed50bf0-3789-4ac0-9a3c-de05486777a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:22.250396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed50bf0-3789-4ac0-9a3c-de05486777a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:22.258887 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 323/651] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:22.259832 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ddfc9-7f76-4316-ac01-4ce96f0dd17d None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:22.261702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed50bf0-3789-4ac0-9a3c-de05486777a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:22.263166 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed50bf0-3789-4ac0-9a3c-de05486777a3 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:22.280305 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-bed50bf0-3789-4ac0-9a3c-de05486777a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:22.281441 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 329/652] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:22.282209 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed50bf0-3789-4ac0-9a3c-de05486777a3 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:22.363003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ddfc9-7f76-4316-ac01-4ce96f0dd17d None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:22.380530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed50bf0-3789-4ac0-9a3c-de05486777a3 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:22.395573 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb049b-5115-42c1-8954-14e8990624a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:22.396267 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb049b-5115-42c1-8954-14e8990624a2 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:22.396569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb049b-5115-42c1-8954-14e8990624a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:22.396835 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb049b-5115-42c1-8954-14e8990624a2 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:22.397569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb049b-5115-42c1-8954-14e8990624a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:22.397868 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb049b-5115-42c1-8954-14e8990624a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:22.399249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb049b-5115-42c1-8954-14e8990624a2 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:22.407799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 324/653] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:22.408897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57daff-c9fb-4dec-9a6e-9db535a21e5c None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:22.409188 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57daff-c9fb-4dec-9a6e-9db535a21e5c None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:22.409460 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57daff-c9fb-4dec-9a6e-9db535a21e5c None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:22.411065 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 325/654] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:22.411762 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57daff-c9fb-4dec-9a6e-9db535a21e5c None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:22.417956 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeff441-5f6a-4369-a8b3-93767559c7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:22.418772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeff441-5f6a-4369-a8b3-93767559c7b0 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:22.419045 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeff441-5f6a-4369-a8b3-93767559c7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:22.419312 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeff441-5f6a-4369-a8b3-93767559c7b0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:22.427282 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeff441-5f6a-4369-a8b3-93767559c7b0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:22.428768 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeff441-5f6a-4369-a8b3-93767559c7b0 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:22.442640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-aaeff441-5f6a-4369-a8b3-93767559c7b0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 12:39:22.443812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 330/655] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:39:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:22.444611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeff441-5f6a-4369-a8b3-93767559c7b0 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:22.515131 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57daff-c9fb-4dec-9a6e-9db535a21e5c None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:22.541316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeff441-5f6a-4369-a8b3-93767559c7b0 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:22.549359 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dd3d2-3bed-49f2-9801-11ef83ecdc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:22.550044 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dd3d2-3bed-49f2-9801-11ef83ecdc88 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:22.550336 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dd3d2-3bed-49f2-9801-11ef83ecdc88 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:22.550610 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dd3d2-3bed-49f2-9801-11ef83ecdc88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:22.551487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dd3d2-3bed-49f2-9801-11ef83ecdc88 None admin] RBAC: Adding query filter params (role.id=63df47d6fc0740e6bc54a845c3f8a257, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=fbcda58f298444eebf4f08ce01deffc0) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:22.551799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dd3d2-3bed-49f2-9801-11ef83ecdc88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:22.553292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dd3d2-3bed-49f2-9801-11ef83ecdc88 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:22.559160 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 326/656] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:22 2022] GET /identity/v3/role_assignments?user.id=fbcda58f298444eebf4f08ce01deffc0&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=63df47d6fc0740e6bc54a845c3f8a257 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:22.559966 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dd3d2-3bed-49f2-9801-11ef83ecdc88 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:22.574328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91881e-f7cd-4aca-82b1-ea145ebf56d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:22.575064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91881e-f7cd-4aca-82b1-ea145ebf56d8 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:22.575353 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91881e-f7cd-4aca-82b1-ea145ebf56d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:22.575623 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91881e-f7cd-4aca-82b1-ea145ebf56d8 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:22.576388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91881e-f7cd-4aca-82b1-ea145ebf56d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:22.576700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91881e-f7cd-4aca-82b1-ea145ebf56d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:22.578330 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91881e-f7cd-4aca-82b1-ea145ebf56d8 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:22.591437 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 331/657] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:22.593121 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e05613-7adf-4000-8c6f-38eb4dfd8365 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:22.593359 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e05613-7adf-4000-8c6f-38eb4dfd8365 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:22.593640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e05613-7adf-4000-8c6f-38eb4dfd8365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:22.611572 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-75e05613-7adf-4000-8c6f-38eb4dfd8365 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:22.612797 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-75e05613-7adf-4000-8c6f-38eb4dfd8365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:22.696231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 332/658] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:22.696231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e05613-7adf-4000-8c6f-38eb4dfd8365 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:22.696519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dd3d2-3bed-49f2-9801-11ef83ecdc88 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:22.721063 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a129b-3688-4ba3-93e8-e392669ecad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:22.722006 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a129b-3688-4ba3-93e8-e392669ecad1 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:22.722366 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a129b-3688-4ba3-93e8-e392669ecad1 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:22.722710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a129b-3688-4ba3-93e8-e392669ecad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:22.734216 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a129b-3688-4ba3-93e8-e392669ecad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:22.735902 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a129b-3688-4ba3-93e8-e392669ecad1 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:22.753310 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-f06a129b-3688-4ba3-93e8-e392669ecad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:22.754537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 327/659] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:22.755316 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a129b-3688-4ba3-93e8-e392669ecad1 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:22.804698 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e05613-7adf-4000-8c6f-38eb4dfd8365 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:22.842206 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098fe3c-d9fd-4e11-b2e6-8b2cfee94e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:22.843040 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098fe3c-d9fd-4e11-b2e6-8b2cfee94e68 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:22.843343 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098fe3c-d9fd-4e11-b2e6-8b2cfee94e68 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:22.843611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098fe3c-d9fd-4e11-b2e6-8b2cfee94e68 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:22.844506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098fe3c-d9fd-4e11-b2e6-8b2cfee94e68 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:22.844823 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098fe3c-d9fd-4e11-b2e6-8b2cfee94e68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:22.846395 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098fe3c-d9fd-4e11-b2e6-8b2cfee94e68 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:22.864453 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 333/660] 10.222.0.90 () {56 vars in 1137 bytes} [Wed Nov 2 12:39:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:22.865343 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098fe3c-d9fd-4e11-b2e6-8b2cfee94e68 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:22.878813 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a129b-3688-4ba3-93e8-e392669ecad1 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:22.912676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5092d34-f1aa-40a2-a572-9a3c73ba11c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:22.913497 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5092d34-f1aa-40a2-a572-9a3c73ba11c6 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:22.913774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5092d34-f1aa-40a2-a572-9a3c73ba11c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:22.914042 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5092d34-f1aa-40a2-a572-9a3c73ba11c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:22.921209 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5092d34-f1aa-40a2-a572-9a3c73ba11c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:22.922953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5092d34-f1aa-40a2-a572-9a3c73ba11c6 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:22.936374 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-d5092d34-f1aa-40a2-a572-9a3c73ba11c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:22.942281 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 328/661] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:22.942281 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5092d34-f1aa-40a2-a572-9a3c73ba11c6 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:22.965470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098fe3c-d9fd-4e11-b2e6-8b2cfee94e68 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:23.001361 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04870680-8f58-415b-97f1-500e4606ea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:23.002426 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04870680-8f58-415b-97f1-500e4606ea36 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:23.002707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04870680-8f58-415b-97f1-500e4606ea36 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:23.002980 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04870680-8f58-415b-97f1-500e4606ea36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:23.015038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04870680-8f58-415b-97f1-500e4606ea36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:23.022101 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-04870680-8f58-415b-97f1-500e4606ea36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:23.023452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 334/662] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:23.024045 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04870680-8f58-415b-97f1-500e4606ea36 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:23.042198 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5092d34-f1aa-40a2-a572-9a3c73ba11c6 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:23.075247 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b03c4-71fe-4367-9f93-b5089a130ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:23.076227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b03c4-71fe-4367-9f93-b5089a130ecd None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:23.076596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b03c4-71fe-4367-9f93-b5089a130ecd None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:23.076883 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b03c4-71fe-4367-9f93-b5089a130ecd None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:23.077765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b03c4-71fe-4367-9f93-b5089a130ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:23.078070 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b03c4-71fe-4367-9f93-b5089a130ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:23.079511 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b03c4-71fe-4367-9f93-b5089a130ecd None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:23.091151 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 329/663] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:23.092055 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b03c4-71fe-4367-9f93-b5089a130ecd None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:23.122451 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04870680-8f58-415b-97f1-500e4606ea36 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:23.157575 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907ca75-72ab-4dbb-b27a-e2ac59a4bd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:23.158517 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907ca75-72ab-4dbb-b27a-e2ac59a4bd4a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:23.158789 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907ca75-72ab-4dbb-b27a-e2ac59a4bd4a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:23.159168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907ca75-72ab-4dbb-b27a-e2ac59a4bd4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:23.199032 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b03c4-71fe-4367-9f93-b5089a130ecd None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:23.225130 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907ca75-72ab-4dbb-b27a-e2ac59a4bd4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:23.226530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907ca75-72ab-4dbb-b27a-e2ac59a4bd4a None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:23.236983 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16633374-7ec5-4654-8426-11c2a6f8922f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:23.237862 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16633374-7ec5-4654-8426-11c2a6f8922f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:23.238311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16633374-7ec5-4654-8426-11c2a6f8922f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:23.238785 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16633374-7ec5-4654-8426-11c2a6f8922f None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:23.239650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16633374-7ec5-4654-8426-11c2a6f8922f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:23.239962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16633374-7ec5-4654-8426-11c2a6f8922f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:23.241414 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16633374-7ec5-4654-8426-11c2a6f8922f None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:23.259141 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 330/664] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:23.259141 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16633374-7ec5-4654-8426-11c2a6f8922f None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:23.327792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 335/665] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:23.328390 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907ca75-72ab-4dbb-b27a-e2ac59a4bd4a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:23.356058 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16633374-7ec5-4654-8426-11c2a6f8922f None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:23.389335 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998c967-b1fe-44bd-b4c3-30363bfbcf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:23.390233 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998c967-b1fe-44bd-b4c3-30363bfbcf74 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:23.390486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998c967-b1fe-44bd-b4c3-30363bfbcf74 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:23.390755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998c967-b1fe-44bd-b4c3-30363bfbcf74 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:23.391506 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998c967-b1fe-44bd-b4c3-30363bfbcf74 None admin] RBAC: Adding query filter params (name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:23.391807 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998c967-b1fe-44bd-b4c3-30363bfbcf74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:23.393255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998c967-b1fe-44bd-b4c3-30363bfbcf74 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:23.404897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 331/666] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:23.404897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998c967-b1fe-44bd-b4c3-30363bfbcf74 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:23.430011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907ca75-72ab-4dbb-b27a-e2ac59a4bd4a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:23.466767 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60cec0-f517-4386-bc39-b5200b91f967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:23.467578 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60cec0-f517-4386-bc39-b5200b91f967 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:23.467937 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60cec0-f517-4386-bc39-b5200b91f967 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:23.468348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60cec0-f517-4386-bc39-b5200b91f967 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:23.475885 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60cec0-f517-4386-bc39-b5200b91f967 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:23.477324 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60cec0-f517-4386-bc39-b5200b91f967 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:23.491479 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-5d60cec0-f517-4386-bc39-b5200b91f967 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 12:39:23.492724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 336/667] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:23.493498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60cec0-f517-4386-bc39-b5200b91f967 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:23.501346 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998c967-b1fe-44bd-b4c3-30363bfbcf74 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:23.535221 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933902f-aa38-4f32-a617-002fd0dca92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:23.535875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933902f-aa38-4f32-a617-002fd0dca92c None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:23.536149 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933902f-aa38-4f32-a617-002fd0dca92c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:23.536471 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933902f-aa38-4f32-a617-002fd0dca92c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:23.537317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933902f-aa38-4f32-a617-002fd0dca92c None admin] RBAC: Adding query filter params (role.id=63df47d6fc0740e6bc54a845c3f8a257, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=0303312c6cec4067a4a92d38edb59086) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:23.537625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933902f-aa38-4f32-a617-002fd0dca92c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:23.539048 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933902f-aa38-4f32-a617-002fd0dca92c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:23.552453 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 332/668] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:23 2022] GET /identity/v3/role_assignments?user.id=0303312c6cec4067a4a92d38edb59086&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=63df47d6fc0740e6bc54a845c3f8a257 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:23.552453 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933902f-aa38-4f32-a617-002fd0dca92c None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:23.604212 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60cec0-f517-4386-bc39-b5200b91f967 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:23.639249 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0780ff9-fc2b-4e19-9a37-bdfd05fa5cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:23.640354 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0780ff9-fc2b-4e19-9a37-bdfd05fa5cb2 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:23.640697 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0780ff9-fc2b-4e19-9a37-bdfd05fa5cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:23.641029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0780ff9-fc2b-4e19-9a37-bdfd05fa5cb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:23.649930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933902f-aa38-4f32-a617-002fd0dca92c None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:23.653347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0780ff9-fc2b-4e19-9a37-bdfd05fa5cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:23.655006 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0780ff9-fc2b-4e19-9a37-bdfd05fa5cb2 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:23.672777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-f0780ff9-fc2b-4e19-9a37-bdfd05fa5cb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:23.678981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 337/669] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:23.680063 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0780ff9-fc2b-4e19-9a37-bdfd05fa5cb2 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:23.693041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76af74-e5fd-4cc4-8a56-1b422a4f1e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:23.694202 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76af74-e5fd-4cc4-8a56-1b422a4f1e0e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:23.694462 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76af74-e5fd-4cc4-8a56-1b422a4f1e0e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:23.694726 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76af74-e5fd-4cc4-8a56-1b422a4f1e0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:23.706691 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76af74-e5fd-4cc4-8a56-1b422a4f1e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:23.708195 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76af74-e5fd-4cc4-8a56-1b422a4f1e0e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:23.726020 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-0d76af74-e5fd-4cc4-8a56-1b422a4f1e0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:23.728045 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 333/670] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:23.728383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76af74-e5fd-4cc4-8a56-1b422a4f1e0e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:23.798661 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0780ff9-fc2b-4e19-9a37-bdfd05fa5cb2 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:23.842083 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8eb7f-2414-4fb6-a2f9-9af9d2ba6ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:23.842803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8eb7f-2414-4fb6-a2f9-9af9d2ba6ba4 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:23.843298 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8eb7f-2414-4fb6-a2f9-9af9d2ba6ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:23.843407 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8eb7f-2414-4fb6-a2f9-9af9d2ba6ba4 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:23.844278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8eb7f-2414-4fb6-a2f9-9af9d2ba6ba4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:23.844585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8eb7f-2414-4fb6-a2f9-9af9d2ba6ba4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:23.846041 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8eb7f-2414-4fb6-a2f9-9af9d2ba6ba4 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:23.849303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76af74-e5fd-4cc4-8a56-1b422a4f1e0e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:23.864672 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 338/671] 10.222.0.90 () {56 vars in 1139 bytes} [Wed Nov 2 12:39:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:23.865435 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8eb7f-2414-4fb6-a2f9-9af9d2ba6ba4 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:23.890966 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab40747-f4d8-4077-af6d-aca52387b4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:23.891782 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab40747-f4d8-4077-af6d-aca52387b4c4 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:23.891975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab40747-f4d8-4077-af6d-aca52387b4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:23.892301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab40747-f4d8-4077-af6d-aca52387b4c4 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:23.893026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab40747-f4d8-4077-af6d-aca52387b4c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:23.893337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab40747-f4d8-4077-af6d-aca52387b4c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:23.895216 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab40747-f4d8-4077-af6d-aca52387b4c4 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:23.909604 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 334/672] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:23.910758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab40747-f4d8-4077-af6d-aca52387b4c4 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:23.988833 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8eb7f-2414-4fb6-a2f9-9af9d2ba6ba4 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:24.031097 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab40747-f4d8-4077-af6d-aca52387b4c4 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:24.033068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11247a2-955f-40c6-8aa3-403a40ac4e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:24.034751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11247a2-955f-40c6-8aa3-403a40ac4e3c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:24.035236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11247a2-955f-40c6-8aa3-403a40ac4e3c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:24.035702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11247a2-955f-40c6-8aa3-403a40ac4e3c None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:24.036642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11247a2-955f-40c6-8aa3-403a40ac4e3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:24.037136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11247a2-955f-40c6-8aa3-403a40ac4e3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:24.038684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11247a2-955f-40c6-8aa3-403a40ac4e3c None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:24.053073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 339/673] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:24.054652 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11247a2-955f-40c6-8aa3-403a40ac4e3c None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:24.069076 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b705b-7a0f-43c6-9c0d-287dd50486ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:24.070185 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b705b-7a0f-43c6-9c0d-287dd50486ae None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:24.070579 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b705b-7a0f-43c6-9c0d-287dd50486ae None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:24.070935 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b705b-7a0f-43c6-9c0d-287dd50486ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:24.145107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b705b-7a0f-43c6-9c0d-287dd50486ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:24.146901 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b705b-7a0f-43c6-9c0d-287dd50486ae None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:24.180404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11247a2-955f-40c6-8aa3-403a40ac4e3c None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:24.213969 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4939d3-a17d-45d0-b1a4-b506469fc98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:24.215195 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4939d3-a17d-45d0-b1a4-b506469fc98d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:24.215697 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4939d3-a17d-45d0-b1a4-b506469fc98d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:24.216175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4939d3-a17d-45d0-b1a4-b506469fc98d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:24.223596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4939d3-a17d-45d0-b1a4-b506469fc98d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:24.225348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4939d3-a17d-45d0-b1a4-b506469fc98d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:24.239317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-9f4939d3-a17d-45d0-b1a4-b506469fc98d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:24.240839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 340/674] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:24.241808 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4939d3-a17d-45d0-b1a4-b506469fc98d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:24.266599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 335/675] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:24.267910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b705b-7a0f-43c6-9c0d-287dd50486ae None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:24.363088 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4939d3-a17d-45d0-b1a4-b506469fc98d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:24.365502 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b705b-7a0f-43c6-9c0d-287dd50486ae None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:24.400876 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc189c6e-b14b-4d6f-b26d-6beb14e89a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:24.402158 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189c6e-b14b-4d6f-b26d-6beb14e89a00 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:24.402627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189c6e-b14b-4d6f-b26d-6beb14e89a00 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:24.403498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189c6e-b14b-4d6f-b26d-6beb14e89a00 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:24.407447 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab52f90-d6bc-49fa-a1e8-97358724b0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:24.408216 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab52f90-d6bc-49fa-a1e8-97358724b0d8 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:24.408602 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab52f90-d6bc-49fa-a1e8-97358724b0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:24.408987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab52f90-d6bc-49fa-a1e8-97358724b0d8 None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:24.409841 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab52f90-d6bc-49fa-a1e8-97358724b0d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:24.410218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab52f90-d6bc-49fa-a1e8-97358724b0d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:24.411730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab52f90-d6bc-49fa-a1e8-97358724b0d8 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:24.412891 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc189c6e-b14b-4d6f-b26d-6beb14e89a00 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:24.414545 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc189c6e-b14b-4d6f-b26d-6beb14e89a00 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:24.426151 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 336/676] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:24.427014 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab52f90-d6bc-49fa-a1e8-97358724b0d8 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:24.429777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-dc189c6e-b14b-4d6f-b26d-6beb14e89a00 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 12:39:24.431933 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 341/677] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:39:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:24.433116 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc189c6e-b14b-4d6f-b26d-6beb14e89a00 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:24.543997 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc189c6e-b14b-4d6f-b26d-6beb14e89a00 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:24.557648 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab52f90-d6bc-49fa-a1e8-97358724b0d8 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:24.585884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb465bd-b446-4049-bc63-9d5783e08493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:24.587491 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb465bd-b446-4049-bc63-9d5783e08493 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:24.588063 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb465bd-b446-4049-bc63-9d5783e08493 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:24.588631 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb465bd-b446-4049-bc63-9d5783e08493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:24.589964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb465bd-b446-4049-bc63-9d5783e08493 None admin] RBAC: Adding query filter params (role.id=63df47d6fc0740e6bc54a845c3f8a257, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=2a6d1ff8ac3b408f87c4a9b8d7363e86) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:24.590535 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb465bd-b446-4049-bc63-9d5783e08493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:24.591359 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc00e0-2064-4454-889c-d588e76c1890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:24.592237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc00e0-2064-4454-889c-d588e76c1890 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:24.592590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc00e0-2064-4454-889c-d588e76c1890 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:24.592796 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb465bd-b446-4049-bc63-9d5783e08493 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:24.592921 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc00e0-2064-4454-889c-d588e76c1890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:24.600815 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 342/678] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:24 2022] GET /identity/v3/role_assignments?user.id=2a6d1ff8ac3b408f87c4a9b8d7363e86&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=63df47d6fc0740e6bc54a845c3f8a257 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:24.602389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb465bd-b446-4049-bc63-9d5783e08493 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:24.603709 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc00e0-2064-4454-889c-d588e76c1890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:24.605432 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc00e0-2064-4454-889c-d588e76c1890 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:24.624886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-d5dc00e0-2064-4454-889c-d588e76c1890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:24.626810 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 337/679] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:24.633622 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc00e0-2064-4454-889c-d588e76c1890 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:24.752396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc00e0-2064-4454-889c-d588e76c1890 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:24.793808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d9460-8b45-483e-9df7-a4bd21d5e6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:24.794555 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d9460-8b45-483e-9df7-a4bd21d5e6c2 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:24.794777 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d9460-8b45-483e-9df7-a4bd21d5e6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:24.795052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d9460-8b45-483e-9df7-a4bd21d5e6c2 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:24.795898 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d9460-8b45-483e-9df7-a4bd21d5e6c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:24.796329 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d9460-8b45-483e-9df7-a4bd21d5e6c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:24.803802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d9460-8b45-483e-9df7-a4bd21d5e6c2 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:24.828589 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 338/680] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:24.836802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d9460-8b45-483e-9df7-a4bd21d5e6c2 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:24.859460 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb465bd-b446-4049-bc63-9d5783e08493 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:24.912631 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b171591-04bf-4d6b-b42a-2225ac749160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:24.913473 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b171591-04bf-4d6b-b42a-2225ac749160 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:24.913751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b171591-04bf-4d6b-b42a-2225ac749160 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:24.914017 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b171591-04bf-4d6b-b42a-2225ac749160 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:24.915160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b171591-04bf-4d6b-b42a-2225ac749160 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:24.915469 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b171591-04bf-4d6b-b42a-2225ac749160 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:24.917474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b171591-04bf-4d6b-b42a-2225ac749160 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:24.944309 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 343/681] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Nov 2 12:39:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:24.949484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b171591-04bf-4d6b-b42a-2225ac749160 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:24.989603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d9460-8b45-483e-9df7-a4bd21d5e6c2 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:25.032592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec2862-3667-429f-bdc3-a59eaa4503e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:25.033407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec2862-3667-429f-bdc3-a59eaa4503e9 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:25.033697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec2862-3667-429f-bdc3-a59eaa4503e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:25.033987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec2862-3667-429f-bdc3-a59eaa4503e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:25.044236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec2862-3667-429f-bdc3-a59eaa4503e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:25.045947 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec2862-3667-429f-bdc3-a59eaa4503e9 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:25.059830 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-34ec2862-3667-429f-bdc3-a59eaa4503e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:25.061397 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 339/682] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:25.066481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044658e-27bc-4186-9703-759af9d48f60 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:25.066481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044658e-27bc-4186-9703-759af9d48f60 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:25.066481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044658e-27bc-4186-9703-759af9d48f60 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:25.066481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 340/683] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:25.070182 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044658e-27bc-4186-9703-759af9d48f60 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:25.091918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b171591-04bf-4d6b-b42a-2225ac749160 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:25.132378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01c216-d8aa-43e8-9f5f-aee38f34bcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:25.133135 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01c216-d8aa-43e8-9f5f-aee38f34bcdc None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:25.133379 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01c216-d8aa-43e8-9f5f-aee38f34bcdc None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:25.133655 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01c216-d8aa-43e8-9f5f-aee38f34bcdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:25.202682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01c216-d8aa-43e8-9f5f-aee38f34bcdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:25.204157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01c216-d8aa-43e8-9f5f-aee38f34bcdc None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:25.207134 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044658e-27bc-4186-9703-759af9d48f60 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:25.263360 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c657f8-4e62-4351-b91c-af46d6f410b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:25.264966 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c657f8-4e62-4351-b91c-af46d6f410b0 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:25.265614 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c657f8-4e62-4351-b91c-af46d6f410b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:25.266251 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c657f8-4e62-4351-b91c-af46d6f410b0 None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:25.267977 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c657f8-4e62-4351-b91c-af46d6f410b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:25.268739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c657f8-4e62-4351-b91c-af46d6f410b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:25.271607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c657f8-4e62-4351-b91c-af46d6f410b0 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:25.299774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 341/684] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:25.302239 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9c12c-9149-4bfa-956b-1f0580ac3db6 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:25.302948 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 344/685] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:25.303157 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9c12c-9149-4bfa-956b-1f0580ac3db6 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:25.303639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9c12c-9149-4bfa-956b-1f0580ac3db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:25.310476 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01c216-d8aa-43e8-9f5f-aee38f34bcdc None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:25.328796 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-42d9c12c-9149-4bfa-956b-1f0580ac3db6 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:25.330823 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-42d9c12c-9149-4bfa-956b-1f0580ac3db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:25.420096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01c216-d8aa-43e8-9f5f-aee38f34bcdc None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:25.438107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 342/686] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:25.439807 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9c12c-9149-4bfa-956b-1f0580ac3db6 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:25.458255 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e14b2e-7d29-4747-9f17-a63eca396a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:25.459091 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e14b2e-7d29-4747-9f17-a63eca396a00 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:25.459373 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e14b2e-7d29-4747-9f17-a63eca396a00 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:25.459652 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e14b2e-7d29-4747-9f17-a63eca396a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:25.480443 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e14b2e-7d29-4747-9f17-a63eca396a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:25.482327 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e14b2e-7d29-4747-9f17-a63eca396a00 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:25.503701 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-81e14b2e-7d29-4747-9f17-a63eca396a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:25.508482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 345/687] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:25.509599 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e14b2e-7d29-4747-9f17-a63eca396a00 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:25.586347 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9c12c-9149-4bfa-956b-1f0580ac3db6 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:25.615274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e14b2e-7d29-4747-9f17-a63eca396a00 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:25.628538 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ac6d4-2878-4259-948d-1a1bb8d506a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:25.629217 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ac6d4-2878-4259-948d-1a1bb8d506a0 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:25.629501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ac6d4-2878-4259-948d-1a1bb8d506a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:25.629780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ac6d4-2878-4259-948d-1a1bb8d506a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:25.630798 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ac6d4-2878-4259-948d-1a1bb8d506a0 None admin] RBAC: Adding query filter params (role.id=63df47d6fc0740e6bc54a845c3f8a257, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=89a11da83d84467ca9ae04b9693beede) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:25.631113 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ac6d4-2878-4259-948d-1a1bb8d506a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:25.633356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ac6d4-2878-4259-948d-1a1bb8d506a0 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:25.640800 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 343/688] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:25 2022] GET /identity/v3/role_assignments?user.id=89a11da83d84467ca9ae04b9693beede&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=63df47d6fc0740e6bc54a845c3f8a257 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:25.642543 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ac6d4-2878-4259-948d-1a1bb8d506a0 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:25.666514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37998d38-2b6d-4700-8e2f-f9136ebf180f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:25.668432 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37998d38-2b6d-4700-8e2f-f9136ebf180f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:25.670211 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37998d38-2b6d-4700-8e2f-f9136ebf180f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:25.670739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37998d38-2b6d-4700-8e2f-f9136ebf180f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:25.695707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37998d38-2b6d-4700-8e2f-f9136ebf180f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:25.707609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-37998d38-2b6d-4700-8e2f-f9136ebf180f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:39:25.707609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 346/689] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:39:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:25.713302 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37998d38-2b6d-4700-8e2f-f9136ebf180f None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:25.786919 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ac6d4-2878-4259-948d-1a1bb8d506a0 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:25.829021 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a7424-96c9-420b-81e1-27a9ee528839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:25.830149 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a7424-96c9-420b-81e1-27a9ee528839 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:25.830629 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a7424-96c9-420b-81e1-27a9ee528839 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:25.831130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a7424-96c9-420b-81e1-27a9ee528839 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:25.832085 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a7424-96c9-420b-81e1-27a9ee528839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:25.832625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a7424-96c9-420b-81e1-27a9ee528839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:25.834253 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a7424-96c9-420b-81e1-27a9ee528839 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:25.860097 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 344/690] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:25.878052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a7424-96c9-420b-81e1-27a9ee528839 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:25.895053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37998d38-2b6d-4700-8e2f-f9136ebf180f None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:25.945328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffea6c-1bab-45fe-a687-51e3893a29f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:25.945997 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffea6c-1bab-45fe-a687-51e3893a29f7 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:25.946278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffea6c-1bab-45fe-a687-51e3893a29f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:25.946554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffea6c-1bab-45fe-a687-51e3893a29f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:25.947309 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffea6c-1bab-45fe-a687-51e3893a29f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:25.947616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffea6c-1bab-45fe-a687-51e3893a29f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:25.949140 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffea6c-1bab-45fe-a687-51e3893a29f7 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:25.962451 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 347/691] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:39:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:25.963695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffea6c-1bab-45fe-a687-51e3893a29f7 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:25.998018 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a7424-96c9-420b-81e1-27a9ee528839 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:26.032215 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175967e-2e1b-4152-9633-ccd28fe7e59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:26.033409 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175967e-2e1b-4152-9633-ccd28fe7e59b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:26.034306 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175967e-2e1b-4152-9633-ccd28fe7e59b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:26.034783 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175967e-2e1b-4152-9633-ccd28fe7e59b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:26.042425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175967e-2e1b-4152-9633-ccd28fe7e59b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:26.044220 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175967e-2e1b-4152-9633-ccd28fe7e59b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:26.059692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-6175967e-2e1b-4152-9633-ccd28fe7e59b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:26.061617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 345/692] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:26.066248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffea6c-1bab-45fe-a687-51e3893a29f7 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:26.067627 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175967e-2e1b-4152-9633-ccd28fe7e59b None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:26.099849 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f07fc-db9f-4882-ba1c-ee89fb8ab800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:26.100716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f07fc-db9f-4882-ba1c-ee89fb8ab800 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:26.100995 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f07fc-db9f-4882-ba1c-ee89fb8ab800 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:26.101266 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f07fc-db9f-4882-ba1c-ee89fb8ab800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:26.112564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f07fc-db9f-4882-ba1c-ee89fb8ab800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:26.113968 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f07fc-db9f-4882-ba1c-ee89fb8ab800 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:26.131263 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-395f07fc-db9f-4882-ba1c-ee89fb8ab800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:26.136375 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 348/693] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:26.138720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f07fc-db9f-4882-ba1c-ee89fb8ab800 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:26.173657 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175967e-2e1b-4152-9633-ccd28fe7e59b None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:26.213581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ffef5-6ffb-4b7f-93f2-5f00a8fbe04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:26.214763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ffef5-6ffb-4b7f-93f2-5f00a8fbe04d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:26.215281 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ffef5-6ffb-4b7f-93f2-5f00a8fbe04d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:26.215760 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ffef5-6ffb-4b7f-93f2-5f00a8fbe04d None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:26.216849 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ffef5-6ffb-4b7f-93f2-5f00a8fbe04d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:26.217349 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ffef5-6ffb-4b7f-93f2-5f00a8fbe04d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:26.219121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ffef5-6ffb-4b7f-93f2-5f00a8fbe04d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:26.236486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 346/694] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:26.238726 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ffef5-6ffb-4b7f-93f2-5f00a8fbe04d None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:26.243946 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f07fc-db9f-4882-ba1c-ee89fb8ab800 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:26.278272 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a52621-89ea-49e8-8fde-c419c71b89a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:26.279009 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a52621-89ea-49e8-8fde-c419c71b89a6 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:26.279292 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a52621-89ea-49e8-8fde-c419c71b89a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:26.279568 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a52621-89ea-49e8-8fde-c419c71b89a6 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:26.280339 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a52621-89ea-49e8-8fde-c419c71b89a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:26.280649 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a52621-89ea-49e8-8fde-c419c71b89a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:26.282053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a52621-89ea-49e8-8fde-c419c71b89a6 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:26.299234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 349/695] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:26.300684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a52621-89ea-49e8-8fde-c419c71b89a6 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:26.359533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ffef5-6ffb-4b7f-93f2-5f00a8fbe04d None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:26.405774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a52621-89ea-49e8-8fde-c419c71b89a6 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:26.412743 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da394648-4c67-42cc-a0a9-73b5fc4a430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:26.413645 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da394648-4c67-42cc-a0a9-73b5fc4a430d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:26.414119 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da394648-4c67-42cc-a0a9-73b5fc4a430d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:26.414642 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da394648-4c67-42cc-a0a9-73b5fc4a430d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:26.415730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da394648-4c67-42cc-a0a9-73b5fc4a430d None admin] RBAC: Adding query filter params (role.id=63df47d6fc0740e6bc54a845c3f8a257, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=baece5d60fe6407989b460fc6b747f6c) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:26.416250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da394648-4c67-42cc-a0a9-73b5fc4a430d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:26.417923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da394648-4c67-42cc-a0a9-73b5fc4a430d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:26.424968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 347/696] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:26 2022] GET /identity/v3/role_assignments?user.id=baece5d60fe6407989b460fc6b747f6c&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=63df47d6fc0740e6bc54a845c3f8a257 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:26.431476 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13fd37-b70d-4dcc-96d0-1129dc5d5ad7 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:26.432311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13fd37-b70d-4dcc-96d0-1129dc5d5ad7 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:26.432876 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13fd37-b70d-4dcc-96d0-1129dc5d5ad7 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:26.435589 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 348/697] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:26.435765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903b9a3-5568-429e-bf73-166609b88877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:26.437021 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903b9a3-5568-429e-bf73-166609b88877 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:26.438187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903b9a3-5568-429e-bf73-166609b88877 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:26.438187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903b9a3-5568-429e-bf73-166609b88877 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:26.441524 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063b10f-06d4-4668-8e92-0b4b98393edd None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:26.442070 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063b10f-06d4-4668-8e92-0b4b98393edd None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:26.442643 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063b10f-06d4-4668-8e92-0b4b98393edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:26.446735 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903b9a3-5568-429e-bf73-166609b88877 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:26.448483 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903b9a3-5568-429e-bf73-166609b88877 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:26.464616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-7903b9a3-5568-429e-bf73-166609b88877 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:39:26.476227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-f063b10f-06d4-4668-8e92-0b4b98393edd None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:26.476408 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 350/698] 10.222.0.90 () {56 vars in 1093 bytes} [Wed Nov 2 12:39:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:26.476516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f063b10f-06d4-4668-8e92-0b4b98393edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:26.476589 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903b9a3-5568-429e-bf73-166609b88877 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:26.589626 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903b9a3-5568-429e-bf73-166609b88877 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:26.631373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 349/699] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:26.639064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3726ea6-53a5-44de-a9c4-c2a719ca838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:26.639751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3726ea6-53a5-44de-a9c4-c2a719ca838f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:26.640033 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3726ea6-53a5-44de-a9c4-c2a719ca838f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:26.640344 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3726ea6-53a5-44de-a9c4-c2a719ca838f None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:26.641252 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3726ea6-53a5-44de-a9c4-c2a719ca838f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:26.641566 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3726ea6-53a5-44de-a9c4-c2a719ca838f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:26.643103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3726ea6-53a5-44de-a9c4-c2a719ca838f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:26.668119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 351/700] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Nov 2 12:39:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:26.670045 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063b10f-06d4-4668-8e92-0b4b98393edd None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:26.674525 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3726ea6-53a5-44de-a9c4-c2a719ca838f None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:26.813517 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063b10f-06d4-4668-8e92-0b4b98393edd None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:26.818191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3726ea6-53a5-44de-a9c4-c2a719ca838f None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:26.858864 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a3fec-4c1b-4d33-8905-2cd874012ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:26.859526 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a3fec-4c1b-4d33-8905-2cd874012ca1 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:26.860001 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a3fec-4c1b-4d33-8905-2cd874012ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:26.860321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a3fec-4c1b-4d33-8905-2cd874012ca1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:26.860645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6459e-ce9e-4af7-b217-2d86e3136ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:26.861612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6459e-ce9e-4af7-b217-2d86e3136ec7 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:26.862079 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6459e-ce9e-4af7-b217-2d86e3136ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:26.862553 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6459e-ce9e-4af7-b217-2d86e3136ec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:26.873533 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6459e-ce9e-4af7-b217-2d86e3136ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:26.875470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6459e-ce9e-4af7-b217-2d86e3136ec7 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:26.897385 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-b4f6459e-ce9e-4af7-b217-2d86e3136ec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:26.900281 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 352/701] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:26.907437 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6459e-ce9e-4af7-b217-2d86e3136ec7 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:26.940361 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a3fec-4c1b-4d33-8905-2cd874012ca1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:26.941808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a3fec-4c1b-4d33-8905-2cd874012ca1 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:27.027426 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6459e-ce9e-4af7-b217-2d86e3136ec7 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:27.050143 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 350/702] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:27.051545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a3fec-4c1b-4d33-8905-2cd874012ca1 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:27.065274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9345722-8448-4308-9d7c-e0018a8aa4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:27.066359 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9345722-8448-4308-9d7c-e0018a8aa4ea None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:27.066832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9345722-8448-4308-9d7c-e0018a8aa4ea None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:27.067293 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9345722-8448-4308-9d7c-e0018a8aa4ea None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:27.068310 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9345722-8448-4308-9d7c-e0018a8aa4ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:27.068855 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9345722-8448-4308-9d7c-e0018a8aa4ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:27.070453 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9345722-8448-4308-9d7c-e0018a8aa4ea None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:27.084157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 353/703] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:27.090146 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9345722-8448-4308-9d7c-e0018a8aa4ea None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:27.157998 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a3fec-4c1b-4d33-8905-2cd874012ca1 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:27.189466 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9345722-8448-4308-9d7c-e0018a8aa4ea None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:27.193051 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da3ba0-f9e6-4882-b25f-531fe21b71e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:27.193800 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da3ba0-f9e6-4882-b25f-531fe21b71e8 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:27.194083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da3ba0-f9e6-4882-b25f-531fe21b71e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:27.194361 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da3ba0-f9e6-4882-b25f-531fe21b71e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:27.205581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da3ba0-f9e6-4882-b25f-531fe21b71e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:27.207130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da3ba0-f9e6-4882-b25f-531fe21b71e8 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:27.224628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-29da3ba0-f9e6-4882-b25f-531fe21b71e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:27.226104 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32e475-a68d-4415-bdd0-c7676a2aed02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:27.227035 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32e475-a68d-4415-bdd0-c7676a2aed02 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:27.227546 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32e475-a68d-4415-bdd0-c7676a2aed02 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:27.228001 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32e475-a68d-4415-bdd0-c7676a2aed02 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:27.228910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32e475-a68d-4415-bdd0-c7676a2aed02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:27.230492 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 351/704] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:27.230832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32e475-a68d-4415-bdd0-c7676a2aed02 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:27.231663 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da3ba0-f9e6-4882-b25f-531fe21b71e8 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:27.255878 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 354/705] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:39:27 2022] POST /identity/v3/users => generated 254 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:27.348428 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da3ba0-f9e6-4882-b25f-531fe21b71e8 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:27.384439 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc881854-6eb9-4250-90e7-3c1032b5b9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:27.385103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc881854-6eb9-4250-90e7-3c1032b5b9c5 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:27.385377 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc881854-6eb9-4250-90e7-3c1032b5b9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:27.385646 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc881854-6eb9-4250-90e7-3c1032b5b9c5 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:27.386454 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc881854-6eb9-4250-90e7-3c1032b5b9c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:27.386753 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc881854-6eb9-4250-90e7-3c1032b5b9c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:27.388420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc881854-6eb9-4250-90e7-3c1032b5b9c5 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:27.406729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 352/706] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:27.408387 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32e475-a68d-4415-bdd0-c7676a2aed02 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:27.448642 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d8e58-0bcd-41d7-9721-a18ee72a5ab5 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:27.448642 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d8e58-0bcd-41d7-9721-a18ee72a5ab5 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:27.448642 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d8e58-0bcd-41d7-9721-a18ee72a5ab5 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:27.448642 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 353/707] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:39:27.453439 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14952331-711a-4a08-9137-550c96ec5362 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:27.453800 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14952331-711a-4a08-9137-550c96ec5362 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:27.454516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14952331-711a-4a08-9137-550c96ec5362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:27.497605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-14952331-711a-4a08-9137-550c96ec5362 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:27.498858 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-14952331-711a-4a08-9137-550c96ec5362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:27.551796 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32e475-a68d-4415-bdd0-c7676a2aed02 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:27.590239 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2288c7-938e-4319-aa11-1d4611322c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:27.591402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2288c7-938e-4319-aa11-1d4611322c0f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:27.591887 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2288c7-938e-4319-aa11-1d4611322c0f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:27.592378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2288c7-938e-4319-aa11-1d4611322c0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:27.594440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 354/708] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:39:27.599701 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2288c7-938e-4319-aa11-1d4611322c0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:27.601248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2288c7-938e-4319-aa11-1d4611322c0f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:27.615230 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-4a2288c7-938e-4319-aa11-1d4611322c0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:27.616770 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 355/709] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:27.623234 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14952331-711a-4a08-9137-550c96ec5362 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:27.629369 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2288c7-938e-4319-aa11-1d4611322c0f None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:27.728269 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14952331-711a-4a08-9137-550c96ec5362 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:27.731382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2288c7-938e-4319-aa11-1d4611322c0f None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:27.762874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1923e-2305-4909-9e6a-164c30d31637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:27.764156 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1923e-2305-4909-9e6a-164c30d31637 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:27.764772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1923e-2305-4909-9e6a-164c30d31637 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:27.764876 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd9a5a-1421-4af6-beb2-91a8542a4814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:27.765382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1923e-2305-4909-9e6a-164c30d31637 None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:27.765689 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd9a5a-1421-4af6-beb2-91a8542a4814 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:27.765964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd9a5a-1421-4af6-beb2-91a8542a4814 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:27.766231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd9a5a-1421-4af6-beb2-91a8542a4814 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:27.766877 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd9a5a-1421-4af6-beb2-91a8542a4814 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:27.767183 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1923e-2305-4909-9e6a-164c30d31637 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:27.767673 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1923e-2305-4909-9e6a-164c30d31637 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:27.768252 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd9a5a-1421-4af6-beb2-91a8542a4814 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:27.769662 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1923e-2305-4909-9e6a-164c30d31637 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:27.782491 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-3cdd9a5a-1421-4af6-beb2-91a8542a4814 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 12:39:27.783045 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 355/710] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:27.783711 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 356/711] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Nov 2 12:39:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:27.789293 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd9a5a-1421-4af6-beb2-91a8542a4814 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:27.790535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1923e-2305-4909-9e6a-164c30d31637 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:27.889920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd9a5a-1421-4af6-beb2-91a8542a4814 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:27.924134 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59127676-b2b6-4a8c-8a17-d899d4be3d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:27.924838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127676-b2b6-4a8c-8a17-d899d4be3d24 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:27.925112 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127676-b2b6-4a8c-8a17-d899d4be3d24 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:27.925378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127676-b2b6-4a8c-8a17-d899d4be3d24 None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:27.926080 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59127676-b2b6-4a8c-8a17-d899d4be3d24 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:27.926377 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59127676-b2b6-4a8c-8a17-d899d4be3d24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:27.927753 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59127676-b2b6-4a8c-8a17-d899d4be3d24 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:27.933751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 357/712] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Nov 2 12:39:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:27.941561 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59127676-b2b6-4a8c-8a17-d899d4be3d24 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:28.034412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1923e-2305-4909-9e6a-164c30d31637 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:28.060079 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59127676-b2b6-4a8c-8a17-d899d4be3d24 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:28.100227 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276f723-3c2b-475a-afea-c2c50c5c3154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:28.100901 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276f723-3c2b-475a-afea-c2c50c5c3154 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:28.101175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276f723-3c2b-475a-afea-c2c50c5c3154 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:28.101444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276f723-3c2b-475a-afea-c2c50c5c3154 None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:28.102142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276f723-3c2b-475a-afea-c2c50c5c3154 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:28.102441 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276f723-3c2b-475a-afea-c2c50c5c3154 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:28.103807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276f723-3c2b-475a-afea-c2c50c5c3154 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:28.106215 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dca1ab-a5bc-431e-8d4a-6305a06f75b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:28.106866 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dca1ab-a5bc-431e-8d4a-6305a06f75b7 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:28.107137 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dca1ab-a5bc-431e-8d4a-6305a06f75b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:28.107402 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dca1ab-a5bc-431e-8d4a-6305a06f75b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:28.108342 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dca1ab-a5bc-431e-8d4a-6305a06f75b7 None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=fbcda58f298444eebf4f08ce01deffc0) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:28.108760 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dca1ab-a5bc-431e-8d4a-6305a06f75b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:28.110178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dca1ab-a5bc-431e-8d4a-6305a06f75b7 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:28.127973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 358/713] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Nov 2 12:39:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:28.128382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 356/714] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:27 2022] GET /identity/v3/role_assignments?user.id=fbcda58f298444eebf4f08ce01deffc0&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=85136c55809b4d9db97c263a72392ad1 => generated 259 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:28.562082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d551a62-0ae4-4de1-a89d-69ce2f5ae47b None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:28.562405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d551a62-0ae4-4de1-a89d-69ce2f5ae47b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:28.562627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d551a62-0ae4-4de1-a89d-69ce2f5ae47b None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:28.564744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 359/715] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:28.570239 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26c938-218e-4b46-a9ce-435644ea3f89 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:28.570785 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26c938-218e-4b46-a9ce-435644ea3f89 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:28.571251 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26c938-218e-4b46-a9ce-435644ea3f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:28.592347 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-4b26c938-218e-4b46-a9ce-435644ea3f89 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:28.594023 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4b26c938-218e-4b46-a9ce-435644ea3f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:28.680731 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 357/716] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:28.714976 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d551a62-0ae4-4de1-a89d-69ce2f5ae47b None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:28.841852 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d551a62-0ae4-4de1-a89d-69ce2f5ae47b None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:28.883586 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a18797-d8ef-41b7-bbb3-c0fb2c30ed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:28.884416 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a18797-d8ef-41b7-bbb3-c0fb2c30ed09 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:28.884687 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a18797-d8ef-41b7-bbb3-c0fb2c30ed09 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:28.884952 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a18797-d8ef-41b7-bbb3-c0fb2c30ed09 None admin] PATH_INFO: `/v3/services/network` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:28.885597 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a18797-d8ef-41b7-bbb3-c0fb2c30ed09 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:28.886997 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a18797-d8ef-41b7-bbb3-c0fb2c30ed09 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:28.903893 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-39a18797-d8ef-41b7-bbb3-c0fb2c30ed09 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 12:39:28.905307 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 360/717] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:28 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:28.911058 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26c938-218e-4b46-a9ce-435644ea3f89 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:29.046452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26c938-218e-4b46-a9ce-435644ea3f89 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:29.089315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0771754-d354-4e8e-b0d8-9604d976001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:29.090359 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0771754-d354-4e8e-b0d8-9604d976001e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:29.090843 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0771754-d354-4e8e-b0d8-9604d976001e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:29.091315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0771754-d354-4e8e-b0d8-9604d976001e None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:29.092257 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0771754-d354-4e8e-b0d8-9604d976001e None admin] RBAC: Adding query filter params (name=network) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:29.093022 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0771754-d354-4e8e-b0d8-9604d976001e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:29.094592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0771754-d354-4e8e-b0d8-9604d976001e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:29.103930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 358/718] 10.222.0.90 () {56 vars in 1112 bytes} [Wed Nov 2 12:39:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:29.109288 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a18797-d8ef-41b7-bbb3-c0fb2c30ed09 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:29.233079 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a18797-d8ef-41b7-bbb3-c0fb2c30ed09 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:29.271651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4b088-30f1-4d8a-8230-66204fca00ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:29.272349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4b088-30f1-4d8a-8230-66204fca00ff None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:29.272626 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4b088-30f1-4d8a-8230-66204fca00ff None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:29.272891 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4b088-30f1-4d8a-8230-66204fca00ff None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:29.273600 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4b088-30f1-4d8a-8230-66204fca00ff None admin] RBAC: Adding query filter params (type=network) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:29.273910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4b088-30f1-4d8a-8230-66204fca00ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:29.275276 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4b088-30f1-4d8a-8230-66204fca00ff None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:29.280907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 361/719] 10.222.0.90 () {56 vars in 1112 bytes} [Wed Nov 2 12:39:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:29.774660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccb5b5-c864-40e3-993a-86a886ccad67 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:29.775141 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccb5b5-c864-40e3-993a-86a886ccad67 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:29.775141 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccb5b5-c864-40e3-993a-86a886ccad67 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:29.777258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 359/720] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:29.782966 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef10ad-bb06-430d-8e89-a5df94f795a2 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:29.783515 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef10ad-bb06-430d-8e89-a5df94f795a2 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:29.783977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef10ad-bb06-430d-8e89-a5df94f795a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:29.806142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-0eef10ad-bb06-430d-8e89-a5df94f795a2 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:29.807622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0eef10ad-bb06-430d-8e89-a5df94f795a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:29.901582 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 362/721] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:29.937118 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccb5b5-c864-40e3-993a-86a886ccad67 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:30.068059 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccb5b5-c864-40e3-993a-86a886ccad67 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:30.120920 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ac5b8-09c4-4acc-b689-3dfdd8fac8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:30.121731 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ac5b8-09c4-4acc-b689-3dfdd8fac8c4 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:30.122017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ac5b8-09c4-4acc-b689-3dfdd8fac8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:30.122292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ac5b8-09c4-4acc-b689-3dfdd8fac8c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:30.133253 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ac5b8-09c4-4acc-b689-3dfdd8fac8c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:30.140548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-753ac5b8-09c4-4acc-b689-3dfdd8fac8c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:39:30.142107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 360/722] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:39:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:30.147890 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef10ad-bb06-430d-8e89-a5df94f795a2 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:30.301694 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef10ad-bb06-430d-8e89-a5df94f795a2 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:30.347668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1d8d6-f7e3-47f9-a2c2-726e7e659103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:30.348286 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1d8d6-f7e3-47f9-a2c2-726e7e659103 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:30.348568 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1d8d6-f7e3-47f9-a2c2-726e7e659103 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:30.348839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1d8d6-f7e3-47f9-a2c2-726e7e659103 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:30.349583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1d8d6-f7e3-47f9-a2c2-726e7e659103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:30.349884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1d8d6-f7e3-47f9-a2c2-726e7e659103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:30.351260 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1d8d6-f7e3-47f9-a2c2-726e7e659103 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:30.364245 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 363/723] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:39:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:30.369739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ac5b8-09c4-4acc-b689-3dfdd8fac8c4 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:30.435363 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e0c98-1b59-49b0-8539-6182199517f7 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:30.435699 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e0c98-1b59-49b0-8539-6182199517f7 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:30.435976 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e0c98-1b59-49b0-8539-6182199517f7 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:30.438339 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 364/724] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:30.443630 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a53461-a19c-45b3-b46f-e4063c031153 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:30.443916 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a53461-a19c-45b3-b46f-e4063c031153 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:30.444196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a53461-a19c-45b3-b46f-e4063c031153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:30.482295 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-c3a53461-a19c-45b3-b46f-e4063c031153 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:30.483611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-c3a53461-a19c-45b3-b46f-e4063c031153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:30.497586 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ac5b8-09c4-4acc-b689-3dfdd8fac8c4 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:30.537184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c9b33-cdd4-4a19-863f-501d8be2d9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:30.537984 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c9b33-cdd4-4a19-863f-501d8be2d9a4 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:30.538255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c9b33-cdd4-4a19-863f-501d8be2d9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:30.538520 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c9b33-cdd4-4a19-863f-501d8be2d9a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:30.554670 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c9b33-cdd4-4a19-863f-501d8be2d9a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:30.556132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c9b33-cdd4-4a19-863f-501d8be2d9a4 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:30.590887 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-168c9b33-cdd4-4a19-863f-501d8be2d9a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:30.593595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 361/725] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:30.598873 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c9b33-cdd4-4a19-863f-501d8be2d9a4 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:30.641518 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 365/726] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:30.665357 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a53461-a19c-45b3-b46f-e4063c031153 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:30.771355 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c9b33-cdd4-4a19-863f-501d8be2d9a4 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:30.812705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d04eb5-92e1-4754-97d8-626385fa1bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:30.813332 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d04eb5-92e1-4754-97d8-626385fa1bfa None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:30.813559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d04eb5-92e1-4754-97d8-626385fa1bfa None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:30.813713 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d04eb5-92e1-4754-97d8-626385fa1bfa None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:30.814439 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d04eb5-92e1-4754-97d8-626385fa1bfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:30.814744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d04eb5-92e1-4754-97d8-626385fa1bfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:30.816133 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d04eb5-92e1-4754-97d8-626385fa1bfa None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:30.844625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 362/727] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:30.849421 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d04eb5-92e1-4754-97d8-626385fa1bfa None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:30.859271 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a53461-a19c-45b3-b46f-e4063c031153 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:30.907791 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec0a8c-1dab-49aa-ab25-88e17244bd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:30.909032 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec0a8c-1dab-49aa-ab25-88e17244bd0d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:30.909530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec0a8c-1dab-49aa-ab25-88e17244bd0d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:30.909989 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec0a8c-1dab-49aa-ab25-88e17244bd0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:30.928031 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec0a8c-1dab-49aa-ab25-88e17244bd0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:30.940144 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-c0ec0a8c-1dab-49aa-ab25-88e17244bd0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:30.948964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 366/728] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:30.953849 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec0a8c-1dab-49aa-ab25-88e17244bd0d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:31.052784 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d04eb5-92e1-4754-97d8-626385fa1bfa None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:31.066882 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec0a8c-1dab-49aa-ab25-88e17244bd0d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:31.096121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740b2b8-4091-4455-a501-868cc6410854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:31.097354 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740b2b8-4091-4455-a501-868cc6410854 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:31.097821 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740b2b8-4091-4455-a501-868cc6410854 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:31.098318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740b2b8-4091-4455-a501-868cc6410854 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:31.100190 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3a8d9-2c35-402d-ab4d-68a291683ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:31.100996 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3a8d9-2c35-402d-ab4d-68a291683ca3 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:31.101272 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3a8d9-2c35-402d-ab4d-68a291683ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:31.101538 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3a8d9-2c35-402d-ab4d-68a291683ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:31.102798 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3a8d9-2c35-402d-ab4d-68a291683ca3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:31.103104 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3a8d9-2c35-402d-ab4d-68a291683ca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:31.104547 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3a8d9-2c35-402d-ab4d-68a291683ca3 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:31.107488 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740b2b8-4091-4455-a501-868cc6410854 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:31.109458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740b2b8-4091-4455-a501-868cc6410854 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:31.114239 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 367/729] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:31.115622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb052e41-a113-4cca-8fbc-4d4ed189a808 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:31.115907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb052e41-a113-4cca-8fbc-4d4ed189a808 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:31.116179 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb052e41-a113-4cca-8fbc-4d4ed189a808 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:31.118473 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 368/730] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:31.119178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb052e41-a113-4cca-8fbc-4d4ed189a808 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:31.125901 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-4740b2b8-4091-4455-a501-868cc6410854 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 12:39:31.127604 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 363/731] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:39:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:31.133564 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769522d-292c-4bc3-9b81-d06d1113991e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:31.134121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769522d-292c-4bc3-9b81-d06d1113991e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:31.134602 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769522d-292c-4bc3-9b81-d06d1113991e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:31.151623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-0769522d-292c-4bc3-9b81-d06d1113991e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:31.153510 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0769522d-292c-4bc3-9b81-d06d1113991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:31.221464 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 364/732] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:31.222692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769522d-292c-4bc3-9b81-d06d1113991e None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:31.240527 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb052e41-a113-4cca-8fbc-4d4ed189a808 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:31.283644 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe66234-1170-430e-84fc-58fb3be2e2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:31.284742 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe66234-1170-430e-84fc-58fb3be2e2a2 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:31.285068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe66234-1170-430e-84fc-58fb3be2e2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:31.285328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe66234-1170-430e-84fc-58fb3be2e2a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:31.297616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe66234-1170-430e-84fc-58fb3be2e2a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:31.299313 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe66234-1170-430e-84fc-58fb3be2e2a2 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:31.316002 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-afe66234-1170-430e-84fc-58fb3be2e2a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:31.317265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 369/733] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:31.318047 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe66234-1170-430e-84fc-58fb3be2e2a2 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:31.323471 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769522d-292c-4bc3-9b81-d06d1113991e None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:31.356972 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd90d7-42b7-478f-85ba-1236ef8f3d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:31.357979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd90d7-42b7-478f-85ba-1236ef8f3d1b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:31.358591 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd90d7-42b7-478f-85ba-1236ef8f3d1b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:31.359058 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd90d7-42b7-478f-85ba-1236ef8f3d1b None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:31.360055 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd90d7-42b7-478f-85ba-1236ef8f3d1b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:31.360572 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd90d7-42b7-478f-85ba-1236ef8f3d1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:31.361995 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd90d7-42b7-478f-85ba-1236ef8f3d1b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:31.383737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 365/734] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Nov 2 12:39:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:31.383737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02779f3-5fb4-4ce9-b4f5-13eb7c7cbd4b None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:31.383737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02779f3-5fb4-4ce9-b4f5-13eb7c7cbd4b None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:31.383737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02779f3-5fb4-4ce9-b4f5-13eb7c7cbd4b None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:31.383737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 366/735] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:31.384155 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02779f3-5fb4-4ce9-b4f5-13eb7c7cbd4b None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:31.422634 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe66234-1170-430e-84fc-58fb3be2e2a2 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:31.456604 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7464247-e311-4bb4-a8ab-6201f6d84073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:31.457408 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7464247-e311-4bb4-a8ab-6201f6d84073 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:31.457684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7464247-e311-4bb4-a8ab-6201f6d84073 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:31.457954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7464247-e311-4bb4-a8ab-6201f6d84073 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:31.471303 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7464247-e311-4bb4-a8ab-6201f6d84073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:31.478287 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-d7464247-e311-4bb4-a8ab-6201f6d84073 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:39:31.479515 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 370/736] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:39:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:31.481303 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7464247-e311-4bb4-a8ab-6201f6d84073 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:31.488391 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02779f3-5fb4-4ce9-b4f5-13eb7c7cbd4b None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:31.522138 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ba0f4-1bc7-4fe7-9c9f-b89f90689122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:31.522805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ba0f4-1bc7-4fe7-9c9f-b89f90689122 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:31.523087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ba0f4-1bc7-4fe7-9c9f-b89f90689122 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:31.523360 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ba0f4-1bc7-4fe7-9c9f-b89f90689122 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:31.524077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ba0f4-1bc7-4fe7-9c9f-b89f90689122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:31.524413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ba0f4-1bc7-4fe7-9c9f-b89f90689122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:31.525772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ba0f4-1bc7-4fe7-9c9f-b89f90689122 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:31.537381 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 367/737] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:31.538630 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d236e1-19da-403b-ac6f-1777d82f198d None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:31.538914 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d236e1-19da-403b-ac6f-1777d82f198d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:31.539185 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d236e1-19da-403b-ac6f-1777d82f198d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:31.555495 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-38d236e1-19da-403b-ac6f-1777d82f198d None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:31.556700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-38d236e1-19da-403b-ac6f-1777d82f198d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:31.587084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7464247-e311-4bb4-a8ab-6201f6d84073 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:31.620731 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db2da0-6fe9-4b46-83c5-ced83709dd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:31.621301 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db2da0-6fe9-4b46-83c5-ced83709dd36 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:31.621585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db2da0-6fe9-4b46-83c5-ced83709dd36 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:31.621861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db2da0-6fe9-4b46-83c5-ced83709dd36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:31.628553 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 368/738] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:31.629763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d236e1-19da-403b-ac6f-1777d82f198d None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:31.692880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db2da0-6fe9-4b46-83c5-ced83709dd36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:31.694695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db2da0-6fe9-4b46-83c5-ced83709dd36 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:31.730785 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d236e1-19da-403b-ac6f-1777d82f198d None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:31.764877 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10de80-1fa1-45b0-ab48-093e71260258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:31.765847 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10de80-1fa1-45b0-ab48-093e71260258 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:31.766114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10de80-1fa1-45b0-ab48-093e71260258 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:31.766382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10de80-1fa1-45b0-ab48-093e71260258 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:31.767126 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10de80-1fa1-45b0-ab48-093e71260258 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:31.767424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10de80-1fa1-45b0-ab48-093e71260258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:31.768823 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10de80-1fa1-45b0-ab48-093e71260258 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:31.778356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 369/739] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:39:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:31.779808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10de80-1fa1-45b0-ab48-093e71260258 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:31.803953 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 371/740] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:31.803953 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db2da0-6fe9-4b46-83c5-ced83709dd36 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:31.886623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10de80-1fa1-45b0-ab48-093e71260258 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:31.899336 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db2da0-6fe9-4b46-83c5-ced83709dd36 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:31.919023 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bb1d8-bf8e-439b-a33e-1580a30a5f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:31.919838 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bb1d8-bf8e-439b-a33e-1580a30a5f8c None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:31.920117 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bb1d8-bf8e-439b-a33e-1580a30a5f8c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:31.920417 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bb1d8-bf8e-439b-a33e-1580a30a5f8c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:31.928016 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bb1d8-bf8e-439b-a33e-1580a30a5f8c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:31.929524 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bb1d8-bf8e-439b-a33e-1580a30a5f8c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:31.934849 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba274aa5-5856-4142-a7b8-4d1891d4b237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:31.935605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba274aa5-5856-4142-a7b8-4d1891d4b237 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:31.935938 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba274aa5-5856-4142-a7b8-4d1891d4b237 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:31.936321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba274aa5-5856-4142-a7b8-4d1891d4b237 None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:31.937261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba274aa5-5856-4142-a7b8-4d1891d4b237 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:31.938690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba274aa5-5856-4142-a7b8-4d1891d4b237 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:31.943634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-a70bb1d8-bf8e-439b-a33e-1580a30a5f8c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 12:39:31.945041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 370/741] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Nov 2 12:39:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:31.946896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bb1d8-bf8e-439b-a33e-1580a30a5f8c None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:31.955824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 372/742] 10.222.0.90 () {60 vars in 1141 bytes} [Wed Nov 2 12:39:31 2022] POST /identity/v3/services => generated 251 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:31.956734 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba274aa5-5856-4142-a7b8-4d1891d4b237 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:32.058573 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bb1d8-bf8e-439b-a33e-1580a30a5f8c None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:32.081395 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba274aa5-5856-4142-a7b8-4d1891d4b237 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:32.095064 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2d6fe-fe48-4b71-bce0-959989261890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:32.096245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2d6fe-fe48-4b71-bce0-959989261890 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:32.096671 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2d6fe-fe48-4b71-bce0-959989261890 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:32.097082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2d6fe-fe48-4b71-bce0-959989261890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:32.109236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2d6fe-fe48-4b71-bce0-959989261890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:32.111082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2d6fe-fe48-4b71-bce0-959989261890 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:32.120410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf8bcd-7382-4e9f-8b45-09ab010909ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:32.121133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf8bcd-7382-4e9f-8b45-09ab010909ea None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:32.121410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf8bcd-7382-4e9f-8b45-09ab010909ea None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:32.121681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf8bcd-7382-4e9f-8b45-09ab010909ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:32.130120 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c4c2d6fe-fe48-4b71-bce0-959989261890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:32.132063 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 371/743] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:32.133230 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2d6fe-fe48-4b71-bce0-959989261890 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:32.138476 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf8bcd-7382-4e9f-8b45-09ab010909ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:32.140908 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf8bcd-7382-4e9f-8b45-09ab010909ea None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:32.157811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-7bbf8bcd-7382-4e9f-8b45-09ab010909ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:32.159224 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 373/744] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:32.159830 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf8bcd-7382-4e9f-8b45-09ab010909ea None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:32.233887 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2d6fe-fe48-4b71-bce0-959989261890 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:32.263322 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf8bcd-7382-4e9f-8b45-09ab010909ea None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:32.268052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45928b8b-ceaf-4f8a-8e95-9666b8889f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:32.268763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45928b8b-ceaf-4f8a-8e95-9666b8889f0b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:32.269041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45928b8b-ceaf-4f8a-8e95-9666b8889f0b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:32.269313 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45928b8b-ceaf-4f8a-8e95-9666b8889f0b None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:32.270147 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45928b8b-ceaf-4f8a-8e95-9666b8889f0b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:32.270454 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45928b8b-ceaf-4f8a-8e95-9666b8889f0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:32.271907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45928b8b-ceaf-4f8a-8e95-9666b8889f0b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:32.293977 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 372/745] 10.222.0.90 () {56 vars in 1149 bytes} [Wed Nov 2 12:39:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:32.294915 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45928b8b-ceaf-4f8a-8e95-9666b8889f0b None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:32.304922 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e16177-a331-4049-b82a-d7f940396c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:32.305653 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e16177-a331-4049-b82a-d7f940396c02 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:32.306156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e16177-a331-4049-b82a-d7f940396c02 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:32.306483 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e16177-a331-4049-b82a-d7f940396c02 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:32.307214 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e16177-a331-4049-b82a-d7f940396c02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:32.307644 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e16177-a331-4049-b82a-d7f940396c02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:32.309056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e16177-a331-4049-b82a-d7f940396c02 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:32.325471 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 374/746] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:32.325471 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a0332-fc83-49a7-886a-6bcc4260cd29 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:32.325471 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a0332-fc83-49a7-886a-6bcc4260cd29 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:32.325471 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a0332-fc83-49a7-886a-6bcc4260cd29 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:32.325471 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 375/747] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:32.325856 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a0332-fc83-49a7-886a-6bcc4260cd29 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:32.400686 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45928b8b-ceaf-4f8a-8e95-9666b8889f0b None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:32.428308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a0332-fc83-49a7-886a-6bcc4260cd29 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:32.434147 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85964a0-92e4-491b-8d12-a78d0a0c3dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:32.434946 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85964a0-92e4-491b-8d12-a78d0a0c3dbb None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:32.435194 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85964a0-92e4-491b-8d12-a78d0a0c3dbb None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:32.435582 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85964a0-92e4-491b-8d12-a78d0a0c3dbb None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:32.436405 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85964a0-92e4-491b-8d12-a78d0a0c3dbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:32.436716 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85964a0-92e4-491b-8d12-a78d0a0c3dbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:32.438274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85964a0-92e4-491b-8d12-a78d0a0c3dbb None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:32.453842 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 373/748] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:32.453842 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85964a0-92e4-491b-8d12-a78d0a0c3dbb None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:32.471224 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba2da0-a9d5-4b29-bdd3-da0895f9c6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:32.472007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2da0-a9d5-4b29-bdd3-da0895f9c6c0 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:32.472765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2da0-a9d5-4b29-bdd3-da0895f9c6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:32.472765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2da0-a9d5-4b29-bdd3-da0895f9c6c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:32.548099 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85964a0-92e4-491b-8d12-a78d0a0c3dbb None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:32.548450 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba2da0-a9d5-4b29-bdd3-da0895f9c6c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:32.550928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba2da0-a9d5-4b29-bdd3-da0895f9c6c0 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:32.581448 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bec79-ce94-49ca-862e-ec8b0804ca62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:32.582314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bec79-ce94-49ca-862e-ec8b0804ca62 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:32.582699 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bec79-ce94-49ca-862e-ec8b0804ca62 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:32.582990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bec79-ce94-49ca-862e-ec8b0804ca62 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:32.591164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1bec79-ce94-49ca-862e-ec8b0804ca62 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:32.592727 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1bec79-ce94-49ca-862e-ec8b0804ca62 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:32.606724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-2b1bec79-ce94-49ca-862e-ec8b0804ca62 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:39:32.608057 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 374/749] 10.222.0.90 () {56 vars in 1093 bytes} [Wed Nov 2 12:39:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:32.609423 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e260a80-027f-4a06-944b-10fba12a1c53 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:32.609705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e260a80-027f-4a06-944b-10fba12a1c53 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:32.609983 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e260a80-027f-4a06-944b-10fba12a1c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:32.628917 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-8e260a80-027f-4a06-944b-10fba12a1c53 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:32.630078 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-8e260a80-027f-4a06-944b-10fba12a1c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:32.658776 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 376/750] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:32 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:32.659850 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba2da0-a9d5-4b29-bdd3-da0895f9c6c0 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:32.714755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 375/751] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:32.716284 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e260a80-027f-4a06-944b-10fba12a1c53 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:32.790832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba2da0-a9d5-4b29-bdd3-da0895f9c6c0 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:32.816546 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e260a80-027f-4a06-944b-10fba12a1c53 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:32.825122 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c469b-4baf-4870-b33e-862fe83c5a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:32.825921 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c469b-4baf-4870-b33e-862fe83c5a42 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:32.826196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c469b-4baf-4870-b33e-862fe83c5a42 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:32.826464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c469b-4baf-4870-b33e-862fe83c5a42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:32.833997 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c469b-4baf-4870-b33e-862fe83c5a42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:32.835447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c469b-4baf-4870-b33e-862fe83c5a42 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:32.848277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-852c469b-4baf-4870-b33e-862fe83c5a42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:32.849171 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb0b33-6a20-4944-8682-1f3b83369253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:32.849840 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb0b33-6a20-4944-8682-1f3b83369253 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:32.850118 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb0b33-6a20-4944-8682-1f3b83369253 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:32.850473 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb0b33-6a20-4944-8682-1f3b83369253 None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:32.851298 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb0b33-6a20-4944-8682-1f3b83369253 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:32.851598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb0b33-6a20-4944-8682-1f3b83369253 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:32.853048 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb0b33-6a20-4944-8682-1f3b83369253 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:32.854329 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 377/752] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:32.855097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c469b-4baf-4870-b33e-862fe83c5a42 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:32.870609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 376/753] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Nov 2 12:39:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:32.871516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb0b33-6a20-4944-8682-1f3b83369253 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:32.956955 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c469b-4baf-4870-b33e-862fe83c5a42 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:32.969699 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb0b33-6a20-4944-8682-1f3b83369253 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:32.990502 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102dc37a-77ff-46b4-a97d-614bc65b454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:32.991298 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dc37a-77ff-46b4-a97d-614bc65b454a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:32.991573 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dc37a-77ff-46b4-a97d-614bc65b454a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:32.991841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dc37a-77ff-46b4-a97d-614bc65b454a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:33.002359 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102dc37a-77ff-46b4-a97d-614bc65b454a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:33.004511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102dc37a-77ff-46b4-a97d-614bc65b454a None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:33.005864 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc5ccf-c60b-4069-83ea-5a232a0a7348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:33.006582 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc5ccf-c60b-4069-83ea-5a232a0a7348 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:33.006801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc5ccf-c60b-4069-83ea-5a232a0a7348 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:33.007071 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc5ccf-c60b-4069-83ea-5a232a0a7348 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:33.007798 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc5ccf-c60b-4069-83ea-5a232a0a7348 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:33.009163 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc5ccf-c60b-4069-83ea-5a232a0a7348 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:33.021616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-102dc37a-77ff-46b4-a97d-614bc65b454a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:33.022822 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 378/754] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:33.023588 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102dc37a-77ff-46b4-a97d-614bc65b454a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:33.036233 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 377/755] 10.222.0.90 () {60 vars in 1141 bytes} [Wed Nov 2 12:39:32 2022] POST /identity/v3/services => generated 240 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:33.036233 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc5ccf-c60b-4069-83ea-5a232a0a7348 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:33.143424 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102dc37a-77ff-46b4-a97d-614bc65b454a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:33.192611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9551ea-e102-45ec-8648-93e2302044e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:33.193290 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9551ea-e102-45ec-8648-93e2302044e6 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:33.193566 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9551ea-e102-45ec-8648-93e2302044e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:33.193838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9551ea-e102-45ec-8648-93e2302044e6 None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:33.194752 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9551ea-e102-45ec-8648-93e2302044e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:33.195061 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9551ea-e102-45ec-8648-93e2302044e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:33.196554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9551ea-e102-45ec-8648-93e2302044e6 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:33.196890 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc5ccf-c60b-4069-83ea-5a232a0a7348 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:33.211146 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 379/756] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:33.211967 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9551ea-e102-45ec-8648-93e2302044e6 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:33.241230 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700f70d-83a4-4832-88a6-61b2e3c7936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:33.242035 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700f70d-83a4-4832-88a6-61b2e3c7936e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:33.242319 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700f70d-83a4-4832-88a6-61b2e3c7936e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:33.242588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700f70d-83a4-4832-88a6-61b2e3c7936e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:33.252949 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700f70d-83a4-4832-88a6-61b2e3c7936e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:33.254456 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700f70d-83a4-4832-88a6-61b2e3c7936e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:33.271126 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-9700f70d-83a4-4832-88a6-61b2e3c7936e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:33.272371 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 378/757] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:33.273517 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700f70d-83a4-4832-88a6-61b2e3c7936e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:33.324932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9551ea-e102-45ec-8648-93e2302044e6 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:33.359636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508f378-1e29-4901-a79f-64f2fdf8cb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:33.360519 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508f378-1e29-4901-a79f-64f2fdf8cb3f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:33.360803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508f378-1e29-4901-a79f-64f2fdf8cb3f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:33.361075 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508f378-1e29-4901-a79f-64f2fdf8cb3f None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:33.362096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508f378-1e29-4901-a79f-64f2fdf8cb3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:33.362410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508f378-1e29-4901-a79f-64f2fdf8cb3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:33.364080 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508f378-1e29-4901-a79f-64f2fdf8cb3f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:33.378277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 380/758] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:33.379140 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508f378-1e29-4901-a79f-64f2fdf8cb3f None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:33.414537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700f70d-83a4-4832-88a6-61b2e3c7936e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:33.457199 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e187bb-5fd6-4aae-b321-0ebe69b7cd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:33.457927 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e187bb-5fd6-4aae-b321-0ebe69b7cd64 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:33.458205 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e187bb-5fd6-4aae-b321-0ebe69b7cd64 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:33.458478 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e187bb-5fd6-4aae-b321-0ebe69b7cd64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:33.459855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e187bb-5fd6-4aae-b321-0ebe69b7cd64 None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=baece5d60fe6407989b460fc6b747f6c) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:33.460170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e187bb-5fd6-4aae-b321-0ebe69b7cd64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:33.462134 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e187bb-5fd6-4aae-b321-0ebe69b7cd64 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:33.469349 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 379/759] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:33 2022] GET /identity/v3/role_assignments?user.id=baece5d60fe6407989b460fc6b747f6c&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=85136c55809b4d9db97c263a72392ad1 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:33.470693 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e187bb-5fd6-4aae-b321-0ebe69b7cd64 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:33.496902 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508f378-1e29-4901-a79f-64f2fdf8cb3f None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:33.536236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92749792-2b00-4001-9db3-1b91c48f6d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:33.537289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92749792-2b00-4001-9db3-1b91c48f6d17 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:33.537796 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92749792-2b00-4001-9db3-1b91c48f6d17 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:33.538279 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92749792-2b00-4001-9db3-1b91c48f6d17 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:33.539214 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92749792-2b00-4001-9db3-1b91c48f6d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:33.539761 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92749792-2b00-4001-9db3-1b91c48f6d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:33.541430 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92749792-2b00-4001-9db3-1b91c48f6d17 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:33.555481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 381/760] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:33.563131 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92749792-2b00-4001-9db3-1b91c48f6d17 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:33.596675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e187bb-5fd6-4aae-b321-0ebe69b7cd64 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:33.648071 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aad588-6303-4c2e-9db6-7aea04d0c3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:33.649383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aad588-6303-4c2e-9db6-7aea04d0c3e6 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:33.649383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aad588-6303-4c2e-9db6-7aea04d0c3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:33.649606 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aad588-6303-4c2e-9db6-7aea04d0c3e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:33.660091 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aad588-6303-4c2e-9db6-7aea04d0c3e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:33.661610 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aad588-6303-4c2e-9db6-7aea04d0c3e6 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:33.686087 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92749792-2b00-4001-9db3-1b91c48f6d17 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:33.690841 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-75aad588-6303-4c2e-9db6-7aea04d0c3e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:33.699125 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 380/761] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:33.705190 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aad588-6303-4c2e-9db6-7aea04d0c3e6 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:33.739880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba9a23-3e3c-45b1-b5bd-54a65fbc2855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:33.740940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba9a23-3e3c-45b1-b5bd-54a65fbc2855 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:33.741384 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba9a23-3e3c-45b1-b5bd-54a65fbc2855 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:33.741792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba9a23-3e3c-45b1-b5bd-54a65fbc2855 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:33.749337 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba9a23-3e3c-45b1-b5bd-54a65fbc2855 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:33.750991 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba9a23-3e3c-45b1-b5bd-54a65fbc2855 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:33.765154 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-feba9a23-3e3c-45b1-b5bd-54a65fbc2855 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:33.766957 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 382/762] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:33.773785 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba9a23-3e3c-45b1-b5bd-54a65fbc2855 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:33.872580 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aad588-6303-4c2e-9db6-7aea04d0c3e6 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:33.912069 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ae71e-5a0c-4f9e-bc03-7e2e37fa59e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:33.913154 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ae71e-5a0c-4f9e-bc03-7e2e37fa59e2 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:33.913702 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ae71e-5a0c-4f9e-bc03-7e2e37fa59e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:33.914173 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ae71e-5a0c-4f9e-bc03-7e2e37fa59e2 None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:33.915163 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ae71e-5a0c-4f9e-bc03-7e2e37fa59e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:33.915666 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ae71e-5a0c-4f9e-bc03-7e2e37fa59e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:33.917372 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ae71e-5a0c-4f9e-bc03-7e2e37fa59e2 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:33.920940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba9a23-3e3c-45b1-b5bd-54a65fbc2855 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:33.930431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 381/763] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:33.946539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ae71e-5a0c-4f9e-bc03-7e2e37fa59e2 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:33.971290 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b7fd0-aea8-4003-99f8-59ebb41bd8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:33.971961 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b7fd0-aea8-4003-99f8-59ebb41bd8c6 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:33.972273 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b7fd0-aea8-4003-99f8-59ebb41bd8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:33.972549 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b7fd0-aea8-4003-99f8-59ebb41bd8c6 None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:33.973756 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b7fd0-aea8-4003-99f8-59ebb41bd8c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:33.974072 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b7fd0-aea8-4003-99f8-59ebb41bd8c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:33.975571 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b7fd0-aea8-4003-99f8-59ebb41bd8c6 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:33.989204 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 383/764] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:33.994704 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b7fd0-aea8-4003-99f8-59ebb41bd8c6 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:34.111296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ae71e-5a0c-4f9e-bc03-7e2e37fa59e2 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:34.153593 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f412d-5ee6-4309-9ae0-1793c2b9dbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:34.154256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f412d-5ee6-4309-9ae0-1793c2b9dbd9 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:34.154534 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f412d-5ee6-4309-9ae0-1793c2b9dbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:34.154808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f412d-5ee6-4309-9ae0-1793c2b9dbd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:34.161878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f412d-5ee6-4309-9ae0-1793c2b9dbd9 None admin] RBAC: Adding query filter params (role.id=63df47d6fc0740e6bc54a845c3f8a257, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=fef95ce95d4447a58063233a549adfe5) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:34.162238 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f412d-5ee6-4309-9ae0-1793c2b9dbd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:34.163716 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f412d-5ee6-4309-9ae0-1793c2b9dbd9 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:34.175889 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 382/765] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:33 2022] GET /identity/v3/role_assignments?user.id=fef95ce95d4447a58063233a549adfe5&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=63df47d6fc0740e6bc54a845c3f8a257 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:34.199782 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b7fd0-aea8-4003-99f8-59ebb41bd8c6 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:34.239776 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ced74-0b81-4212-b7bd-1e0ed995bf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:34.240731 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ced74-0b81-4212-b7bd-1e0ed995bf65 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:34.241003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ced74-0b81-4212-b7bd-1e0ed995bf65 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:34.241267 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ced74-0b81-4212-b7bd-1e0ed995bf65 None admin] PATH_INFO: `/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/fbcda58f298444eebf4f08ce01deffc0/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:34.243292 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ced74-0b81-4212-b7bd-1e0ed995bf65 None admin] RBAC: Authorizing `identity:create_grant(project_id=a08ee6d287714297a10248ad8e4522bc, user_id=fbcda58f298444eebf4f08ce01deffc0, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:34.244965 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ced74-0b81-4212-b7bd-1e0ed995bf65 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:34.265440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 384/766] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:39:33 2022] PUT /identity/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/fbcda58f298444eebf4f08ce01deffc0/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:34.524497 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854491-971b-4216-801a-b0271b1d5734 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:34.524788 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854491-971b-4216-801a-b0271b1d5734 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:34.524964 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854491-971b-4216-801a-b0271b1d5734 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:34.527101 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 383/767] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:34.533002 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73b322-0578-48e0-aed9-5d6046079367 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:34.533482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73b322-0578-48e0-aed9-5d6046079367 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:34.533558 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73b322-0578-48e0-aed9-5d6046079367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:34.556508 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-0a73b322-0578-48e0-aed9-5d6046079367 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:34.557872 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0a73b322-0578-48e0-aed9-5d6046079367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:34.645011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 385/768] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:34.686541 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a854491-971b-4216-801a-b0271b1d5734 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:34.809939 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a854491-971b-4216-801a-b0271b1d5734 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:34.851904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60648-bbba-4d15-9f8b-b16c832e5d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:34.852744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60648-bbba-4d15-9f8b-b16c832e5d91 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:34.853021 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60648-bbba-4d15-9f8b-b16c832e5d91 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:34.853289 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60648-bbba-4d15-9f8b-b16c832e5d91 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:34.853936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd60648-bbba-4d15-9f8b-b16c832e5d91 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:34.855325 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd60648-bbba-4d15-9f8b-b16c832e5d91 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:34.873175 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-5cd60648-bbba-4d15-9f8b-b16c832e5d91 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 12:39:34.874489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 384/769] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Nov 2 12:39:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:34.880689 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73b322-0578-48e0-aed9-5d6046079367 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:35.013984 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73b322-0578-48e0-aed9-5d6046079367 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:35.051638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c5009-bbdc-4469-b32d-4d1c0010dd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:35.052332 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c5009-bbdc-4469-b32d-4d1c0010dd6e None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:35.052613 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c5009-bbdc-4469-b32d-4d1c0010dd6e None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:35.052944 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c5009-bbdc-4469-b32d-4d1c0010dd6e None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:35.053701 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c5009-bbdc-4469-b32d-4d1c0010dd6e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:35.054006 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c5009-bbdc-4469-b32d-4d1c0010dd6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:35.055402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c5009-bbdc-4469-b32d-4d1c0010dd6e None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:35.060153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 386/770] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Nov 2 12:39:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:35.066059 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60648-bbba-4d15-9f8b-b16c832e5d91 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:35.180921 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60648-bbba-4d15-9f8b-b16c832e5d91 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:35.220435 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905e8de-0aed-43ea-8525-e2888a7c95ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:35.221148 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905e8de-0aed-43ea-8525-e2888a7c95ee None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:35.221429 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905e8de-0aed-43ea-8525-e2888a7c95ee None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:35.221700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905e8de-0aed-43ea-8525-e2888a7c95ee None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:35.222413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905e8de-0aed-43ea-8525-e2888a7c95ee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:35.222729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905e8de-0aed-43ea-8525-e2888a7c95ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:35.224102 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905e8de-0aed-43ea-8525-e2888a7c95ee None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:35.230408 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 385/771] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Nov 2 12:39:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:35.236412 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c5009-bbdc-4469-b32d-4d1c0010dd6e None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:35.341250 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c5009-bbdc-4469-b32d-4d1c0010dd6e None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:35.378702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e092f-6070-46ad-afd7-302b234fc95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:35.379366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e092f-6070-46ad-afd7-302b234fc95b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:35.379696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e092f-6070-46ad-afd7-302b234fc95b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:35.379979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e092f-6070-46ad-afd7-302b234fc95b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:35.380800 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e092f-6070-46ad-afd7-302b234fc95b None admin] RBAC: Adding query filter params (interface=public, service_id=3f56863e23b64dbd9eb40d38357dcd79, region_id=RegionOne) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:35.381106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e092f-6070-46ad-afd7-302b234fc95b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:35.382485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e092f-6070-46ad-afd7-302b234fc95b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:35.390383 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 387/772] 10.222.0.90 () {56 vars in 1251 bytes} [Wed Nov 2 12:39:35 2022] GET /identity/v3/endpoints?service_id=3f56863e23b64dbd9eb40d38357dcd79&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:35.397297 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905e8de-0aed-43ea-8525-e2888a7c95ee None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:35.498526 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905e8de-0aed-43ea-8525-e2888a7c95ee None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:35.535406 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d1540-00cd-4e4b-96b9-a74a40a6ad08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:35.536094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d1540-00cd-4e4b-96b9-a74a40a6ad08 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:35.536403 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d1540-00cd-4e4b-96b9-a74a40a6ad08 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:35.536678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d1540-00cd-4e4b-96b9-a74a40a6ad08 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:35.537365 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d1540-00cd-4e4b-96b9-a74a40a6ad08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:35.538746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d1540-00cd-4e4b-96b9-a74a40a6ad08 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:35.544820 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 386/773] 10.222.0.90 () {56 vars in 1087 bytes} [Wed Nov 2 12:39:35 2022] GET /identity/v3/services => generated 772 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:36.095106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29fe9a-e469-4daf-98bb-3e6223e7f4c2 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:36.095804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29fe9a-e469-4daf-98bb-3e6223e7f4c2 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:36.095804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29fe9a-e469-4daf-98bb-3e6223e7f4c2 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:36.097658 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 388/774] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:36.103092 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec47d3d-b2df-40cf-8a6d-8d9a172a2e92 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:36.103383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec47d3d-b2df-40cf-8a6d-8d9a172a2e92 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:36.103660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec47d3d-b2df-40cf-8a6d-8d9a172a2e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:36.121036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-9ec47d3d-b2df-40cf-8a6d-8d9a172a2e92 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:36.122217 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-9ec47d3d-b2df-40cf-8a6d-8d9a172a2e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:36.188957 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 387/775] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:39:36.211246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29fe9a-e469-4daf-98bb-3e6223e7f4c2 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:36.233938 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d2737-b400-4578-9f8f-02878fdd925a None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:36.234242 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d2737-b400-4578-9f8f-02878fdd925a None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:36.236004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d2737-b400-4578-9f8f-02878fdd925a None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:36.237786 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 388/776] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:39:36.244727 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873e1f-8dbb-499d-8b31-ae6dc9238098 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:36.245357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873e1f-8dbb-499d-8b31-ae6dc9238098 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:36.246098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873e1f-8dbb-499d-8b31-ae6dc9238098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:36.265446 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e9873e1f-8dbb-499d-8b31-ae6dc9238098 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:36.267383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e9873e1f-8dbb-499d-8b31-ae6dc9238098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:36.342980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 389/777] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:39:36.389374 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9873e1f-8dbb-499d-8b31-ae6dc9238098 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:36.399226 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29fe9a-e469-4daf-98bb-3e6223e7f4c2 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:36.476914 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd0161-cfca-4e6f-b20a-e3638fe46383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:36.477737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd0161-cfca-4e6f-b20a-e3638fe46383 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:36.478021 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd0161-cfca-4e6f-b20a-e3638fe46383 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:36.478298 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd0161-cfca-4e6f-b20a-e3638fe46383 None admin] PATH_INFO: `/v3/services/network` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:36.478964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd0161-cfca-4e6f-b20a-e3638fe46383 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:36.480439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd0161-cfca-4e6f-b20a-e3638fe46383 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:36.495278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-47fd0161-cfca-4e6f-b20a-e3638fe46383 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 12:39:36.496846 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 389/778] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:36 2022] GET /identity/v3/services/network => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:36.503790 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9873e1f-8dbb-499d-8b31-ae6dc9238098 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:36.505247 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd0161-cfca-4e6f-b20a-e3638fe46383 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:36.539069 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68437706-6267-4e54-93c3-187f0d6552cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:36.540276 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437706-6267-4e54-93c3-187f0d6552cd None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:36.540750 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437706-6267-4e54-93c3-187f0d6552cd None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:36.541212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437706-6267-4e54-93c3-187f0d6552cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:36.552185 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68437706-6267-4e54-93c3-187f0d6552cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:36.559621 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-68437706-6267-4e54-93c3-187f0d6552cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:39:36.561470 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 390/779] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:39:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:36.569411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68437706-6267-4e54-93c3-187f0d6552cd None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:36.650966 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd0161-cfca-4e6f-b20a-e3638fe46383 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:36.697657 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68437706-6267-4e54-93c3-187f0d6552cd None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:36.697862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ec6f2-686c-473d-b35f-31127fe0bca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:36.698518 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ec6f2-686c-473d-b35f-31127fe0bca4 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:36.698809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ec6f2-686c-473d-b35f-31127fe0bca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:36.699091 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ec6f2-686c-473d-b35f-31127fe0bca4 None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:36.699843 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ec6f2-686c-473d-b35f-31127fe0bca4 None admin] RBAC: Adding query filter params (name=network) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:36.700156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ec6f2-686c-473d-b35f-31127fe0bca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:36.701669 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ec6f2-686c-473d-b35f-31127fe0bca4 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:36.716064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 390/780] 10.222.0.90 () {56 vars in 1112 bytes} [Wed Nov 2 12:39:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:36.737316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ec6f2-686c-473d-b35f-31127fe0bca4 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:36.745503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138a7b9-3371-40fb-9b6b-438148a30313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:36.746472 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138a7b9-3371-40fb-9b6b-438148a30313 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:36.746973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138a7b9-3371-40fb-9b6b-438148a30313 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:36.747451 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138a7b9-3371-40fb-9b6b-438148a30313 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:36.748420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138a7b9-3371-40fb-9b6b-438148a30313 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:36.748936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138a7b9-3371-40fb-9b6b-438148a30313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:36.750530 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138a7b9-3371-40fb-9b6b-438148a30313 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:36.760107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 391/781] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:39:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:36.768961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138a7b9-3371-40fb-9b6b-438148a30313 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:36.868127 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138a7b9-3371-40fb-9b6b-438148a30313 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:36.901884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d06d8a-65dc-41c3-9e1c-487a2f784342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:36.903353 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d06d8a-65dc-41c3-9e1c-487a2f784342 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:36.903836 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d06d8a-65dc-41c3-9e1c-487a2f784342 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:36.904345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d06d8a-65dc-41c3-9e1c-487a2f784342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:36.915559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d06d8a-65dc-41c3-9e1c-487a2f784342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:36.917349 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d06d8a-65dc-41c3-9e1c-487a2f784342 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:36.934425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-a5d06d8a-65dc-41c3-9e1c-487a2f784342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:36.936527 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 392/782] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:36.945682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ec6f2-686c-473d-b35f-31127fe0bca4 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:36.946341 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d06d8a-65dc-41c3-9e1c-487a2f784342 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:36.983984 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340c5c0-4a59-41e2-9061-ed91168c9dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:36.984918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340c5c0-4a59-41e2-9061-ed91168c9dca None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:36.985360 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340c5c0-4a59-41e2-9061-ed91168c9dca None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:36.985764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340c5c0-4a59-41e2-9061-ed91168c9dca None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:36.987588 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340c5c0-4a59-41e2-9061-ed91168c9dca None admin] RBAC: Adding query filter params (type=network) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:36.988190 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340c5c0-4a59-41e2-9061-ed91168c9dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:36.991564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340c5c0-4a59-41e2-9061-ed91168c9dca None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:37.000594 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 391/783] 10.222.0.90 () {56 vars in 1112 bytes} [Wed Nov 2 12:39:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:37.008932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340c5c0-4a59-41e2-9061-ed91168c9dca None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:37.076655 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d06d8a-65dc-41c3-9e1c-487a2f784342 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:37.110493 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0730d92-67c1-4244-a9c2-9c9898d967cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:37.111543 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0730d92-67c1-4244-a9c2-9c9898d967cf None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.112041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0730d92-67c1-4244-a9c2-9c9898d967cf None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.112533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0730d92-67c1-4244-a9c2-9c9898d967cf None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.113449 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0730d92-67c1-4244-a9c2-9c9898d967cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:37.113948 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0730d92-67c1-4244-a9c2-9c9898d967cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:37.115525 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0730d92-67c1-4244-a9c2-9c9898d967cf None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:37.128268 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 393/784] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:37.129984 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10889b-3f2a-4c94-ac64-81401facb015 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.130488 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10889b-3f2a-4c94-ac64-81401facb015 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.130954 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10889b-3f2a-4c94-ac64-81401facb015 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.133165 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 394/785] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:37.134102 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10889b-3f2a-4c94-ac64-81401facb015 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:37.140928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340c5c0-4a59-41e2-9061-ed91168c9dca None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:37.174819 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80755dbe-48ad-4370-9646-a60488507f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:37.175724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80755dbe-48ad-4370-9646-a60488507f60 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.176180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80755dbe-48ad-4370-9646-a60488507f60 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.176684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80755dbe-48ad-4370-9646-a60488507f60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.177637 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80755dbe-48ad-4370-9646-a60488507f60 None admin] RBAC: Adding query filter params (interface=public, service_id=37c36f4903fa408a8192587469c9bbaa, region_id=RegionOne) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:37.178119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80755dbe-48ad-4370-9646-a60488507f60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:37.179676 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80755dbe-48ad-4370-9646-a60488507f60 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:37.185681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 392/786] 10.222.0.90 () {56 vars in 1251 bytes} [Wed Nov 2 12:39:37 2022] GET /identity/v3/endpoints?service_id=37c36f4903fa408a8192587469c9bbaa&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:37.187335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac557fc4-2c9f-41ad-b415-5aca98fb7afa None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.187998 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac557fc4-2c9f-41ad-b415-5aca98fb7afa None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.188641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac557fc4-2c9f-41ad-b415-5aca98fb7afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.205844 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-ac557fc4-2c9f-41ad-b415-5aca98fb7afa None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:37.207347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ac557fc4-2c9f-41ad-b415-5aca98fb7afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:37.241049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10889b-3f2a-4c94-ac64-81401facb015 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:37.274940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 393/787] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:37.275621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac557fc4-2c9f-41ad-b415-5aca98fb7afa None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:37.285026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f10af0-ad0b-4c1b-b12a-049ac2a06b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:37.287476 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f10af0-ad0b-4c1b-b12a-049ac2a06b2a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.288304 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f10af0-ad0b-4c1b-b12a-049ac2a06b2a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.289446 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f10af0-ad0b-4c1b-b12a-049ac2a06b2a None admin] PATH_INFO: `/v3/users/swift` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.303898 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f10af0-ad0b-4c1b-b12a-049ac2a06b2a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:37.306250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f10af0-ad0b-4c1b-b12a-049ac2a06b2a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:37.328828 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-e4f10af0-ad0b-4c1b-b12a-049ac2a06b2a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 12:39:37.330923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 395/788] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:39:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:37.332542 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac56013-92f5-40b7-9861-8a982b97ff71 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.332930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac56013-92f5-40b7-9861-8a982b97ff71 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.333301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac56013-92f5-40b7-9861-8a982b97ff71 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.335088 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 396/789] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:37.336041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac56013-92f5-40b7-9861-8a982b97ff71 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:37.398939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac557fc4-2c9f-41ad-b415-5aca98fb7afa None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:37.431983 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca594bc-698a-4e46-89ca-f30415be95da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:37.432636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca594bc-698a-4e46-89ca-f30415be95da None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.432916 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca594bc-698a-4e46-89ca-f30415be95da None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.433380 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca594bc-698a-4e46-89ca-f30415be95da None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.433891 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca594bc-698a-4e46-89ca-f30415be95da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:37.435454 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca594bc-698a-4e46-89ca-f30415be95da None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:37.448271 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 394/790] 10.222.0.90 () {56 vars in 1087 bytes} [Wed Nov 2 12:39:37 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:37.448271 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca594bc-698a-4e46-89ca-f30415be95da None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:37.451330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac56013-92f5-40b7-9861-8a982b97ff71 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:37.489345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b484f3-a05a-4801-8252-f4b83adad8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:37.490481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b484f3-a05a-4801-8252-f4b83adad8f5 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.490481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b484f3-a05a-4801-8252-f4b83adad8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.490742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b484f3-a05a-4801-8252-f4b83adad8f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.503504 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b484f3-a05a-4801-8252-f4b83adad8f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:37.510034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-a4b484f3-a05a-4801-8252-f4b83adad8f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:37.516444 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 397/791] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:37.516444 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabada3c-315f-438e-ae2a-877effafcf0d None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.516444 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabada3c-315f-438e-ae2a-877effafcf0d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.516444 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabada3c-315f-438e-ae2a-877effafcf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.533242 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-cabada3c-315f-438e-ae2a-877effafcf0d None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:37.534502 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-cabada3c-315f-438e-ae2a-877effafcf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:37.577689 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca594bc-698a-4e46-89ca-f30415be95da None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:37.612353 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 398/792] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:37.614013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabada3c-315f-438e-ae2a-877effafcf0d None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:37.625941 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b4fb1-0091-4ed5-9f18-f0da3d9c7cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:37.626974 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b4fb1-0091-4ed5-9f18-f0da3d9c7cca None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.627422 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b4fb1-0091-4ed5-9f18-f0da3d9c7cca None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.627874 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b4fb1-0091-4ed5-9f18-f0da3d9c7cca None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.629019 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b4fb1-0091-4ed5-9f18-f0da3d9c7cca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:37.629498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b4fb1-0091-4ed5-9f18-f0da3d9c7cca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:37.633417 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b4fb1-0091-4ed5-9f18-f0da3d9c7cca None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:37.658389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 395/793] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Nov 2 12:39:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:37.659314 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b4fb1-0091-4ed5-9f18-f0da3d9c7cca None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:37.739150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabada3c-315f-438e-ae2a-877effafcf0d None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:37.773199 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcbb0e-316f-4c73-b398-9ca8863f0c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:37.773874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcbb0e-316f-4c73-b398-9ca8863f0c3e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.774154 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcbb0e-316f-4c73-b398-9ca8863f0c3e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.774431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcbb0e-316f-4c73-b398-9ca8863f0c3e None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.775184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcbb0e-316f-4c73-b398-9ca8863f0c3e None admin] RBAC: Adding query filter params (name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:37.775518 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcbb0e-316f-4c73-b398-9ca8863f0c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:37.777081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcbb0e-316f-4c73-b398-9ca8863f0c3e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:37.782119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b4fb1-0091-4ed5-9f18-f0da3d9c7cca None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:37.786239 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 399/794] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:37.787074 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcbb0e-316f-4c73-b398-9ca8863f0c3e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:37.819618 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74840969-d228-4a46-a14f-b7c8e130387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:37.820542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74840969-d228-4a46-a14f-b7c8e130387d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.820834 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74840969-d228-4a46-a14f-b7c8e130387d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.821147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74840969-d228-4a46-a14f-b7c8e130387d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.831762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74840969-d228-4a46-a14f-b7c8e130387d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:37.838887 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-74840969-d228-4a46-a14f-b7c8e130387d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:39:37.840501 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 396/795] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:37.841387 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74840969-d228-4a46-a14f-b7c8e130387d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:37.911283 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcbb0e-316f-4c73-b398-9ca8863f0c3e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:37.939541 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74840969-d228-4a46-a14f-b7c8e130387d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:37.954945 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356c016-12e4-447d-9c32-3880f893f57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:37.955755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356c016-12e4-447d-9c32-3880f893f57c None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.956034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356c016-12e4-447d-9c32-3880f893f57c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.956330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356c016-12e4-447d-9c32-3880f893f57c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.969650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356c016-12e4-447d-9c32-3880f893f57c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:37.971113 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356c016-12e4-447d-9c32-3880f893f57c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:37.981663 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d70ca1-b3b6-4eb8-b30e-18cc1bb2815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:37.982737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d70ca1-b3b6-4eb8-b30e-18cc1bb2815b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.983234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d70ca1-b3b6-4eb8-b30e-18cc1bb2815b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.983698 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d70ca1-b3b6-4eb8-b30e-18cc1bb2815b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.988061 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-0356c016-12e4-447d-9c32-3880f893f57c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:37.994307 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 400/796] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:37.994307 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356c016-12e4-447d-9c32-3880f893f57c None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:38.001484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d70ca1-b3b6-4eb8-b30e-18cc1bb2815b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:38.003237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d70ca1-b3b6-4eb8-b30e-18cc1bb2815b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:38.025494 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-72d70ca1-b3b6-4eb8-b30e-18cc1bb2815b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:38.032323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 397/797] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:38.032323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d70ca1-b3b6-4eb8-b30e-18cc1bb2815b None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:38.098857 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356c016-12e4-447d-9c32-3880f893f57c None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:38.144311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da1469-963b-4e91-ac4a-bc023bfb0c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:38.145548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da1469-963b-4e91-ac4a-bc023bfb0c32 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:38.146351 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da1469-963b-4e91-ac4a-bc023bfb0c32 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:38.146943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da1469-963b-4e91-ac4a-bc023bfb0c32 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:38.147997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da1469-963b-4e91-ac4a-bc023bfb0c32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:38.148624 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da1469-963b-4e91-ac4a-bc023bfb0c32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:38.150748 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da1469-963b-4e91-ac4a-bc023bfb0c32 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:38.155005 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d70ca1-b3b6-4eb8-b30e-18cc1bb2815b None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:38.162439 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 401/798] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:38.163412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da1469-963b-4e91-ac4a-bc023bfb0c32 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:38.194309 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53551783-e1b7-4c0e-9753-3bf9dce1ec48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:38.195310 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53551783-e1b7-4c0e-9753-3bf9dce1ec48 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:38.195831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53551783-e1b7-4c0e-9753-3bf9dce1ec48 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:38.196316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53551783-e1b7-4c0e-9753-3bf9dce1ec48 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:38.197234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53551783-e1b7-4c0e-9753-3bf9dce1ec48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:38.197729 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53551783-e1b7-4c0e-9753-3bf9dce1ec48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:38.199414 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53551783-e1b7-4c0e-9753-3bf9dce1ec48 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:38.211766 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 398/799] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:38.212985 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53551783-e1b7-4c0e-9753-3bf9dce1ec48 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:38.275709 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da1469-963b-4e91-ac4a-bc023bfb0c32 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:38.319223 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3e01a-bdca-47a1-82d2-c5a7d005b000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:38.320256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3e01a-bdca-47a1-82d2-c5a7d005b000 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:38.320547 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3e01a-bdca-47a1-82d2-c5a7d005b000 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:38.320821 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3e01a-bdca-47a1-82d2-c5a7d005b000 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:38.321813 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3e01a-bdca-47a1-82d2-c5a7d005b000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:38.322122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3e01a-bdca-47a1-82d2-c5a7d005b000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:38.324006 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3e01a-bdca-47a1-82d2-c5a7d005b000 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:38.330008 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53551783-e1b7-4c0e-9753-3bf9dce1ec48 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:38.340355 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 402/800] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:38.341614 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3e01a-bdca-47a1-82d2-c5a7d005b000 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:38.368778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd117477-e041-4307-bcfc-f053a2701062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:38.370070 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd117477-e041-4307-bcfc-f053a2701062 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:38.370591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd117477-e041-4307-bcfc-f053a2701062 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:38.371054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd117477-e041-4307-bcfc-f053a2701062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:38.382177 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd117477-e041-4307-bcfc-f053a2701062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:38.383902 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd117477-e041-4307-bcfc-f053a2701062 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:38.406659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-dd117477-e041-4307-bcfc-f053a2701062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:38.408567 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 399/801] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:38.409816 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd117477-e041-4307-bcfc-f053a2701062 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:38.469643 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3e01a-bdca-47a1-82d2-c5a7d005b000 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:38.503542 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fed617-a3b0-4436-a916-be966fae8fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:38.504411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fed617-a3b0-4436-a916-be966fae8fef None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:38.504696 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fed617-a3b0-4436-a916-be966fae8fef None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:38.504973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fed617-a3b0-4436-a916-be966fae8fef None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:38.512449 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fed617-a3b0-4436-a916-be966fae8fef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:38.513895 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fed617-a3b0-4436-a916-be966fae8fef None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:38.524664 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd117477-e041-4307-bcfc-f053a2701062 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:38.526777 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c3fed617-a3b0-4436-a916-be966fae8fef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:38.533247 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 403/802] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:38.533247 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fed617-a3b0-4436-a916-be966fae8fef None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:38.558673 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34897e32-e793-4ab7-b105-250290891fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:38.559486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34897e32-e793-4ab7-b105-250290891fc5 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:38.559763 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34897e32-e793-4ab7-b105-250290891fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:38.560028 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34897e32-e793-4ab7-b105-250290891fc5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:38.567651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34897e32-e793-4ab7-b105-250290891fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:38.569123 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34897e32-e793-4ab7-b105-250290891fc5 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:38.583030 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-34897e32-e793-4ab7-b105-250290891fc5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 12:39:38.584234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 400/803] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Nov 2 12:39:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:38.585428 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd278ca-3c0f-4d8d-9e73-e872e7c11e46 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:38.585918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd278ca-3c0f-4d8d-9e73-e872e7c11e46 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:38.586026 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd278ca-3c0f-4d8d-9e73-e872e7c11e46 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:38.587951 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 401/804] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:38.588651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd278ca-3c0f-4d8d-9e73-e872e7c11e46 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:38.632692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fed617-a3b0-4436-a916-be966fae8fef None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:38.666209 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6c798-cf7b-49ae-8161-7360a6cc8662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:38.666976 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6c798-cf7b-49ae-8161-7360a6cc8662 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:38.667260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6c798-cf7b-49ae-8161-7360a6cc8662 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:38.667529 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6c798-cf7b-49ae-8161-7360a6cc8662 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:38.668294 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6c798-cf7b-49ae-8161-7360a6cc8662 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:38.668595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6c798-cf7b-49ae-8161-7360a6cc8662 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:38.669957 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6c798-cf7b-49ae-8161-7360a6cc8662 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:38.681482 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 404/805] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:38.682780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d427a50-e06c-4100-a7a7-71d5ee175e1f None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:38.683067 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d427a50-e06c-4100-a7a7-71d5ee175e1f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:38.683334 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d427a50-e06c-4100-a7a7-71d5ee175e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:38.695874 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd278ca-3c0f-4d8d-9e73-e872e7c11e46 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:38.698973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-5d427a50-e06c-4100-a7a7-71d5ee175e1f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:38.700150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5d427a50-e06c-4100-a7a7-71d5ee175e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:38.730915 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b7753-116d-439a-98ea-233bef18fb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:38.731578 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b7753-116d-439a-98ea-233bef18fb49 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:38.731853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b7753-116d-439a-98ea-233bef18fb49 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:38.732122 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b7753-116d-439a-98ea-233bef18fb49 None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:38.733033 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b7753-116d-439a-98ea-233bef18fb49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:38.733486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b7753-116d-439a-98ea-233bef18fb49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:38.736271 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b7753-116d-439a-98ea-233bef18fb49 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:38.752248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 402/806] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:38.752248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b7753-116d-439a-98ea-233bef18fb49 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:38.780311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 405/807] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:38.780311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d427a50-e06c-4100-a7a7-71d5ee175e1f None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:38.861725 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b7753-116d-439a-98ea-233bef18fb49 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:38.863995 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d427a50-e06c-4100-a7a7-71d5ee175e1f None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:38.895961 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa266f-5bed-42ac-a4d4-48ea2631b12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:38.896137 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fa24f-09fd-40e2-814a-cf2646a51b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:38.896822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fa24f-09fd-40e2-814a-cf2646a51b9c None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:38.897103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fa24f-09fd-40e2-814a-cf2646a51b9c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:38.897381 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fa24f-09fd-40e2-814a-cf2646a51b9c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:38.897609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa266f-5bed-42ac-a4d4-48ea2631b12a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:38.898058 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa266f-5bed-42ac-a4d4-48ea2631b12a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:38.898509 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa266f-5bed-42ac-a4d4-48ea2631b12a None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:38.899501 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa266f-5bed-42ac-a4d4-48ea2631b12a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:38.899996 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa266f-5bed-42ac-a4d4-48ea2631b12a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:38.901646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa266f-5bed-42ac-a4d4-48ea2631b12a None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:38.906260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fa24f-09fd-40e2-814a-cf2646a51b9c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:38.907701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fa24f-09fd-40e2-814a-cf2646a51b9c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:38.924158 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 403/808] 10.222.0.90 () {56 vars in 1149 bytes} [Wed Nov 2 12:39:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:38.924158 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa266f-5bed-42ac-a4d4-48ea2631b12a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:38.924420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c97fa24f-09fd-40e2-814a-cf2646a51b9c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:39:38.924420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 406/809] 10.222.0.90 () {56 vars in 1093 bytes} [Wed Nov 2 12:39:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:38.924420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fa24f-09fd-40e2-814a-cf2646a51b9c None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:39.018999 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fa24f-09fd-40e2-814a-cf2646a51b9c None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:39.024726 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa266f-5bed-42ac-a4d4-48ea2631b12a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:39.054734 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f50ebe-e842-4911-abdf-3be7d794eb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:39.055477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f50ebe-e842-4911-abdf-3be7d794eb2a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:39.055737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f50ebe-e842-4911-abdf-3be7d794eb2a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:39.056005 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f50ebe-e842-4911-abdf-3be7d794eb2a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:39.056678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f50ebe-e842-4911-abdf-3be7d794eb2a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:39.057118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dead52-b9c6-40cd-bd13-2b69918522c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:39.058097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dead52-b9c6-40cd-bd13-2b69918522c6 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:39.058396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f50ebe-e842-4911-abdf-3be7d794eb2a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:39.058817 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dead52-b9c6-40cd-bd13-2b69918522c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:39.058817 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dead52-b9c6-40cd-bd13-2b69918522c6 None admin] PATH_INFO: `/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/baece5d60fe6407989b460fc6b747f6c/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:39.060799 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dead52-b9c6-40cd-bd13-2b69918522c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a08ee6d287714297a10248ad8e4522bc, user_id=baece5d60fe6407989b460fc6b747f6c, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:39.062237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dead52-b9c6-40cd-bd13-2b69918522c6 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:39.070079 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-d5f50ebe-e842-4911-abdf-3be7d794eb2a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 12:39:39.071268 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 407/810] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Nov 2 12:39:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:39.072024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f50ebe-e842-4911-abdf-3be7d794eb2a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:39.088518 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 404/811] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:39:38 2022] PUT /identity/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/baece5d60fe6407989b460fc6b747f6c/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:39.088518 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dead52-b9c6-40cd-bd13-2b69918522c6 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:39.193580 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f50ebe-e842-4911-abdf-3be7d794eb2a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:39.198417 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dead52-b9c6-40cd-bd13-2b69918522c6 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:39.230120 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae419a0-a460-49e7-800c-f55d43cdc0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:39.231114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae419a0-a460-49e7-800c-f55d43cdc0fb None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:39.231488 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae419a0-a460-49e7-800c-f55d43cdc0fb None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:39.231877 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae419a0-a460-49e7-800c-f55d43cdc0fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:39.235974 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295a7f4-a6ef-4b20-bc89-ede427d75b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:39.236719 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295a7f4-a6ef-4b20-bc89-ede427d75b91 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:39.237004 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295a7f4-a6ef-4b20-bc89-ede427d75b91 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:39.237282 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295a7f4-a6ef-4b20-bc89-ede427d75b91 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:39.238195 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295a7f4-a6ef-4b20-bc89-ede427d75b91 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:39.238511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295a7f4-a6ef-4b20-bc89-ede427d75b91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:39.240595 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295a7f4-a6ef-4b20-bc89-ede427d75b91 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:39.249575 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae419a0-a460-49e7-800c-f55d43cdc0fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:39.252384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae419a0-a460-49e7-800c-f55d43cdc0fb None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:39.261742 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 405/812] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Nov 2 12:39:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:39.262871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295a7f4-a6ef-4b20-bc89-ede427d75b91 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:39.280272 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-0ae419a0-a460-49e7-800c-f55d43cdc0fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:39.282115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 408/813] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:39.282941 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae419a0-a460-49e7-800c-f55d43cdc0fb None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:39.373551 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295a7f4-a6ef-4b20-bc89-ede427d75b91 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:39.406829 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae419a0-a460-49e7-800c-f55d43cdc0fb None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:39.408243 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bef16d-5d8b-4997-81c1-2c4683d47079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:39.409132 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bef16d-5d8b-4997-81c1-2c4683d47079 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:39.409578 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bef16d-5d8b-4997-81c1-2c4683d47079 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:39.409990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bef16d-5d8b-4997-81c1-2c4683d47079 None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:39.410856 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bef16d-5d8b-4997-81c1-2c4683d47079 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:39.411323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bef16d-5d8b-4997-81c1-2c4683d47079 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:39.412921 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bef16d-5d8b-4997-81c1-2c4683d47079 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:39.418387 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 406/814] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Nov 2 12:39:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:39.423915 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bef16d-5d8b-4997-81c1-2c4683d47079 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:39.443622 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822748f2-ccd6-4084-b8f5-ed9a9768858a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:39.444578 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822748f2-ccd6-4084-b8f5-ed9a9768858a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:39.445050 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822748f2-ccd6-4084-b8f5-ed9a9768858a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:39.445490 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822748f2-ccd6-4084-b8f5-ed9a9768858a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:39.536731 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822748f2-ccd6-4084-b8f5-ed9a9768858a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:39.538671 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822748f2-ccd6-4084-b8f5-ed9a9768858a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:39.540930 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bef16d-5d8b-4997-81c1-2c4683d47079 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:39.576089 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b53d2-f3ed-41be-82c6-8d5bf016e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:39.578068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b53d2-f3ed-41be-82c6-8d5bf016e02a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:39.578555 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b53d2-f3ed-41be-82c6-8d5bf016e02a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:39.579001 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b53d2-f3ed-41be-82c6-8d5bf016e02a None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:39.579913 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b53d2-f3ed-41be-82c6-8d5bf016e02a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:39.580463 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b53d2-f3ed-41be-82c6-8d5bf016e02a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:39.582504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b53d2-f3ed-41be-82c6-8d5bf016e02a None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:39.598225 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 407/815] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:39.599343 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b53d2-f3ed-41be-82c6-8d5bf016e02a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:39.664306 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 409/816] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:39:39.664306 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822748f2-ccd6-4084-b8f5-ed9a9768858a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:39.731758 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b53d2-f3ed-41be-82c6-8d5bf016e02a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:39.760700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822748f2-ccd6-4084-b8f5-ed9a9768858a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:39.773965 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3e88a-8216-4b3c-9975-e49b1ad5f183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:39.775619 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3e88a-8216-4b3c-9975-e49b1ad5f183 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:39.776194 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3e88a-8216-4b3c-9975-e49b1ad5f183 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:39.776844 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3e88a-8216-4b3c-9975-e49b1ad5f183 None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:39.778355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3e88a-8216-4b3c-9975-e49b1ad5f183 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:39.778861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3e88a-8216-4b3c-9975-e49b1ad5f183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:39.780927 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3e88a-8216-4b3c-9975-e49b1ad5f183 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:39.793191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 408/817] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Nov 2 12:39:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:39.793377 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3e88a-8216-4b3c-9975-e49b1ad5f183 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:39.800391 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977c878-49c2-42da-9252-86419b665cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:39.801198 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977c878-49c2-42da-9252-86419b665cd2 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:39.801472 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977c878-49c2-42da-9252-86419b665cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:39.801741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977c878-49c2-42da-9252-86419b665cd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:39.809614 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977c878-49c2-42da-9252-86419b665cd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:39.811266 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977c878-49c2-42da-9252-86419b665cd2 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:39.824440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-e977c878-49c2-42da-9252-86419b665cd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:39.830531 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 410/818] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:39.831380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977c878-49c2-42da-9252-86419b665cd2 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:39.899110 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3e88a-8216-4b3c-9975-e49b1ad5f183 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:39.933108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4ee34-30c7-445b-a9fc-ae5bd93e598d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:39.933933 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4ee34-30c7-445b-a9fc-ae5bd93e598d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:39.934368 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4ee34-30c7-445b-a9fc-ae5bd93e598d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:39.934492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4ee34-30c7-445b-a9fc-ae5bd93e598d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:39.942312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977c878-49c2-42da-9252-86419b665cd2 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:39.947646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4ee34-30c7-445b-a9fc-ae5bd93e598d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:39.947646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4ee34-30c7-445b-a9fc-ae5bd93e598d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:39.964762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-19f4ee34-30c7-445b-a9fc-ae5bd93e598d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:39.966186 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 409/819] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:39.966797 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4ee34-30c7-445b-a9fc-ae5bd93e598d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:39.979771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e21f3-cdfc-4916-8304-b9ea7395e6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:39.980460 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e21f3-cdfc-4916-8304-b9ea7395e6d7 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:39.980735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e21f3-cdfc-4916-8304-b9ea7395e6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:39.981003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e21f3-cdfc-4916-8304-b9ea7395e6d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:39.981737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e21f3-cdfc-4916-8304-b9ea7395e6d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:39.983188 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e21f3-cdfc-4916-8304-b9ea7395e6d7 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:40.012436 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 411/820] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:39:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:40.013980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faf804-3edf-4f1a-8491-2fbd5149c60c None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:40.014371 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faf804-3edf-4f1a-8491-2fbd5149c60c None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:40.014641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faf804-3edf-4f1a-8491-2fbd5149c60c None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:40.020868 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 412/821] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:40.021835 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faf804-3edf-4f1a-8491-2fbd5149c60c None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:40.087917 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4ee34-30c7-445b-a9fc-ae5bd93e598d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:40.135272 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dec6f0-f702-41a0-a399-99c36943ab6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:40.136404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dec6f0-f702-41a0-a399-99c36943ab6c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:40.136404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dec6f0-f702-41a0-a399-99c36943ab6c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:40.136809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dec6f0-f702-41a0-a399-99c36943ab6c None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:40.137364 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dec6f0-f702-41a0-a399-99c36943ab6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:40.137667 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dec6f0-f702-41a0-a399-99c36943ab6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:40.139160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dec6f0-f702-41a0-a399-99c36943ab6c None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:40.146605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faf804-3edf-4f1a-8491-2fbd5149c60c None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:40.158357 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 410/822] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:40.159858 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6398-04ae-40e1-854a-b7159e6e0a5d None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:40.160232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6398-04ae-40e1-854a-b7159e6e0a5d None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:40.160554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6398-04ae-40e1-854a-b7159e6e0a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:40.178141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-528b6398-04ae-40e1-854a-b7159e6e0a5d None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:40.179328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-528b6398-04ae-40e1-854a-b7159e6e0a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:40.185033 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf6a9d-4190-4229-8fb4-8b242515a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:40.185699 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf6a9d-4190-4229-8fb4-8b242515a7ca None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:40.185980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf6a9d-4190-4229-8fb4-8b242515a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:40.186366 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf6a9d-4190-4229-8fb4-8b242515a7ca None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:40.187147 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf6a9d-4190-4229-8fb4-8b242515a7ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:40.187449 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf6a9d-4190-4229-8fb4-8b242515a7ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:40.189037 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf6a9d-4190-4229-8fb4-8b242515a7ca None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:40.202455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 413/823] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:40.203360 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf6a9d-4190-4229-8fb4-8b242515a7ca None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:40.260840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 411/824] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:40.261825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b6398-04ae-40e1-854a-b7159e6e0a5d None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:40.314539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf6a9d-4190-4229-8fb4-8b242515a7ca None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:40.351732 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871079d-083e-4375-b650-19d30acd58be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:40.353222 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871079d-083e-4375-b650-19d30acd58be None admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:40.353495 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871079d-083e-4375-b650-19d30acd58be None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:40.353766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871079d-083e-4375-b650-19d30acd58be None admin] PATH_INFO: `/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/fef95ce95d4447a58063233a549adfe5/roles/63df47d6fc0740e6bc54a845c3f8a257` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:40.369596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b6398-04ae-40e1-854a-b7159e6e0a5d None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:40.372534 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871079d-083e-4375-b650-19d30acd58be None admin] RBAC: Authorizing `identity:create_grant(project_id=a08ee6d287714297a10248ad8e4522bc, user_id=fef95ce95d4447a58063233a549adfe5, role_id=63df47d6fc0740e6bc54a845c3f8a257)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:40.374911 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871079d-083e-4375-b650-19d30acd58be None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:40.396306 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 414/825] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:39:40 2022] PUT /identity/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/fef95ce95d4447a58063233a549adfe5/roles/63df47d6fc0740e6bc54a845c3f8a257 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:40.397878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871079d-083e-4375-b650-19d30acd58be None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:40.434285 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be268e-dcc7-48c8-ba8b-a3844b4920cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:40.435175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be268e-dcc7-48c8-ba8b-a3844b4920cc None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:40.435384 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be268e-dcc7-48c8-ba8b-a3844b4920cc None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:40.435650 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be268e-dcc7-48c8-ba8b-a3844b4920cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:40.453418 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be268e-dcc7-48c8-ba8b-a3844b4920cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:40.454894 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be268e-dcc7-48c8-ba8b-a3844b4920cc None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:40.480423 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-f0be268e-dcc7-48c8-ba8b-a3844b4920cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:40.482201 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 412/826] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:40.488035 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be268e-dcc7-48c8-ba8b-a3844b4920cc None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:40.582866 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871079d-083e-4375-b650-19d30acd58be None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:40.638834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa9fdd-b262-47e7-8b9f-be25f32af314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:40.639788 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa9fdd-b262-47e7-8b9f-be25f32af314 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:40.640057 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa9fdd-b262-47e7-8b9f-be25f32af314 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:40.640362 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa9fdd-b262-47e7-8b9f-be25f32af314 None admin] PATH_INFO: `/v3/services/network` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:40.641017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa9fdd-b262-47e7-8b9f-be25f32af314 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:40.642380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa9fdd-b262-47e7-8b9f-be25f32af314 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:40.656550 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-52aa9fdd-b262-47e7-8b9f-be25f32af314 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 12:39:40.658380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 415/827] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:40 2022] GET /identity/v3/services/network => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:40.664300 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa9fdd-b262-47e7-8b9f-be25f32af314 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:40.668849 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be268e-dcc7-48c8-ba8b-a3844b4920cc None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:40.705712 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02f15a-2c8f-4c20-8f6e-b5ee207d45f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:40.706544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02f15a-2c8f-4c20-8f6e-b5ee207d45f6 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:40.706544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02f15a-2c8f-4c20-8f6e-b5ee207d45f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:40.706821 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02f15a-2c8f-4c20-8f6e-b5ee207d45f6 None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:40.707600 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02f15a-2c8f-4c20-8f6e-b5ee207d45f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:40.707900 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02f15a-2c8f-4c20-8f6e-b5ee207d45f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:40.709384 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02f15a-2c8f-4c20-8f6e-b5ee207d45f6 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:40.724116 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 413/828] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:40.733826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02f15a-2c8f-4c20-8f6e-b5ee207d45f6 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:40.794952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa9fdd-b262-47e7-8b9f-be25f32af314 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:40.859881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5929f-c298-4028-92ed-f301d3b3c507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:40.860830 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5929f-c298-4028-92ed-f301d3b3c507 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:40.862586 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5929f-c298-4028-92ed-f301d3b3c507 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:40.862998 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5929f-c298-4028-92ed-f301d3b3c507 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:40.863867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5929f-c298-4028-92ed-f301d3b3c507 None admin] RBAC: Adding query filter params (name=network) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:40.865127 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5929f-c298-4028-92ed-f301d3b3c507 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:40.867478 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5929f-c298-4028-92ed-f301d3b3c507 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:40.877792 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 416/829] 10.222.0.90 () {56 vars in 1112 bytes} [Wed Nov 2 12:39:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:40.884517 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5929f-c298-4028-92ed-f301d3b3c507 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:40.907908 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02f15a-2c8f-4c20-8f6e-b5ee207d45f6 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:40.975045 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f80fbe-2e1a-4791-b365-2095aa6c6a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:40.975979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f80fbe-2e1a-4791-b365-2095aa6c6a65 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:40.976465 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f80fbe-2e1a-4791-b365-2095aa6c6a65 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:40.976871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f80fbe-2e1a-4791-b365-2095aa6c6a65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:40.977894 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f80fbe-2e1a-4791-b365-2095aa6c6a65 None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=fbcda58f298444eebf4f08ce01deffc0) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:40.979434 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f80fbe-2e1a-4791-b365-2095aa6c6a65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:40.981919 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f80fbe-2e1a-4791-b365-2095aa6c6a65 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:40.993847 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 414/830] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:40 2022] GET /identity/v3/role_assignments?user.id=fbcda58f298444eebf4f08ce01deffc0&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=85136c55809b4d9db97c263a72392ad1 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:41.066369 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5929f-c298-4028-92ed-f301d3b3c507 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:41.114781 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137d4ef-c624-4e57-8df3-9d82d1e24b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:41.115456 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137d4ef-c624-4e57-8df3-9d82d1e24b5a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:41.115730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137d4ef-c624-4e57-8df3-9d82d1e24b5a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:41.115998 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137d4ef-c624-4e57-8df3-9d82d1e24b5a None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:41.116739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137d4ef-c624-4e57-8df3-9d82d1e24b5a None admin] RBAC: Adding query filter params (type=network) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:41.117039 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137d4ef-c624-4e57-8df3-9d82d1e24b5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:41.118423 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137d4ef-c624-4e57-8df3-9d82d1e24b5a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:41.128357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 417/831] 10.222.0.90 () {56 vars in 1112 bytes} [Wed Nov 2 12:39:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:41.130179 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f80fbe-2e1a-4791-b365-2095aa6c6a65 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:41.279549 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f80fbe-2e1a-4791-b365-2095aa6c6a65 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:41.313458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e48eda-6505-410c-bd60-10cf2ed42021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:41.314120 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e48eda-6505-410c-bd60-10cf2ed42021 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:41.314396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e48eda-6505-410c-bd60-10cf2ed42021 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:41.314666 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e48eda-6505-410c-bd60-10cf2ed42021 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:41.315399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e48eda-6505-410c-bd60-10cf2ed42021 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:41.316817 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e48eda-6505-410c-bd60-10cf2ed42021 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:41.343035 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 415/832] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:39:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:41.664153 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68f80b-8925-4e9c-bb37-7046637464a0 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:41.664682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68f80b-8925-4e9c-bb37-7046637464a0 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:41.664682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68f80b-8925-4e9c-bb37-7046637464a0 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:41.666611 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 418/833] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:41.672772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba63f68-21e8-4e34-92ba-9cff89a18e23 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:41.673061 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba63f68-21e8-4e34-92ba-9cff89a18e23 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:41.673336 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba63f68-21e8-4e34-92ba-9cff89a18e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:41.694374 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-2ba63f68-21e8-4e34-92ba-9cff89a18e23 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:41.695547 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2ba63f68-21e8-4e34-92ba-9cff89a18e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:41.779722 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 416/834] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:41.813632 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68f80b-8925-4e9c-bb37-7046637464a0 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:41.914837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68f80b-8925-4e9c-bb37-7046637464a0 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:41.947636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bfeb0-7469-487e-88fe-718522bcc61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:41.948529 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bfeb0-7469-487e-88fe-718522bcc61a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:41.948812 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bfeb0-7469-487e-88fe-718522bcc61a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:41.949088 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bfeb0-7469-487e-88fe-718522bcc61a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:41.959309 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59bfeb0-7469-487e-88fe-718522bcc61a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:41.966112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-a59bfeb0-7469-487e-88fe-718522bcc61a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:39:41.967603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 419/835] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:39:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:41.973454 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba63f68-21e8-4e34-92ba-9cff89a18e23 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:42.073415 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba63f68-21e8-4e34-92ba-9cff89a18e23 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:42.107773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f518f47-c2ba-4cea-b130-1df8f306e785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:42.109055 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f518f47-c2ba-4cea-b130-1df8f306e785 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:42.109531 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f518f47-c2ba-4cea-b130-1df8f306e785 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:42.109993 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f518f47-c2ba-4cea-b130-1df8f306e785 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:42.110925 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f518f47-c2ba-4cea-b130-1df8f306e785 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:42.111421 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f518f47-c2ba-4cea-b130-1df8f306e785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:42.113030 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f518f47-c2ba-4cea-b130-1df8f306e785 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:42.122026 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 417/836] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:39:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:42.127458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bfeb0-7469-487e-88fe-718522bcc61a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:42.231831 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bfeb0-7469-487e-88fe-718522bcc61a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:42.265686 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf91c8e-95dc-47d0-b155-aaa71e9e5986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:42.266491 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf91c8e-95dc-47d0-b155-aaa71e9e5986 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:42.266770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf91c8e-95dc-47d0-b155-aaa71e9e5986 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:42.267037 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf91c8e-95dc-47d0-b155-aaa71e9e5986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:42.278083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf91c8e-95dc-47d0-b155-aaa71e9e5986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:42.279606 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf91c8e-95dc-47d0-b155-aaa71e9e5986 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:42.296861 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-8cf91c8e-95dc-47d0-b155-aaa71e9e5986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:42.298440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 420/837] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:42.304043 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f518f47-c2ba-4cea-b130-1df8f306e785 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:42.404672 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f518f47-c2ba-4cea-b130-1df8f306e785 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:42.441665 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea41d4-87cd-4d6f-918d-a891141a384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:42.442359 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea41d4-87cd-4d6f-918d-a891141a384f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:42.442641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea41d4-87cd-4d6f-918d-a891141a384f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:42.442911 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea41d4-87cd-4d6f-918d-a891141a384f None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:42.443635 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea41d4-87cd-4d6f-918d-a891141a384f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:42.443940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea41d4-87cd-4d6f-918d-a891141a384f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:42.445360 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea41d4-87cd-4d6f-918d-a891141a384f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:42.459502 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 418/838] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:42.465321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf91c8e-95dc-47d0-b155-aaa71e9e5986 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:42.556645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fc8c6-4dc7-475d-9788-e98414cf946c None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:42.556832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fc8c6-4dc7-475d-9788-e98414cf946c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:42.557229 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fc8c6-4dc7-475d-9788-e98414cf946c None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:42.559390 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 419/839] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:42.564458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d185e5-e12e-45b9-9d42-e10405c3c405 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:42.564897 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d185e5-e12e-45b9-9d42-e10405c3c405 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:42.565184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d185e5-e12e-45b9-9d42-e10405c3c405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:42.567017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf91c8e-95dc-47d0-b155-aaa71e9e5986 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:42.586531 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-e4d185e5-e12e-45b9-9d42-e10405c3c405 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:42.587770 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e4d185e5-e12e-45b9-9d42-e10405c3c405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:42.603094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe9511-8b8d-4d47-aac8-9688719109e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:42.603906 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe9511-8b8d-4d47-aac8-9688719109e3 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:42.604279 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe9511-8b8d-4d47-aac8-9688719109e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:42.604559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe9511-8b8d-4d47-aac8-9688719109e3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:42.612829 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe9511-8b8d-4d47-aac8-9688719109e3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:42.614349 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe9511-8b8d-4d47-aac8-9688719109e3 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:42.628994 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-cebe9511-8b8d-4d47-aac8-9688719109e3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 12:39:42.630594 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 421/840] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:39:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:42.636755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe9511-8b8d-4d47-aac8-9688719109e3 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:42.680353 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 420/841] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:39:42.701321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d185e5-e12e-45b9-9d42-e10405c3c405 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:42.757198 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe9511-8b8d-4d47-aac8-9688719109e3 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:42.799405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d185e5-e12e-45b9-9d42-e10405c3c405 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:42.804086 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcb1ae-8ea0-486b-8bcd-f16554398146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:42.804787 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcb1ae-8ea0-486b-8bcd-f16554398146 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:42.805069 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcb1ae-8ea0-486b-8bcd-f16554398146 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:42.805346 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcb1ae-8ea0-486b-8bcd-f16554398146 None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:42.806182 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcb1ae-8ea0-486b-8bcd-f16554398146 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:42.806964 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcb1ae-8ea0-486b-8bcd-f16554398146 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:42.808863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcb1ae-8ea0-486b-8bcd-f16554398146 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:42.831744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 422/842] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Nov 2 12:39:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:42.832916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcb1ae-8ea0-486b-8bcd-f16554398146 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:42.834760 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6c1e8-d8a9-4b06-9e02-3d7f1baac5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:42.835607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6c1e8-d8a9-4b06-9e02-3d7f1baac5bc None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:42.835885 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6c1e8-d8a9-4b06-9e02-3d7f1baac5bc None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:42.836151 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6c1e8-d8a9-4b06-9e02-3d7f1baac5bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:42.836856 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6c1e8-d8a9-4b06-9e02-3d7f1baac5bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:42.838305 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6c1e8-d8a9-4b06-9e02-3d7f1baac5bc None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:42.850089 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-4bb6c1e8-d8a9-4b06-9e02-3d7f1baac5bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 12:39:42.851583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 421/843] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:39:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:42.857794 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6c1e8-d8a9-4b06-9e02-3d7f1baac5bc None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:42.952244 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcb1ae-8ea0-486b-8bcd-f16554398146 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:42.976845 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6c1e8-d8a9-4b06-9e02-3d7f1baac5bc None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:42.996594 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce24cba-3071-4b70-a94b-7488e75346bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:42.997735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce24cba-3071-4b70-a94b-7488e75346bf None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:42.998388 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce24cba-3071-4b70-a94b-7488e75346bf None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:42.998844 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce24cba-3071-4b70-a94b-7488e75346bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:43.018280 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b68787-46d6-4317-9c35-fd4be7fb9d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:43.018949 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b68787-46d6-4317-9c35-fd4be7fb9d6b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:43.019224 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b68787-46d6-4317-9c35-fd4be7fb9d6b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:43.019500 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b68787-46d6-4317-9c35-fd4be7fb9d6b None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:43.020225 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b68787-46d6-4317-9c35-fd4be7fb9d6b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:43.020528 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b68787-46d6-4317-9c35-fd4be7fb9d6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:43.021895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b68787-46d6-4317-9c35-fd4be7fb9d6b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:43.026831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 422/844] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:39:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:43.028546 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247608cf-7386-45c4-a9e8-d48154924ac7 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:43.028831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247608cf-7386-45c4-a9e8-d48154924ac7 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:43.029105 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247608cf-7386-45c4-a9e8-d48154924ac7 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:43.030891 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 423/845] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:43.033404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247608cf-7386-45c4-a9e8-d48154924ac7 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:43.072481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce24cba-3071-4b70-a94b-7488e75346bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:43.073907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce24cba-3071-4b70-a94b-7488e75346bf None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:43.135932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247608cf-7386-45c4-a9e8-d48154924ac7 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:43.169485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302ad88-12c3-45a5-a35c-a6c5401b675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:43.170156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302ad88-12c3-45a5-a35c-a6c5401b675a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:43.170442 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302ad88-12c3-45a5-a35c-a6c5401b675a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:43.170803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302ad88-12c3-45a5-a35c-a6c5401b675a None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:43.171872 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302ad88-12c3-45a5-a35c-a6c5401b675a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:43.172183 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302ad88-12c3-45a5-a35c-a6c5401b675a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:43.172382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 423/846] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:42 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:39:43.173609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302ad88-12c3-45a5-a35c-a6c5401b675a None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:43.174018 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a9ae8-0860-4d03-892d-120aa2e0d051 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:43.174509 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a9ae8-0860-4d03-892d-120aa2e0d051 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:43.174948 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a9ae8-0860-4d03-892d-120aa2e0d051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:43.188662 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 424/847] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:39:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:43.189709 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302ad88-12c3-45a5-a35c-a6c5401b675a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:43.192052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-1e8a9ae8-0860-4d03-892d-120aa2e0d051 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:43.193354 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1e8a9ae8-0860-4d03-892d-120aa2e0d051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:43.272650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 424/848] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:43.291341 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a9ae8-0860-4d03-892d-120aa2e0d051 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:43.302838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302ad88-12c3-45a5-a35c-a6c5401b675a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:43.338932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315396d-d507-4bed-a32c-11dd10e833a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:43.339665 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315396d-d507-4bed-a32c-11dd10e833a4 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:43.339929 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315396d-d507-4bed-a32c-11dd10e833a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:43.340195 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315396d-d507-4bed-a32c-11dd10e833a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:43.351245 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315396d-d507-4bed-a32c-11dd10e833a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:43.352758 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315396d-d507-4bed-a32c-11dd10e833a4 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:43.380186 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-a315396d-d507-4bed-a32c-11dd10e833a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:43.380186 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 425/849] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:43.380186 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315396d-d507-4bed-a32c-11dd10e833a4 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:43.398695 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a9ae8-0860-4d03-892d-120aa2e0d051 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:43.438729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c187326-fae5-4462-a68d-bfd6e12691da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:43.439632 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c187326-fae5-4462-a68d-bfd6e12691da None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:43.439932 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c187326-fae5-4462-a68d-bfd6e12691da None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:43.440517 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c187326-fae5-4462-a68d-bfd6e12691da None admin] PATH_INFO: `/v3/roles/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:43.455690 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c187326-fae5-4462-a68d-bfd6e12691da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:43.465502 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-2c187326-fae5-4462-a68d-bfd6e12691da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:39:43.467466 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 425/850] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:39:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:43.474292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c187326-fae5-4462-a68d-bfd6e12691da None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:43.508478 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315396d-d507-4bed-a32c-11dd10e833a4 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:43.553464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59dcb9-6b62-4e6f-aec4-f908d03521af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:43.555311 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59dcb9-6b62-4e6f-aec4-f908d03521af None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:43.555769 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59dcb9-6b62-4e6f-aec4-f908d03521af None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:43.556232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59dcb9-6b62-4e6f-aec4-f908d03521af None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:43.557122 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59dcb9-6b62-4e6f-aec4-f908d03521af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:43.557677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59dcb9-6b62-4e6f-aec4-f908d03521af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:43.559209 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59dcb9-6b62-4e6f-aec4-f908d03521af None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:43.581954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 426/851] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:43.583889 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59dcb9-6b62-4e6f-aec4-f908d03521af None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:43.594797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c187326-fae5-4462-a68d-bfd6e12691da None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:43.627783 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4298a-2a91-463c-95d8-a7fcc1623334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:43.628842 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4298a-2a91-463c-95d8-a7fcc1623334 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:43.629318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4298a-2a91-463c-95d8-a7fcc1623334 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:43.629779 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4298a-2a91-463c-95d8-a7fcc1623334 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:43.630729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4298a-2a91-463c-95d8-a7fcc1623334 None admin] RBAC: Adding query filter params (name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:43.631247 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4298a-2a91-463c-95d8-a7fcc1623334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:43.632943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4298a-2a91-463c-95d8-a7fcc1623334 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:43.646458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 426/852] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:39:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:43.647713 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4298a-2a91-463c-95d8-a7fcc1623334 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:43.698315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59dcb9-6b62-4e6f-aec4-f908d03521af None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:43.733103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1773-4d15-4959-b5b1-b4e9a04c0154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:43.734255 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1773-4d15-4959-b5b1-b4e9a04c0154 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:43.734782 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1773-4d15-4959-b5b1-b4e9a04c0154 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:43.735279 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1773-4d15-4959-b5b1-b4e9a04c0154 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:43.742856 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1773-4d15-4959-b5b1-b4e9a04c0154 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:43.744609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1773-4d15-4959-b5b1-b4e9a04c0154 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:43.758586 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-707a1773-4d15-4959-b5b1-b4e9a04c0154 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:43.760419 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 427/853] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:43.764975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4298a-2a91-463c-95d8-a7fcc1623334 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:43.767098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1773-4d15-4959-b5b1-b4e9a04c0154 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:43.800864 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530607c9-958e-419f-9db8-0c7180812ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:43.802076 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530607c9-958e-419f-9db8-0c7180812ec9 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:43.802591 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530607c9-958e-419f-9db8-0c7180812ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:43.803099 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530607c9-958e-419f-9db8-0c7180812ec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:43.814335 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530607c9-958e-419f-9db8-0c7180812ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:43.816140 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530607c9-958e-419f-9db8-0c7180812ec9 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:43.833363 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-530607c9-958e-419f-9db8-0c7180812ec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:43.834692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 427/854] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:43.835740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0437def-bc16-4f7d-baa6-84eccae05a83 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:43.836018 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0437def-bc16-4f7d-baa6-84eccae05a83 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:43.836317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0437def-bc16-4f7d-baa6-84eccae05a83 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:43.838065 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 428/855] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:43.842383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0437def-bc16-4f7d-baa6-84eccae05a83 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:43.877099 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1773-4d15-4959-b5b1-b4e9a04c0154 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:43.910707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f071f1-2a42-4e37-bd51-86ad31ada352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:43.911362 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f071f1-2a42-4e37-bd51-86ad31ada352 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:43.911635 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f071f1-2a42-4e37-bd51-86ad31ada352 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:43.911886 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f071f1-2a42-4e37-bd51-86ad31ada352 None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:43.912693 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f071f1-2a42-4e37-bd51-86ad31ada352 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:43.913049 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f071f1-2a42-4e37-bd51-86ad31ada352 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:43.914477 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f071f1-2a42-4e37-bd51-86ad31ada352 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:43.931159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 428/856] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:43.932559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06df0d-8e93-40b6-b8e1-118fdcd7408c None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:43.932848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06df0d-8e93-40b6-b8e1-118fdcd7408c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:43.933104 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06df0d-8e93-40b6-b8e1-118fdcd7408c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:43.942857 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0437def-bc16-4f7d-baa6-84eccae05a83 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:43.952417 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-8c06df0d-8e93-40b6-b8e1-118fdcd7408c None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:43.954170 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8c06df0d-8e93-40b6-b8e1-118fdcd7408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:43.975679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348ee76-2fdf-4a20-82fe-ae21aef93662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:43.976375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348ee76-2fdf-4a20-82fe-ae21aef93662 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:43.976637 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348ee76-2fdf-4a20-82fe-ae21aef93662 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:43.976923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348ee76-2fdf-4a20-82fe-ae21aef93662 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:43.977651 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348ee76-2fdf-4a20-82fe-ae21aef93662 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:43.977951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348ee76-2fdf-4a20-82fe-ae21aef93662 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:43.979396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348ee76-2fdf-4a20-82fe-ae21aef93662 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:43.996617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 429/857] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:43.996617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348ee76-2fdf-4a20-82fe-ae21aef93662 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:44.029727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 429/858] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:44.030990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06df0d-8e93-40b6-b8e1-118fdcd7408c None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:44.101440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348ee76-2fdf-4a20-82fe-ae21aef93662 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:44.126191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06df0d-8e93-40b6-b8e1-118fdcd7408c None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:44.133617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f22ce-0483-453e-baab-3cf2efb4a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:44.134219 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f22ce-0483-453e-baab-3cf2efb4a6eb None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:44.134489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f22ce-0483-453e-baab-3cf2efb4a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:44.134755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f22ce-0483-453e-baab-3cf2efb4a6eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:44.135629 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f22ce-0483-453e-baab-3cf2efb4a6eb None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=baece5d60fe6407989b460fc6b747f6c) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:44.135932 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f22ce-0483-453e-baab-3cf2efb4a6eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:44.137415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f22ce-0483-453e-baab-3cf2efb4a6eb None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:44.152445 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 430/859] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:43 2022] GET /identity/v3/role_assignments?user.id=baece5d60fe6407989b460fc6b747f6c&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=85136c55809b4d9db97c263a72392ad1 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:44.152445 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f22ce-0483-453e-baab-3cf2efb4a6eb None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:44.178167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a96de-7f06-41b3-ab51-0b815f7f420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:44.179739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a96de-7f06-41b3-ab51-0b815f7f420e None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:44.180065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a96de-7f06-41b3-ab51-0b815f7f420e None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:44.180638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a96de-7f06-41b3-ab51-0b815f7f420e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:44.192230 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a96de-7f06-41b3-ab51-0b815f7f420e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:44.193657 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a96de-7f06-41b3-ab51-0b815f7f420e None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:44.214650 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-105a96de-7f06-41b3-ab51-0b815f7f420e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 12:39:44.216429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 430/860] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Nov 2 12:39:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:44.223647 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a96de-7f06-41b3-ab51-0b815f7f420e None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:44.266237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f22ce-0483-453e-baab-3cf2efb4a6eb None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:44.308828 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1d148-ca8a-4b06-8a83-ac97507d8e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:44.312949 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1d148-ca8a-4b06-8a83-ac97507d8e81 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:44.313453 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1d148-ca8a-4b06-8a83-ac97507d8e81 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:44.313829 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1d148-ca8a-4b06-8a83-ac97507d8e81 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:44.314625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1d148-ca8a-4b06-8a83-ac97507d8e81 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:44.316159 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1d148-ca8a-4b06-8a83-ac97507d8e81 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:44.328471 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-34a1d148-ca8a-4b06-8a83-ac97507d8e81 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 12:39:44.330208 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 431/861] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Nov 2 12:39:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:44.345333 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1d148-ca8a-4b06-8a83-ac97507d8e81 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:44.352726 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a96de-7f06-41b3-ab51-0b815f7f420e None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:44.395563 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd9834-0689-40ad-b074-fdfe456f0832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:44.396168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd9834-0689-40ad-b074-fdfe456f0832 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:44.396498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd9834-0689-40ad-b074-fdfe456f0832 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:44.396774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd9834-0689-40ad-b074-fdfe456f0832 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:44.397610 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd9834-0689-40ad-b074-fdfe456f0832 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:44.397919 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd9834-0689-40ad-b074-fdfe456f0832 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:44.399350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd9834-0689-40ad-b074-fdfe456f0832 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:44.419032 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 431/862] 10.222.0.90 () {56 vars in 1149 bytes} [Wed Nov 2 12:39:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:44.425236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd9834-0689-40ad-b074-fdfe456f0832 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:44.474673 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1d148-ca8a-4b06-8a83-ac97507d8e81 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:44.515260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4ea3e-4f86-46ab-b4c4-7c0cf59e7fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:44.516211 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4ea3e-4f86-46ab-b4c4-7c0cf59e7fa2 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:44.516498 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4ea3e-4f86-46ab-b4c4-7c0cf59e7fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:44.516769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4ea3e-4f86-46ab-b4c4-7c0cf59e7fa2 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:44.517633 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4ea3e-4f86-46ab-b4c4-7c0cf59e7fa2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:44.517938 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4ea3e-4f86-46ab-b4c4-7c0cf59e7fa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:44.519599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4ea3e-4f86-46ab-b4c4-7c0cf59e7fa2 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:44.528285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 432/863] 10.222.0.90 () {56 vars in 1126 bytes} [Wed Nov 2 12:39:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:44.532334 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4ea3e-4f86-46ab-b4c4-7c0cf59e7fa2 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:44.539621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd9834-0689-40ad-b074-fdfe456f0832 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:44.573274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897758a-8a14-4cf9-87dc-23c8b405a75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:44.573952 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897758a-8a14-4cf9-87dc-23c8b405a75c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:44.574228 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897758a-8a14-4cf9-87dc-23c8b405a75c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:44.574496 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897758a-8a14-4cf9-87dc-23c8b405a75c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:44.646651 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4ea3e-4f86-46ab-b4c4-7c0cf59e7fa2 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:44.656926 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897758a-8a14-4cf9-87dc-23c8b405a75c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:44.658938 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897758a-8a14-4cf9-87dc-23c8b405a75c None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:44.679981 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48a4cf-fc6b-4d42-8385-681b09a04216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:44.680896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48a4cf-fc6b-4d42-8385-681b09a04216 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:44.681272 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48a4cf-fc6b-4d42-8385-681b09a04216 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:44.681639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48a4cf-fc6b-4d42-8385-681b09a04216 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:44.682470 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48a4cf-fc6b-4d42-8385-681b09a04216 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:44.682866 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48a4cf-fc6b-4d42-8385-681b09a04216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:44.684381 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48a4cf-fc6b-4d42-8385-681b09a04216 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:44.695864 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 433/864] 10.222.0.90 () {56 vars in 1126 bytes} [Wed Nov 2 12:39:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:44.768997 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 432/865] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 12:39:44.774822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48a4cf-fc6b-4d42-8385-681b09a04216 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:44.885363 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48a4cf-fc6b-4d42-8385-681b09a04216 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:44.918229 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3c426-ec1d-4858-b333-6e353379b200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:44.918952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3c426-ec1d-4858-b333-6e353379b200 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:44.919229 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3c426-ec1d-4858-b333-6e353379b200 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:44.919503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3c426-ec1d-4858-b333-6e353379b200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:44.930231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3c426-ec1d-4858-b333-6e353379b200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:44.931693 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3c426-ec1d-4858-b333-6e353379b200 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:44.948411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c7e3c426-ec1d-4858-b333-6e353379b200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:44.949945 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 434/866] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:44.955577 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897758a-8a14-4cf9-87dc-23c8b405a75c None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:45.058296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897758a-8a14-4cf9-87dc-23c8b405a75c None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:45.095236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f543bf8-3e91-4d62-b7c0-f25b115fdec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:45.095905 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f543bf8-3e91-4d62-b7c0-f25b115fdec1 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:45.096180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f543bf8-3e91-4d62-b7c0-f25b115fdec1 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:45.096501 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f543bf8-3e91-4d62-b7c0-f25b115fdec1 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:45.097216 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f543bf8-3e91-4d62-b7c0-f25b115fdec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:45.097515 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f543bf8-3e91-4d62-b7c0-f25b115fdec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:45.098885 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f543bf8-3e91-4d62-b7c0-f25b115fdec1 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:45.110624 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 433/867] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:45.115776 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3c426-ec1d-4858-b333-6e353379b200 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:45.224769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3c426-ec1d-4858-b333-6e353379b200 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:45.258556 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f6178-7ac9-4e4e-bfb6-da2d3e3d7d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:45.259360 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f6178-7ac9-4e4e-bfb6-da2d3e3d7d9e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:45.259632 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f6178-7ac9-4e4e-bfb6-da2d3e3d7d9e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:45.259899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f6178-7ac9-4e4e-bfb6-da2d3e3d7d9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:45.266973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f6178-7ac9-4e4e-bfb6-da2d3e3d7d9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:45.268438 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f6178-7ac9-4e4e-bfb6-da2d3e3d7d9e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:45.282191 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-263f6178-7ac9-4e4e-bfb6-da2d3e3d7d9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:45.283717 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 435/868] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:45.289568 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f543bf8-3e91-4d62-b7c0-f25b115fdec1 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:45.393831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f543bf8-3e91-4d62-b7c0-f25b115fdec1 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:45.429133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb7d96-95d1-456c-8171-f2d6a8730495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:45.430208 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb7d96-95d1-456c-8171-f2d6a8730495 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:45.430699 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb7d96-95d1-456c-8171-f2d6a8730495 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:45.431174 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb7d96-95d1-456c-8171-f2d6a8730495 None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:45.432254 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb7d96-95d1-456c-8171-f2d6a8730495 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:45.432819 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb7d96-95d1-456c-8171-f2d6a8730495 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:45.435289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb7d96-95d1-456c-8171-f2d6a8730495 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:45.450378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 434/869] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:45.456106 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f6178-7ac9-4e4e-bfb6-da2d3e3d7d9e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:45.570535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f6178-7ac9-4e4e-bfb6-da2d3e3d7d9e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:45.571677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b540ff5-7b8c-45d6-964c-34276159d17f None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:45.572347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b540ff5-7b8c-45d6-964c-34276159d17f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:45.572623 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b540ff5-7b8c-45d6-964c-34276159d17f None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:45.575801 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 435/870] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:39:45.581608 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0364f40-34cf-4736-be69-f9b17d5cbf28 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:45.581902 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0364f40-34cf-4736-be69-f9b17d5cbf28 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:45.582186 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0364f40-34cf-4736-be69-f9b17d5cbf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:45.598981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-b0364f40-34cf-4736-be69-f9b17d5cbf28 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:45.600492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b0364f40-34cf-4736-be69-f9b17d5cbf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:45.612650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab11f10-36ed-4375-8e44-fe6bad244038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:45.613673 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab11f10-36ed-4375-8e44-fe6bad244038 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:45.614084 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab11f10-36ed-4375-8e44-fe6bad244038 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:45.614560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab11f10-36ed-4375-8e44-fe6bad244038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:45.615522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab11f10-36ed-4375-8e44-fe6bad244038 None admin] RBAC: Adding query filter params (role.id=63df47d6fc0740e6bc54a845c3f8a257, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=fef95ce95d4447a58063233a549adfe5) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:45.615980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab11f10-36ed-4375-8e44-fe6bad244038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:45.617560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab11f10-36ed-4375-8e44-fe6bad244038 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:45.624062 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 436/871] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:45 2022] GET /identity/v3/role_assignments?user.id=fef95ce95d4447a58063233a549adfe5&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=63df47d6fc0740e6bc54a845c3f8a257 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:45.672591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 436/872] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:45.696121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab11f10-36ed-4375-8e44-fe6bad244038 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:45.803737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab11f10-36ed-4375-8e44-fe6bad244038 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:45.839383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398cc92-1528-4882-9394-ff72e7afe2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:45.839982 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398cc92-1528-4882-9394-ff72e7afe2dd None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:45.840332 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398cc92-1528-4882-9394-ff72e7afe2dd None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:45.840612 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398cc92-1528-4882-9394-ff72e7afe2dd None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:45.841397 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398cc92-1528-4882-9394-ff72e7afe2dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:45.842782 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398cc92-1528-4882-9394-ff72e7afe2dd None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:45.858028 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 437/873] 10.222.0.90 () {60 vars in 1141 bytes} [Wed Nov 2 12:39:45 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:46.662148 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679fa1d-8f5a-430c-8e97-06d3e158c633 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:46.663041 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679fa1d-8f5a-430c-8e97-06d3e158c633 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:46.663486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679fa1d-8f5a-430c-8e97-06d3e158c633 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:46.665756 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 437/874] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:46.671560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203933f6-c979-47b6-b201-26553767f5d9 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:46.672147 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203933f6-c979-47b6-b201-26553767f5d9 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:46.672676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203933f6-c979-47b6-b201-26553767f5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:46.690524 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-203933f6-c979-47b6-b201-26553767f5d9 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:46.692027 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-203933f6-c979-47b6-b201-26553767f5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:46.769136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 438/875] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:46 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:46.794005 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679fa1d-8f5a-430c-8e97-06d3e158c633 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:46.900168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679fa1d-8f5a-430c-8e97-06d3e158c633 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:46.935650 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22151b14-1ad3-4e41-bd0e-b9aef1feeb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:46.937011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22151b14-1ad3-4e41-bd0e-b9aef1feeb31 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:46.937536 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22151b14-1ad3-4e41-bd0e-b9aef1feeb31 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:46.938041 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22151b14-1ad3-4e41-bd0e-b9aef1feeb31 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:46.938895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22151b14-1ad3-4e41-bd0e-b9aef1feeb31 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:46.940517 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22151b14-1ad3-4e41-bd0e-b9aef1feeb31 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:46.952702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-22151b14-1ad3-4e41-bd0e-b9aef1feeb31 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:39:46.954494 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 438/876] 10.222.0.90 () {56 vars in 1126 bytes} [Wed Nov 2 12:39:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:46.961007 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203933f6-c979-47b6-b201-26553767f5d9 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:47.064236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203933f6-c979-47b6-b201-26553767f5d9 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:47.099390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474e6a8-ce3e-4505-9c5f-a8c2c4cfd2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:47.100602 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474e6a8-ce3e-4505-9c5f-a8c2c4cfd2ea None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:47.101136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474e6a8-ce3e-4505-9c5f-a8c2c4cfd2ea None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:47.101617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474e6a8-ce3e-4505-9c5f-a8c2c4cfd2ea None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:47.102538 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474e6a8-ce3e-4505-9c5f-a8c2c4cfd2ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:47.103086 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474e6a8-ce3e-4505-9c5f-a8c2c4cfd2ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:47.104779 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474e6a8-ce3e-4505-9c5f-a8c2c4cfd2ea None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:47.110212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 439/877] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Nov 2 12:39:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:47.116426 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22151b14-1ad3-4e41-bd0e-b9aef1feeb31 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:47.159135 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a559b6-ff53-49a0-b210-1e4889596f14 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:47.159780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a559b6-ff53-49a0-b210-1e4889596f14 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:47.160285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a559b6-ff53-49a0-b210-1e4889596f14 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:47.162933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 440/878] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:39:47.168406 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ff13d-ee94-4174-a461-8866af5cb445 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:47.168946 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ff13d-ee94-4174-a461-8866af5cb445 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:47.169432 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ff13d-ee94-4174-a461-8866af5cb445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:47.186176 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-004ff13d-ee94-4174-a461-8866af5cb445 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:47.187718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-004ff13d-ee94-4174-a461-8866af5cb445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:47.221677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22151b14-1ad3-4e41-bd0e-b9aef1feeb31 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:47.254672 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8a71d-0e9a-4357-9a2f-f7f89be5071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:47.260530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8a71d-0e9a-4357-9a2f-f7f89be5071e None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:47.260530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8a71d-0e9a-4357-9a2f-f7f89be5071e None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:47.260530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8a71d-0e9a-4357-9a2f-f7f89be5071e None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:47.260530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8a71d-0e9a-4357-9a2f-f7f89be5071e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:47.260530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8a71d-0e9a-4357-9a2f-f7f89be5071e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:47.260530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8a71d-0e9a-4357-9a2f-f7f89be5071e None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:47.261361 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 441/879] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:47 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:47.263089 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 439/880] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Nov 2 12:39:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:47.281939 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ff13d-ee94-4174-a461-8866af5cb445 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:47.386272 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ff13d-ee94-4174-a461-8866af5cb445 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:47.424900 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b469b5-50bc-4976-a19e-62f5c02ef997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:47.425950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b469b5-50bc-4976-a19e-62f5c02ef997 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:47.426431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b469b5-50bc-4976-a19e-62f5c02ef997 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:47.426902 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b469b5-50bc-4976-a19e-62f5c02ef997 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:47.427866 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b469b5-50bc-4976-a19e-62f5c02ef997 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:47.429514 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b469b5-50bc-4976-a19e-62f5c02ef997 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:47.449359 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 442/881] 10.222.0.90 () {60 vars in 1141 bytes} [Wed Nov 2 12:39:47 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:48.069249 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d5ae-f4be-4394-a2aa-3de8cc71ea4a None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:48.069798 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d5ae-f4be-4394-a2aa-3de8cc71ea4a None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:48.070010 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d5ae-f4be-4394-a2aa-3de8cc71ea4a None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:48.072064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 440/882] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:48.077372 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa8ee-c587-44be-a2a0-31cce0f66036 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:48.077805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa8ee-c587-44be-a2a0-31cce0f66036 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:48.078110 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa8ee-c587-44be-a2a0-31cce0f66036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:48.095156 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-deefa8ee-c587-44be-a2a0-31cce0f66036 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:48.096365 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-deefa8ee-c587-44be-a2a0-31cce0f66036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:48.169094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 443/883] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:48.192712 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6d5ae-f4be-4394-a2aa-3de8cc71ea4a None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:48.206903 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63526fd4-77fd-4cb9-b894-eaf5b75d627d None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:48.207184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63526fd4-77fd-4cb9-b894-eaf5b75d627d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:48.207455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63526fd4-77fd-4cb9-b894-eaf5b75d627d None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:48.210521 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 444/884] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:39:48.214668 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceb5aa-aa87-480a-826e-895efeda2ce5 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:48.214948 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceb5aa-aa87-480a-826e-895efeda2ce5 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:48.215223 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceb5aa-aa87-480a-826e-895efeda2ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:48.231731 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-26ceb5aa-aa87-480a-826e-895efeda2ce5 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:48.233098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-26ceb5aa-aa87-480a-826e-895efeda2ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:48.298457 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6d5ae-f4be-4394-a2aa-3de8cc71ea4a None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:48.304904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 445/885] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:39:48.327812 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ceb5aa-aa87-480a-826e-895efeda2ce5 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:48.339761 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaca431-9124-4fbf-b148-4632512ea9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:48.340956 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaca431-9124-4fbf-b148-4632512ea9ab None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:48.341430 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaca431-9124-4fbf-b148-4632512ea9ab None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:48.341897 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaca431-9124-4fbf-b148-4632512ea9ab None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:48.356250 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaca431-9124-4fbf-b148-4632512ea9ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:48.361022 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-abaca431-9124-4fbf-b148-4632512ea9ab None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 12:39:48.362586 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 441/886] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Nov 2 12:39:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:48.367939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaca431-9124-4fbf-b148-4632512ea9ab None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:48.441612 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ceb5aa-aa87-480a-826e-895efeda2ce5 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:48.478379 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaca431-9124-4fbf-b148-4632512ea9ab None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:48.491103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c6384-cc81-441d-8975-d440f4c41242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:48.492581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c6384-cc81-441d-8975-d440f4c41242 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:48.493295 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c6384-cc81-441d-8975-d440f4c41242 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:48.493741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c6384-cc81-441d-8975-d440f4c41242 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:48.494771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c6384-cc81-441d-8975-d440f4c41242 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:48.498341 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c6384-cc81-441d-8975-d440f4c41242 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:48.520751 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-292c6384-cc81-441d-8975-d440f4c41242 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 12:39:48.522843 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 446/887] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:39:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:48.523471 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2bf3b-a533-4a94-812b-7e407f86b15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:48.532233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2bf3b-a533-4a94-812b-7e407f86b15d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:48.532233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2bf3b-a533-4a94-812b-7e407f86b15d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:48.532233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2bf3b-a533-4a94-812b-7e407f86b15d None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:48.532233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2bf3b-a533-4a94-812b-7e407f86b15d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:48.532233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2bf3b-a533-4a94-812b-7e407f86b15d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:48.532233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2bf3b-a533-4a94-812b-7e407f86b15d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:48.532747 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c6384-cc81-441d-8975-d440f4c41242 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:48.547239 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 442/888] 10.222.0.90 () {56 vars in 1115 bytes} [Wed Nov 2 12:39:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:48.548755 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2bf3b-a533-4a94-812b-7e407f86b15d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:48.629583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c6384-cc81-441d-8975-d440f4c41242 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:48.648228 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2bf3b-a533-4a94-812b-7e407f86b15d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:48.662999 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30a5cd-e98a-4725-ab61-4887832a79f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:48.663669 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30a5cd-e98a-4725-ab61-4887832a79f2 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:48.663944 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30a5cd-e98a-4725-ab61-4887832a79f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:48.664226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30a5cd-e98a-4725-ab61-4887832a79f2 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:48.664949 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30a5cd-e98a-4725-ab61-4887832a79f2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:48.665249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30a5cd-e98a-4725-ab61-4887832a79f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:48.666733 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30a5cd-e98a-4725-ab61-4887832a79f2 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:48.676212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 447/889] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:39:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:48.677602 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30a5cd-e98a-4725-ab61-4887832a79f2 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:48.685571 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7ad6e-72b4-4f8f-81c2-920898b066b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:48.687009 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7ad6e-72b4-4f8f-81c2-920898b066b8 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:48.687500 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7ad6e-72b4-4f8f-81c2-920898b066b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:48.688325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7ad6e-72b4-4f8f-81c2-920898b066b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:48.701421 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7ad6e-72b4-4f8f-81c2-920898b066b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:48.703311 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7ad6e-72b4-4f8f-81c2-920898b066b8 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:48.721363 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-9dd7ad6e-72b4-4f8f-81c2-920898b066b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:48.727669 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 443/890] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:48.728710 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7ad6e-72b4-4f8f-81c2-920898b066b8 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:48.775341 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30a5cd-e98a-4725-ab61-4887832a79f2 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:48.810008 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4ed28-81e6-4cc4-8076-66bc0dedf75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:48.810696 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ed28-81e6-4cc4-8076-66bc0dedf75e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:48.811061 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ed28-81e6-4cc4-8076-66bc0dedf75e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:48.811332 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ed28-81e6-4cc4-8076-66bc0dedf75e None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:48.812033 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4ed28-81e6-4cc4-8076-66bc0dedf75e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:48.812400 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4ed28-81e6-4cc4-8076-66bc0dedf75e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:48.813769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4ed28-81e6-4cc4-8076-66bc0dedf75e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:48.823542 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 448/891] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:39:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:48.824858 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4ed28-81e6-4cc4-8076-66bc0dedf75e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:48.829819 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7ad6e-72b4-4f8f-81c2-920898b066b8 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:48.863294 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77ccc0-5684-4e1d-a8e4-3704242e66bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:48.864384 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77ccc0-5684-4e1d-a8e4-3704242e66bd None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:48.864865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77ccc0-5684-4e1d-a8e4-3704242e66bd None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:48.865340 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77ccc0-5684-4e1d-a8e4-3704242e66bd None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:48.866247 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77ccc0-5684-4e1d-a8e4-3704242e66bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:48.866794 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77ccc0-5684-4e1d-a8e4-3704242e66bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:48.868358 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77ccc0-5684-4e1d-a8e4-3704242e66bd None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:48.885314 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 444/892] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:48.886437 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77ccc0-5684-4e1d-a8e4-3704242e66bd None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:48.921837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4ed28-81e6-4cc4-8076-66bc0dedf75e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:48.954868 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d817c0-a14d-4e56-b5c1-75f012cbcd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:48.955532 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d817c0-a14d-4e56-b5c1-75f012cbcd89 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:48.955808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d817c0-a14d-4e56-b5c1-75f012cbcd89 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:48.956077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d817c0-a14d-4e56-b5c1-75f012cbcd89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:48.957106 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d817c0-a14d-4e56-b5c1-75f012cbcd89 None admin] RBAC: Adding query filter params (interface=public, service_id=90c08d04e559468ca4a576171567ead8, region_id=RegionOne) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:48.957231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d817c0-a14d-4e56-b5c1-75f012cbcd89 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:48.958532 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d817c0-a14d-4e56-b5c1-75f012cbcd89 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:48.970938 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 449/893] 10.222.0.90 () {56 vars in 1251 bytes} [Wed Nov 2 12:39:48 2022] GET /identity/v3/endpoints?service_id=90c08d04e559468ca4a576171567ead8&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:48.972243 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d817c0-a14d-4e56-b5c1-75f012cbcd89 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:48.987072 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77ccc0-5684-4e1d-a8e4-3704242e66bd None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:49.023372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40353c-1b3d-4535-9b6e-17ab9a456a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:49.024562 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40353c-1b3d-4535-9b6e-17ab9a456a17 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:49.025059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40353c-1b3d-4535-9b6e-17ab9a456a17 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:49.025517 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40353c-1b3d-4535-9b6e-17ab9a456a17 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:49.035095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40353c-1b3d-4535-9b6e-17ab9a456a17 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:49.036868 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40353c-1b3d-4535-9b6e-17ab9a456a17 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:49.051463 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-5c40353c-1b3d-4535-9b6e-17ab9a456a17 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 12:39:49.052960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 445/894] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Nov 2 12:39:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:49.060054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40353c-1b3d-4535-9b6e-17ab9a456a17 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:49.078765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d817c0-a14d-4e56-b5c1-75f012cbcd89 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:49.121925 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d7236-292c-445a-b01d-ccd5d023e840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:49.122596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d7236-292c-445a-b01d-ccd5d023e840 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:49.122873 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d7236-292c-445a-b01d-ccd5d023e840 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:49.123144 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d7236-292c-445a-b01d-ccd5d023e840 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:49.123823 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d7236-292c-445a-b01d-ccd5d023e840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:49.125695 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d7236-292c-445a-b01d-ccd5d023e840 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:49.138906 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 450/895] 10.222.0.90 () {56 vars in 1087 bytes} [Wed Nov 2 12:39:48 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:39:49.181460 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40353c-1b3d-4535-9b6e-17ab9a456a17 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:49.220553 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe2e6e-cc7b-4135-a877-4d28f6e27ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:49.221234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe2e6e-cc7b-4135-a877-4d28f6e27ad5 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:49.221507 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe2e6e-cc7b-4135-a877-4d28f6e27ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:49.221774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe2e6e-cc7b-4135-a877-4d28f6e27ad5 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:49.222611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe2e6e-cc7b-4135-a877-4d28f6e27ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:49.222918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe2e6e-cc7b-4135-a877-4d28f6e27ad5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:49.224376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe2e6e-cc7b-4135-a877-4d28f6e27ad5 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:49.244925 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 446/896] 10.222.0.90 () {56 vars in 1149 bytes} [Wed Nov 2 12:39:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:49.253390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d7236-292c-445a-b01d-ccd5d023e840 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:49.362256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d7236-292c-445a-b01d-ccd5d023e840 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:49.400149 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfc41c-0c7e-43ea-9b6e-aa353f20182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:49.401219 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfc41c-0c7e-43ea-9b6e-aa353f20182b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:49.401688 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfc41c-0c7e-43ea-9b6e-aa353f20182b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:49.402476 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfc41c-0c7e-43ea-9b6e-aa353f20182b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:49.473239 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfc41c-0c7e-43ea-9b6e-aa353f20182b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:49.474989 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfc41c-0c7e-43ea-9b6e-aa353f20182b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:49.581487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 451/897] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:49 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:39:49.587204 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe2e6e-cc7b-4135-a877-4d28f6e27ad5 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:49.685637 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe2e6e-cc7b-4135-a877-4d28f6e27ad5 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:49.719033 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247bfab-fdf5-430d-8292-e270133f856b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:49.719831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247bfab-fdf5-430d-8292-e270133f856b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:49.720133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247bfab-fdf5-430d-8292-e270133f856b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:49.720411 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247bfab-fdf5-430d-8292-e270133f856b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:49.725887 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df47974-45b7-4650-88f6-2a836d666a91 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:49.726287 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df47974-45b7-4650-88f6-2a836d666a91 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:49.726575 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df47974-45b7-4650-88f6-2a836d666a91 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:49.728637 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 452/898] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:39:49.730547 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247bfab-fdf5-430d-8292-e270133f856b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:49.732004 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247bfab-fdf5-430d-8292-e270133f856b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:49.733854 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f6e64-970f-40de-8b4f-6d793c70ad39 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:49.734141 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f6e64-970f-40de-8b4f-6d793c70ad39 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:49.734418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f6e64-970f-40de-8b4f-6d793c70ad39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:49.750828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-d247bfab-fdf5-430d-8292-e270133f856b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:49.752349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 447/899] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:49.752461 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-4c5f6e64-970f-40de-8b4f-6d793c70ad39 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:49.753718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4c5f6e64-970f-40de-8b4f-6d793c70ad39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:49.761128 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247bfab-fdf5-430d-8292-e270133f856b None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:49.828324 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 453/900] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:49.851786 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f6e64-970f-40de-8b4f-6d793c70ad39 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:49.865486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247bfab-fdf5-430d-8292-e270133f856b None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:49.911124 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bc281-a6ce-4b6f-a693-e55e4e0fb425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:49.911824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bc281-a6ce-4b6f-a693-e55e4e0fb425 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:49.912104 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bc281-a6ce-4b6f-a693-e55e4e0fb425 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:49.912496 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bc281-a6ce-4b6f-a693-e55e4e0fb425 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:49.913274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bc281-a6ce-4b6f-a693-e55e4e0fb425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:49.913581 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bc281-a6ce-4b6f-a693-e55e4e0fb425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:49.915042 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bc281-a6ce-4b6f-a693-e55e4e0fb425 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:49.926818 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 448/901] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:49.928620 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec7d4b-9deb-42ac-923d-952006840515 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:49.928744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec7d4b-9deb-42ac-923d-952006840515 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:49.928944 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec7d4b-9deb-42ac-923d-952006840515 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:49.930939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 449/902] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:49.932298 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec7d4b-9deb-42ac-923d-952006840515 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:49.951801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f6e64-970f-40de-8b4f-6d793c70ad39 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:49.990269 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62ae87-8cd9-42f3-8d04-3d19870eff2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:49.990942 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62ae87-8cd9-42f3-8d04-3d19870eff2c None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:49.991219 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62ae87-8cd9-42f3-8d04-3d19870eff2c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:49.991482 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62ae87-8cd9-42f3-8d04-3d19870eff2c None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:49.992231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62ae87-8cd9-42f3-8d04-3d19870eff2c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:49.993593 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62ae87-8cd9-42f3-8d04-3d19870eff2c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:50.009061 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 454/903] 10.222.0.90 () {60 vars in 1141 bytes} [Wed Nov 2 12:39:49 2022] POST /identity/v3/services => generated 241 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:39:50.010696 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dacd5e-b6d4-4cce-b8a3-e523d09fbeb5 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:50.011029 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dacd5e-b6d4-4cce-b8a3-e523d09fbeb5 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:50.011308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dacd5e-b6d4-4cce-b8a3-e523d09fbeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:50.032681 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-09dacd5e-b6d4-4cce-b8a3-e523d09fbeb5 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:50.033943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-09dacd5e-b6d4-4cce-b8a3-e523d09fbeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:50.050163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec7d4b-9deb-42ac-923d-952006840515 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:50.087988 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b960-70a4-4842-91c6-2dc74ab2a0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:50.089282 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b960-70a4-4842-91c6-2dc74ab2a0c4 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:50.089809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b960-70a4-4842-91c6-2dc74ab2a0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:50.090301 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b960-70a4-4842-91c6-2dc74ab2a0c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:50.100563 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17b960-70a4-4842-91c6-2dc74ab2a0c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:50.102958 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17b960-70a4-4842-91c6-2dc74ab2a0c4 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:50.112283 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 455/904] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:50.119701 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-0b17b960-70a4-4842-91c6-2dc74ab2a0c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:50.124297 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 450/905] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:50.127326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dacd5e-b6d4-4cce-b8a3-e523d09fbeb5 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:50.140552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b960-70a4-4842-91c6-2dc74ab2a0c4 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:50.245378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dacd5e-b6d4-4cce-b8a3-e523d09fbeb5 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:50.269605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b960-70a4-4842-91c6-2dc74ab2a0c4 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:50.287056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b71e6c-bc57-4448-9cfc-85703b295b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:50.288103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b71e6c-bc57-4448-9cfc-85703b295b0a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:50.288546 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b71e6c-bc57-4448-9cfc-85703b295b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:50.288962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b71e6c-bc57-4448-9cfc-85703b295b0a None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:50.289913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b71e6c-bc57-4448-9cfc-85703b295b0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:50.290373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b71e6c-bc57-4448-9cfc-85703b295b0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:50.292010 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b71e6c-bc57-4448-9cfc-85703b295b0a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:50.310352 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 456/906] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:50.310529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b0189-dcb0-4385-9da2-d5ae32df2681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:50.310529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b0189-dcb0-4385-9da2-d5ae32df2681 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:50.310529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b0189-dcb0-4385-9da2-d5ae32df2681 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:50.310529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b0189-dcb0-4385-9da2-d5ae32df2681 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:50.311742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b71e6c-bc57-4448-9cfc-85703b295b0a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:50.312684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b0189-dcb0-4385-9da2-d5ae32df2681 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:50.314089 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b0189-dcb0-4385-9da2-d5ae32df2681 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:50.326933 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-196b0189-dcb0-4385-9da2-d5ae32df2681 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 12:39:50.328563 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 451/907] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Nov 2 12:39:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:50.334238 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b0189-dcb0-4385-9da2-d5ae32df2681 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:50.416089 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b71e6c-bc57-4448-9cfc-85703b295b0a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:50.439191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b0189-dcb0-4385-9da2-d5ae32df2681 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:50.452635 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b31d99-0217-4a57-96d6-4622a7b48bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:50.453554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b31d99-0217-4a57-96d6-4622a7b48bd0 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:50.453971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b31d99-0217-4a57-96d6-4622a7b48bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:50.454388 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b31d99-0217-4a57-96d6-4622a7b48bd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:50.455409 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b31d99-0217-4a57-96d6-4622a7b48bd0 None admin] RBAC: Adding query filter params (role.id=32037682fb594c0a9fe6a908cde45c99, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=fef95ce95d4447a58063233a549adfe5) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:50.455906 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b31d99-0217-4a57-96d6-4622a7b48bd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:50.457499 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b31d99-0217-4a57-96d6-4622a7b48bd0 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:50.472545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 457/908] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:50 2022] GET /identity/v3/role_assignments?user.id=fef95ce95d4447a58063233a549adfe5&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=32037682fb594c0a9fe6a908cde45c99 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:50.477642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4811db-8366-4ac7-8fdc-7e572cfb702f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:50.478600 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4811db-8366-4ac7-8fdc-7e572cfb702f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:50.479059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4811db-8366-4ac7-8fdc-7e572cfb702f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:50.479468 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4811db-8366-4ac7-8fdc-7e572cfb702f None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:50.480444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4811db-8366-4ac7-8fdc-7e572cfb702f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:50.480895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4811db-8366-4ac7-8fdc-7e572cfb702f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:50.482574 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4811db-8366-4ac7-8fdc-7e572cfb702f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:50.488959 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 452/909] 10.222.0.90 () {56 vars in 1126 bytes} [Wed Nov 2 12:39:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:50.495102 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b31d99-0217-4a57-96d6-4622a7b48bd0 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:50.605046 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b31d99-0217-4a57-96d6-4622a7b48bd0 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:50.645794 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e8f63-bf8a-4095-a232-e2efa9a99888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:50.646507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e8f63-bf8a-4095-a232-e2efa9a99888 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:50.646785 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e8f63-bf8a-4095-a232-e2efa9a99888 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:50.647055 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e8f63-bf8a-4095-a232-e2efa9a99888 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:50.647792 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e8f63-bf8a-4095-a232-e2efa9a99888 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:50.648099 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e8f63-bf8a-4095-a232-e2efa9a99888 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:50.649683 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e8f63-bf8a-4095-a232-e2efa9a99888 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:50.655876 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 458/910] 10.222.0.90 () {56 vars in 1126 bytes} [Wed Nov 2 12:39:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:50.661851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4811db-8366-4ac7-8fdc-7e572cfb702f None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:50.783866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4811db-8366-4ac7-8fdc-7e572cfb702f None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:50.817081 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af91d-607e-453d-9c59-48551069302f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:50.817743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af91d-607e-453d-9c59-48551069302f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:50.818016 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af91d-607e-453d-9c59-48551069302f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:50.818285 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af91d-607e-453d-9c59-48551069302f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:50.819173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9af91d-607e-453d-9c59-48551069302f None admin] RBAC: Adding query filter params (interface=public, service_id=aad9cb823e9e47cbb2123a26e3265e04, region_id=RegionOne) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:50.819482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9af91d-607e-453d-9c59-48551069302f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:50.820913 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9af91d-607e-453d-9c59-48551069302f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:50.826594 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 453/911] 10.222.0.90 () {56 vars in 1251 bytes} [Wed Nov 2 12:39:50 2022] GET /identity/v3/endpoints?service_id=aad9cb823e9e47cbb2123a26e3265e04&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:50.833745 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e8f63-bf8a-4095-a232-e2efa9a99888 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:50.952331 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e8f63-bf8a-4095-a232-e2efa9a99888 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:50.986674 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae00bf3-9e67-4a62-bc84-278d5074e828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:50.987356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae00bf3-9e67-4a62-bc84-278d5074e828 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:50.987638 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae00bf3-9e67-4a62-bc84-278d5074e828 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:50.987912 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae00bf3-9e67-4a62-bc84-278d5074e828 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:50.988633 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae00bf3-9e67-4a62-bc84-278d5074e828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:50.990020 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae00bf3-9e67-4a62-bc84-278d5074e828 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:50.996414 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 459/912] 10.222.0.90 () {56 vars in 1087 bytes} [Wed Nov 2 12:39:50 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:39:51.598614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863729ee-fe56-453c-9437-89fca3f816a0 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:51.599376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863729ee-fe56-453c-9437-89fca3f816a0 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:51.599376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863729ee-fe56-453c-9437-89fca3f816a0 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:51.601228 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 454/913] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:51.606843 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695aa2d1-cc3e-45a1-ac0c-c73c36e7a8ba None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:51.607354 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695aa2d1-cc3e-45a1-ac0c-c73c36e7a8ba None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:51.607523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695aa2d1-cc3e-45a1-ac0c-c73c36e7a8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:51.625063 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-695aa2d1-cc3e-45a1-ac0c-c73c36e7a8ba None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:51.626248 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-695aa2d1-cc3e-45a1-ac0c-c73c36e7a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:51.700314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 460/914] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:39:51.716566 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863729ee-fe56-453c-9437-89fca3f816a0 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:51.823330 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863729ee-fe56-453c-9437-89fca3f816a0 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:51.857515 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906c2f6-b4f8-4ee4-8061-5956eca9494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:51.858329 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906c2f6-b4f8-4ee4-8061-5956eca9494a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:51.858609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906c2f6-b4f8-4ee4-8061-5956eca9494a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:51.858881 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906c2f6-b4f8-4ee4-8061-5956eca9494a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:51.859529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906c2f6-b4f8-4ee4-8061-5956eca9494a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:51.860934 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906c2f6-b4f8-4ee4-8061-5956eca9494a None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:51.872431 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-e906c2f6-b4f8-4ee4-8061-5956eca9494a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 12:39:51.873935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 455/915] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:39:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:51.879630 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695aa2d1-cc3e-45a1-ac0c-c73c36e7a8ba None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:51.980968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695aa2d1-cc3e-45a1-ac0c-c73c36e7a8ba None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:52.014771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c8443-326c-4225-b5e7-e709e0f0b404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:52.015467 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c8443-326c-4225-b5e7-e709e0f0b404 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:52.015750 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c8443-326c-4225-b5e7-e709e0f0b404 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:52.016022 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c8443-326c-4225-b5e7-e709e0f0b404 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:52.016765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c8443-326c-4225-b5e7-e709e0f0b404 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:52.017070 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c8443-326c-4225-b5e7-e709e0f0b404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:52.018508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c8443-326c-4225-b5e7-e709e0f0b404 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:52.023753 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 461/916] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:39:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:52.029872 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906c2f6-b4f8-4ee4-8061-5956eca9494a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:52.132375 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906c2f6-b4f8-4ee4-8061-5956eca9494a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:52.166841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bded0a3-12ff-41bf-9bb9-3056688f9c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:52.167523 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bded0a3-12ff-41bf-9bb9-3056688f9c99 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:52.167805 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bded0a3-12ff-41bf-9bb9-3056688f9c99 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:52.168082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bded0a3-12ff-41bf-9bb9-3056688f9c99 None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:52.168834 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bded0a3-12ff-41bf-9bb9-3056688f9c99 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:52.169143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bded0a3-12ff-41bf-9bb9-3056688f9c99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:52.170633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bded0a3-12ff-41bf-9bb9-3056688f9c99 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:52.176927 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 456/917] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Nov 2 12:39:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:52.182711 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c8443-326c-4225-b5e7-e709e0f0b404 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:52.288798 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c8443-326c-4225-b5e7-e709e0f0b404 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:52.323281 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4fd81-9d87-41df-9535-b2bd28eb1297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:52.323971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4fd81-9d87-41df-9535-b2bd28eb1297 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:52.324275 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4fd81-9d87-41df-9535-b2bd28eb1297 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:52.324557 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4fd81-9d87-41df-9535-b2bd28eb1297 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:52.325316 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4fd81-9d87-41df-9535-b2bd28eb1297 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:52.326697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4fd81-9d87-41df-9535-b2bd28eb1297 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:52.346352 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 462/918] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:39:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:52.563153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10d866-f144-4d4d-9be2-4f055d634860 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:52.563458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10d866-f144-4d4d-9be2-4f055d634860 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:52.563817 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10d866-f144-4d4d-9be2-4f055d634860 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:52.566348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 457/919] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:52.572244 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cf700-7acf-4dc0-b843-38d2ad3d7a1b None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:52.572533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cf700-7acf-4dc0-b843-38d2ad3d7a1b None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:52.572828 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cf700-7acf-4dc0-b843-38d2ad3d7a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:52.592494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-900cf700-7acf-4dc0-b843-38d2ad3d7a1b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:52.593696 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-900cf700-7acf-4dc0-b843-38d2ad3d7a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:52.673240 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 463/920] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:52.695579 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10d866-f144-4d4d-9be2-4f055d634860 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:52.799391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10d866-f144-4d4d-9be2-4f055d634860 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:52.834610 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be9baa-0269-43ff-a300-845c0353733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:52.835350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be9baa-0269-43ff-a300-845c0353733b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:52.835627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be9baa-0269-43ff-a300-845c0353733b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:52.835901 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be9baa-0269-43ff-a300-845c0353733b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:52.836579 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be9baa-0269-43ff-a300-845c0353733b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:52.837957 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be9baa-0269-43ff-a300-845c0353733b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:52.849605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-d4be9baa-0269-43ff-a300-845c0353733b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:39:52.851153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 458/921] 10.222.0.90 () {56 vars in 1126 bytes} [Wed Nov 2 12:39:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:52.857240 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cf700-7acf-4dc0-b843-38d2ad3d7a1b None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:52.948050 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595b979-e727-45f3-a3b9-e91908345978 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:52.948423 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595b979-e727-45f3-a3b9-e91908345978 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:52.948652 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595b979-e727-45f3-a3b9-e91908345978 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:52.950788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 459/922] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:39:52.959094 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131bca9-cea6-4017-a61e-242a4edf2083 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:52.959094 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131bca9-cea6-4017-a61e-242a4edf2083 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:52.959094 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131bca9-cea6-4017-a61e-242a4edf2083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:52.960421 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cf700-7acf-4dc0-b843-38d2ad3d7a1b None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:52.979409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-d131bca9-cea6-4017-a61e-242a4edf2083 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:52.981084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-d131bca9-cea6-4017-a61e-242a4edf2083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:52.992138 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff079b98-843b-4f37-a0da-7524c9b7b777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:52.993073 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff079b98-843b-4f37-a0da-7524c9b7b777 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:52.993539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff079b98-843b-4f37-a0da-7524c9b7b777 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:52.993992 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff079b98-843b-4f37-a0da-7524c9b7b777 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:52.994896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff079b98-843b-4f37-a0da-7524c9b7b777 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:52.995371 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff079b98-843b-4f37-a0da-7524c9b7b777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:52.996969 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff079b98-843b-4f37-a0da-7524c9b7b777 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:53.002273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 464/923] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Nov 2 12:39:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:53.008102 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff079b98-843b-4f37-a0da-7524c9b7b777 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:53.060398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 460/924] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:39:53.078914 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131bca9-cea6-4017-a61e-242a4edf2083 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:53.129413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff079b98-843b-4f37-a0da-7524c9b7b777 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:53.175932 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84e80e-71cf-4ecf-84a0-9423a30af7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:53.177053 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84e80e-71cf-4ecf-84a0-9423a30af7c1 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.177539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84e80e-71cf-4ecf-84a0-9423a30af7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.178025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84e80e-71cf-4ecf-84a0-9423a30af7c1 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.179003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84e80e-71cf-4ecf-84a0-9423a30af7c1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:53.179532 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84e80e-71cf-4ecf-84a0-9423a30af7c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:53.181244 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84e80e-71cf-4ecf-84a0-9423a30af7c1 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:53.182146 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131bca9-cea6-4017-a61e-242a4edf2083 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:53.191892 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 465/925] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Nov 2 12:39:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:53.193513 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84e80e-71cf-4ecf-84a0-9423a30af7c1 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:53.218257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85787f6a-497e-4a06-8b21-e5a0b7b5e6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:53.219143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85787f6a-497e-4a06-8b21-e5a0b7b5e6af None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.219416 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85787f6a-497e-4a06-8b21-e5a0b7b5e6af None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.219683 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85787f6a-497e-4a06-8b21-e5a0b7b5e6af None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.230142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85787f6a-497e-4a06-8b21-e5a0b7b5e6af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:53.237770 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-85787f6a-497e-4a06-8b21-e5a0b7b5e6af None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 12:39:53.244620 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 461/926] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Nov 2 12:39:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:53.245540 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85787f6a-497e-4a06-8b21-e5a0b7b5e6af None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:53.308420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84e80e-71cf-4ecf-84a0-9423a30af7c1 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:53.343584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85787f6a-497e-4a06-8b21-e5a0b7b5e6af None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:53.349457 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0d440-6c50-4dcf-97f9-6694b54f503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:53.350123 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0d440-6c50-4dcf-97f9-6694b54f503a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.350397 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0d440-6c50-4dcf-97f9-6694b54f503a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.350666 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0d440-6c50-4dcf-97f9-6694b54f503a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.351870 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0d440-6c50-4dcf-97f9-6694b54f503a None admin] RBAC: Adding query filter params (interface=public, service_id=ff18c4aefcbd41b797662f27a082791c, region_id=RegionOne) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:53.352180 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0d440-6c50-4dcf-97f9-6694b54f503a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:53.354346 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0d440-6c50-4dcf-97f9-6694b54f503a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:53.361443 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 466/927] 10.222.0.90 () {56 vars in 1251 bytes} [Wed Nov 2 12:39:53 2022] GET /identity/v3/endpoints?service_id=ff18c4aefcbd41b797662f27a082791c&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:53.366790 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0d440-6c50-4dcf-97f9-6694b54f503a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:53.382242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adda9e-af8d-48b1-857d-535496c33b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:53.383288 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adda9e-af8d-48b1-857d-535496c33b8b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.383732 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adda9e-af8d-48b1-857d-535496c33b8b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.384177 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adda9e-af8d-48b1-857d-535496c33b8b None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.385171 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adda9e-af8d-48b1-857d-535496c33b8b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:53.385658 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adda9e-af8d-48b1-857d-535496c33b8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:53.387250 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adda9e-af8d-48b1-857d-535496c33b8b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:53.400591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 462/928] 10.222.0.90 () {56 vars in 1115 bytes} [Wed Nov 2 12:39:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:53.401784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adda9e-af8d-48b1-857d-535496c33b8b None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:53.497270 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0d440-6c50-4dcf-97f9-6694b54f503a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:53.514003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adda9e-af8d-48b1-857d-535496c33b8b None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:53.532896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502abb1b-9eee-44ae-9fcb-000148481257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:53.533637 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502abb1b-9eee-44ae-9fcb-000148481257 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.533917 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502abb1b-9eee-44ae-9fcb-000148481257 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.534212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502abb1b-9eee-44ae-9fcb-000148481257 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.534960 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502abb1b-9eee-44ae-9fcb-000148481257 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:53.536384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502abb1b-9eee-44ae-9fcb-000148481257 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:53.552235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 467/929] 10.222.0.90 () {56 vars in 1087 bytes} [Wed Nov 2 12:39:53 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:39:53.552235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231c224-9acf-4797-9ea3-a43abd15107b None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.552235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231c224-9acf-4797-9ea3-a43abd15107b None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.552235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231c224-9acf-4797-9ea3-a43abd15107b None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.552235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 468/930] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:53.552778 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82e2a6-45fb-4612-8b40-38f4eaa90259 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.552874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82e2a6-45fb-4612-8b40-38f4eaa90259 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.553118 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82e2a6-45fb-4612-8b40-38f4eaa90259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.557871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fc551-65a8-4738-9571-2cbd4aee4cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:53.560409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fc551-65a8-4738-9571-2cbd4aee4cf0 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.561012 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fc551-65a8-4738-9571-2cbd4aee4cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.561480 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fc551-65a8-4738-9571-2cbd4aee4cf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.571520 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-ac82e2a6-45fb-4612-8b40-38f4eaa90259 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:53.572870 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ac82e2a6-45fb-4612-8b40-38f4eaa90259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:53.577168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fc551-65a8-4738-9571-2cbd4aee4cf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:53.579097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fc551-65a8-4738-9571-2cbd4aee4cf0 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:53.602799 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-4e1fc551-65a8-4738-9571-2cbd4aee4cf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:53.610144 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 463/931] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:53.611926 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fc551-65a8-4738-9571-2cbd4aee4cf0 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:53.650719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 469/932] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:39:53.674848 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82e2a6-45fb-4612-8b40-38f4eaa90259 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:53.727751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fc551-65a8-4738-9571-2cbd4aee4cf0 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:53.766695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c754327-77f8-4b17-83dd-73f09d519eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:53.767433 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c754327-77f8-4b17-83dd-73f09d519eff None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.767737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c754327-77f8-4b17-83dd-73f09d519eff None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.768021 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c754327-77f8-4b17-83dd-73f09d519eff None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.768865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c754327-77f8-4b17-83dd-73f09d519eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:53.769188 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c754327-77f8-4b17-83dd-73f09d519eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:53.770695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c754327-77f8-4b17-83dd-73f09d519eff None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:53.787696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 464/933] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:53.791202 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c754327-77f8-4b17-83dd-73f09d519eff None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:53.794797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82e2a6-45fb-4612-8b40-38f4eaa90259 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:53.835652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cf7f3-309e-48d4-81a5-809d7bbfbcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:53.836770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cf7f3-309e-48d4-81a5-809d7bbfbcb1 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.837218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cf7f3-309e-48d4-81a5-809d7bbfbcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.837675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cf7f3-309e-48d4-81a5-809d7bbfbcb1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.838499 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8cf7f3-309e-48d4-81a5-809d7bbfbcb1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:53.840498 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8cf7f3-309e-48d4-81a5-809d7bbfbcb1 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:53.854934 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-6c8cf7f3-309e-48d4-81a5-809d7bbfbcb1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 12:39:53.857327 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 470/934] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Nov 2 12:39:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:53.863132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cf7f3-309e-48d4-81a5-809d7bbfbcb1 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:53.903389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c754327-77f8-4b17-83dd-73f09d519eff None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:53.938668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bb71e-9c7c-4288-887b-cd53861b6f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:53.939808 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bb71e-9c7c-4288-887b-cd53861b6f9d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.940291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bb71e-9c7c-4288-887b-cd53861b6f9d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.940705 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bb71e-9c7c-4288-887b-cd53861b6f9d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.948621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bb71e-9c7c-4288-887b-cd53861b6f9d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:53.950273 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bb71e-9c7c-4288-887b-cd53861b6f9d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:53.964813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-df8bb71e-9c7c-4288-887b-cd53861b6f9d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 12:39:53.970940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cf7f3-309e-48d4-81a5-809d7bbfbcb1 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:53.971322 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 465/935] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Nov 2 12:39:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:53.972402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bb71e-9c7c-4288-887b-cd53861b6f9d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:54.004853 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc576ad2-786d-4d68-a96a-01cd99df3015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:54.005738 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc576ad2-786d-4d68-a96a-01cd99df3015 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:54.006128 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc576ad2-786d-4d68-a96a-01cd99df3015 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:54.006401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc576ad2-786d-4d68-a96a-01cd99df3015 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:54.007122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc576ad2-786d-4d68-a96a-01cd99df3015 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:54.007431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc576ad2-786d-4d68-a96a-01cd99df3015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:54.009097 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc576ad2-786d-4d68-a96a-01cd99df3015 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:54.015396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 471/936] 10.222.0.90 () {56 vars in 1126 bytes} [Wed Nov 2 12:39:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:54.022827 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc576ad2-786d-4d68-a96a-01cd99df3015 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:54.082194 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bb71e-9c7c-4288-887b-cd53861b6f9d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:54.116158 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5d233-36bf-4d51-8298-3c087b9104d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:54.116907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5d233-36bf-4d51-8298-3c087b9104d1 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:54.117126 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5d233-36bf-4d51-8298-3c087b9104d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:54.117398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5d233-36bf-4d51-8298-3c087b9104d1 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:54.119034 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5d233-36bf-4d51-8298-3c087b9104d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:54.119034 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5d233-36bf-4d51-8298-3c087b9104d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:54.120069 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5d233-36bf-4d51-8298-3c087b9104d1 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:54.146068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 466/937] 10.222.0.90 () {56 vars in 1149 bytes} [Wed Nov 2 12:39:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:54.157222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5d233-36bf-4d51-8298-3c087b9104d1 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:54.167053 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc576ad2-786d-4d68-a96a-01cd99df3015 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:54.206407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7591c-c6e5-4937-b021-093ba4e95f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:54.207093 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7591c-c6e5-4937-b021-093ba4e95f5a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:54.207427 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7591c-c6e5-4937-b021-093ba4e95f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:54.207748 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7591c-c6e5-4937-b021-093ba4e95f5a None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:54.208505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7591c-c6e5-4937-b021-093ba4e95f5a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:54.208811 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7591c-c6e5-4937-b021-093ba4e95f5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:54.210273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7591c-c6e5-4937-b021-093ba4e95f5a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:54.215868 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 472/938] 10.222.0.90 () {56 vars in 1126 bytes} [Wed Nov 2 12:39:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:54.221714 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7591c-c6e5-4937-b021-093ba4e95f5a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:54.289011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5d233-36bf-4d51-8298-3c087b9104d1 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:54.324345 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f13d7-7522-4a61-8ae3-4734b5797ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:54.325100 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f13d7-7522-4a61-8ae3-4734b5797ff3 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:54.325383 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f13d7-7522-4a61-8ae3-4734b5797ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:54.325656 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f13d7-7522-4a61-8ae3-4734b5797ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:54.336822 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f13d7-7522-4a61-8ae3-4734b5797ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:54.338408 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f13d7-7522-4a61-8ae3-4734b5797ff3 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:54.356007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-757f13d7-7522-4a61-8ae3-4734b5797ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:54.356832 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7591c-c6e5-4937-b021-093ba4e95f5a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:54.357594 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 467/939] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:54.368228 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f13d7-7522-4a61-8ae3-4734b5797ff3 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:54.394204 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288c5b0-bd34-4e88-a765-0aaedab985e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:54.394934 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288c5b0-bd34-4e88-a765-0aaedab985e9 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:54.395213 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288c5b0-bd34-4e88-a765-0aaedab985e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:54.395491 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288c5b0-bd34-4e88-a765-0aaedab985e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:54.396301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288c5b0-bd34-4e88-a765-0aaedab985e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:54.397727 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288c5b0-bd34-4e88-a765-0aaedab985e9 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:54.431508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 473/940] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:39:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:54.492826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f13d7-7522-4a61-8ae3-4734b5797ff3 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:54.539477 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa17bb-086b-4dc8-b897-d7ce78fbed99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:54.540321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa17bb-086b-4dc8-b897-d7ce78fbed99 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:54.540604 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa17bb-086b-4dc8-b897-d7ce78fbed99 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:54.540939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa17bb-086b-4dc8-b897-d7ce78fbed99 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:54.541800 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa17bb-086b-4dc8-b897-d7ce78fbed99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:54.542174 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa17bb-086b-4dc8-b897-d7ce78fbed99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:54.543776 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa17bb-086b-4dc8-b897-d7ce78fbed99 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:54.557299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 468/941] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:54.563068 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288c5b0-bd34-4e88-a765-0aaedab985e9 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:54.673243 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288c5b0-bd34-4e88-a765-0aaedab985e9 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:54.707489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03837a-cf78-410f-b5aa-8b922f13c92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:54.709096 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03837a-cf78-410f-b5aa-8b922f13c92e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:54.709595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03837a-cf78-410f-b5aa-8b922f13c92e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:54.710066 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03837a-cf78-410f-b5aa-8b922f13c92e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:54.717656 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03837a-cf78-410f-b5aa-8b922f13c92e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:54.719393 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03837a-cf78-410f-b5aa-8b922f13c92e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:54.733724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-ea03837a-cf78-410f-b5aa-8b922f13c92e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:54.735499 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 474/942] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:54.741469 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa17bb-086b-4dc8-b897-d7ce78fbed99 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:54.800318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92afcd-1052-4f5e-b71c-947ef33d721d None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:54.800627 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92afcd-1052-4f5e-b71c-947ef33d721d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:54.800874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92afcd-1052-4f5e-b71c-947ef33d721d None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:54.804290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 475/943] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:39:54.807996 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c1067-52a1-4134-ae2a-fef495c18fa4 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:54.808327 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c1067-52a1-4134-ae2a-fef495c18fa4 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:54.808609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c1067-52a1-4134-ae2a-fef495c18fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:54.825377 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-d98c1067-52a1-4134-ae2a-fef495c18fa4 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:54.826620 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-d98c1067-52a1-4134-ae2a-fef495c18fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:54.853481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa17bb-086b-4dc8-b897-d7ce78fbed99 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:54.894587 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 476/944] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:39:54.896652 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed720164-fa4f-4d6d-bb3e-140c4e94a1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:54.897378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed720164-fa4f-4d6d-bb3e-140c4e94a1d1 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:54.897665 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed720164-fa4f-4d6d-bb3e-140c4e94a1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:54.897935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed720164-fa4f-4d6d-bb3e-140c4e94a1d1 None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:54.898727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed720164-fa4f-4d6d-bb3e-140c4e94a1d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:54.899036 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed720164-fa4f-4d6d-bb3e-140c4e94a1d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:54.900511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed720164-fa4f-4d6d-bb3e-140c4e94a1d1 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:54.913576 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 469/945] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:54.921204 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed720164-fa4f-4d6d-bb3e-140c4e94a1d1 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:54.921515 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c1067-52a1-4134-ae2a-fef495c18fa4 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:55.017232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed720164-fa4f-4d6d-bb3e-140c4e94a1d1 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:55.021991 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c1067-52a1-4134-ae2a-fef495c18fa4 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:55.050426 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8712323-9916-4e9a-8e73-f5003a0e1953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:55.051513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8712323-9916-4e9a-8e73-f5003a0e1953 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:55.051901 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8712323-9916-4e9a-8e73-f5003a0e1953 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:55.052309 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8712323-9916-4e9a-8e73-f5003a0e1953 None admin] PATH_INFO: `/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/fef95ce95d4447a58063233a549adfe5/roles/32037682fb594c0a9fe6a908cde45c99` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:55.054642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8712323-9916-4e9a-8e73-f5003a0e1953 None admin] RBAC: Authorizing `identity:create_grant(project_id=a08ee6d287714297a10248ad8e4522bc, user_id=fef95ce95d4447a58063233a549adfe5, role_id=32037682fb594c0a9fe6a908cde45c99)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:55.056175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8712323-9916-4e9a-8e73-f5003a0e1953 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:55.058856 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58129c-7a2c-4433-b23d-091ba19dae54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:55.059679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58129c-7a2c-4433-b23d-091ba19dae54 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:55.060100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58129c-7a2c-4433-b23d-091ba19dae54 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:55.060672 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58129c-7a2c-4433-b23d-091ba19dae54 None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:55.061811 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58129c-7a2c-4433-b23d-091ba19dae54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:55.063424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58129c-7a2c-4433-b23d-091ba19dae54 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:55.064893 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.common [None req-9f58129c-7a2c-4433-b23d-091ba19dae54 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 02 12:39:55.072319 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 470/946] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:39:54 2022] PUT /identity/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/fef95ce95d4447a58063233a549adfe5/roles/32037682fb594c0a9fe6a908cde45c99 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:55.090990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.sql.core [None req-9f58129c-7a2c-4433-b23d-091ba19dae54 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 12:39:55.090990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 12:39:55.090990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [parameters: {'id': '4f390c989ee1475087d403cc88b40cf5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 12:39:55.090990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86736) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 12:39:55.098692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-9f58129c-7a2c-4433-b23d-091ba19dae54 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4f390c989ee1475087d403cc88b40cf5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4f390c989ee1475087d403cc88b40cf5. Nov 02 12:39:55.105781 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 477/947] 10.222.0.90 () {60 vars in 1140 bytes} [Wed Nov 2 12:39:54 2022] POST /identity/v3/projects => generated 262 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:55.107656 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8712323-9916-4e9a-8e73-f5003a0e1953 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:55.216786 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8712323-9916-4e9a-8e73-f5003a0e1953 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:55.254840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9a05d-ba1e-4fca-af3e-71cfbbb6e12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:55.256015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9a05d-ba1e-4fca-af3e-71cfbbb6e12c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:55.256532 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9a05d-ba1e-4fca-af3e-71cfbbb6e12c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:55.257052 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9a05d-ba1e-4fca-af3e-71cfbbb6e12c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:55.265149 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9a05d-ba1e-4fca-af3e-71cfbbb6e12c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:55.266906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9a05d-ba1e-4fca-af3e-71cfbbb6e12c None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:55.281131 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-61f9a05d-ba1e-4fca-af3e-71cfbbb6e12c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:55.283624 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 471/948] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:55.288780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58129c-7a2c-4433-b23d-091ba19dae54 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:55.389314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58129c-7a2c-4433-b23d-091ba19dae54 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:55.422236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042362f0-90b0-41a9-84db-2a7c8f48f1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:55.422905 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042362f0-90b0-41a9-84db-2a7c8f48f1f2 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:55.423186 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042362f0-90b0-41a9-84db-2a7c8f48f1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:55.423458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042362f0-90b0-41a9-84db-2a7c8f48f1f2 None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:55.424231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042362f0-90b0-41a9-84db-2a7c8f48f1f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:55.424545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042362f0-90b0-41a9-84db-2a7c8f48f1f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:55.426196 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042362f0-90b0-41a9-84db-2a7c8f48f1f2 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:55.447820 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 478/949] 10.222.0.90 () {56 vars in 1112 bytes} [Wed Nov 2 12:39:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:55.972710 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c03df4-582f-4be8-8948-300ca601a0a8 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:55.973222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c03df4-582f-4be8-8948-300ca601a0a8 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:55.973222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c03df4-582f-4be8-8948-300ca601a0a8 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:55.975229 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 472/950] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:55.980853 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79ade6-0a11-42cb-ae81-6d3e8a2d16b5 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:55.981259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79ade6-0a11-42cb-ae81-6d3e8a2d16b5 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:55.981425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79ade6-0a11-42cb-ae81-6d3e8a2d16b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:55.998980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-1a79ade6-0a11-42cb-ae81-6d3e8a2d16b5 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:56.000826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1a79ade6-0a11-42cb-ae81-6d3e8a2d16b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:56.066803 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 479/951] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:56.089388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c03df4-582f-4be8-8948-300ca601a0a8 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:56.191821 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c03df4-582f-4be8-8948-300ca601a0a8 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:56.226182 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b314f-e699-4dd8-a98f-9eb7f20e9698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:56.226960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b314f-e699-4dd8-a98f-9eb7f20e9698 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:56.227241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b314f-e699-4dd8-a98f-9eb7f20e9698 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:56.227508 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b314f-e699-4dd8-a98f-9eb7f20e9698 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:56.228153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b314f-e699-4dd8-a98f-9eb7f20e9698 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:56.229650 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b314f-e699-4dd8-a98f-9eb7f20e9698 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:56.241201 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-7a4b314f-e699-4dd8-a98f-9eb7f20e9698 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:39:56.242725 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 473/952] 10.222.0.90 () {56 vars in 1126 bytes} [Wed Nov 2 12:39:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:56.248860 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79ade6-0a11-42cb-ae81-6d3e8a2d16b5 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:56.351654 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79ade6-0a11-42cb-ae81-6d3e8a2d16b5 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:56.385357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fb767-a299-4f7e-80b4-ee607883681c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:56.386323 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fb767-a299-4f7e-80b4-ee607883681c None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:56.386768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fb767-a299-4f7e-80b4-ee607883681c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:56.387227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fb767-a299-4f7e-80b4-ee607883681c None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:56.388191 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fb767-a299-4f7e-80b4-ee607883681c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:56.388852 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fb767-a299-4f7e-80b4-ee607883681c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:56.390379 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fb767-a299-4f7e-80b4-ee607883681c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:56.397544 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 480/953] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Nov 2 12:39:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:56.403921 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b314f-e699-4dd8-a98f-9eb7f20e9698 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:56.512310 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b314f-e699-4dd8-a98f-9eb7f20e9698 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:56.541613 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090df813-e28d-4747-8389-e74211f894f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:56.542275 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090df813-e28d-4747-8389-e74211f894f7 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:56.542550 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090df813-e28d-4747-8389-e74211f894f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:56.542813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090df813-e28d-4747-8389-e74211f894f7 None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:56.543510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090df813-e28d-4747-8389-e74211f894f7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:56.543920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090df813-e28d-4747-8389-e74211f894f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:56.545478 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090df813-e28d-4747-8389-e74211f894f7 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:56.551156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 474/954] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Nov 2 12:39:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:56.557100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fb767-a299-4f7e-80b4-ee607883681c None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:56.664446 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fb767-a299-4f7e-80b4-ee607883681c None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:56.698486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426aff8-243a-4fb3-9ffb-a0eb9f30ca5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:56.699246 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426aff8-243a-4fb3-9ffb-a0eb9f30ca5c None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:56.699528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426aff8-243a-4fb3-9ffb-a0eb9f30ca5c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:56.699797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426aff8-243a-4fb3-9ffb-a0eb9f30ca5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:56.700572 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426aff8-243a-4fb3-9ffb-a0eb9f30ca5c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:56.702016 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426aff8-243a-4fb3-9ffb-a0eb9f30ca5c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:56.722676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 481/955] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:39:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:56.942325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99440c2-7c24-4730-a6b8-5e5a0013e304 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:56.942668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99440c2-7c24-4730-a6b8-5e5a0013e304 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:56.942877 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99440c2-7c24-4730-a6b8-5e5a0013e304 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:56.944714 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 475/956] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:56.951158 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781804-e002-44f9-a81f-10e60481433f None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:56.951441 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781804-e002-44f9-a81f-10e60481433f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:56.951741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781804-e002-44f9-a81f-10e60481433f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:56.969290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-b2781804-e002-44f9-a81f-10e60481433f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:56.970503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-b2781804-e002-44f9-a81f-10e60481433f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:57.044607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 482/957] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:39:57.067885 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99440c2-7c24-4730-a6b8-5e5a0013e304 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:57.178551 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99440c2-7c24-4730-a6b8-5e5a0013e304 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:57.213878 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63540295-d356-4974-b539-4efc6bd8876b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:57.214931 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63540295-d356-4974-b539-4efc6bd8876b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:57.215362 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63540295-d356-4974-b539-4efc6bd8876b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:57.215813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63540295-d356-4974-b539-4efc6bd8876b None admin] PATH_INFO: `/v3/services/compute` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:57.216728 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63540295-d356-4974-b539-4efc6bd8876b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:57.218877 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63540295-d356-4974-b539-4efc6bd8876b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:57.234552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-63540295-d356-4974-b539-4efc6bd8876b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 12:39:57.236466 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 476/958] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:57.243251 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2781804-e002-44f9-a81f-10e60481433f None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:57.344082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2781804-e002-44f9-a81f-10e60481433f None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:57.378700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe53056-24d1-415c-91e3-a7e2e694a78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:57.379421 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe53056-24d1-415c-91e3-a7e2e694a78a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:57.379696 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe53056-24d1-415c-91e3-a7e2e694a78a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:57.380014 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe53056-24d1-415c-91e3-a7e2e694a78a None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:57.380752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe53056-24d1-415c-91e3-a7e2e694a78a None admin] RBAC: Adding query filter params (name=compute) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:57.381052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe53056-24d1-415c-91e3-a7e2e694a78a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:57.382434 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe53056-24d1-415c-91e3-a7e2e694a78a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:57.387619 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 483/959] 10.222.0.90 () {56 vars in 1112 bytes} [Wed Nov 2 12:39:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:57.393405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63540295-d356-4974-b539-4efc6bd8876b None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:57.497064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63540295-d356-4974-b539-4efc6bd8876b None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:57.531900 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e3586-146b-4817-8210-e024e8cc78cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:57.532612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e3586-146b-4817-8210-e024e8cc78cb None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:57.532898 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e3586-146b-4817-8210-e024e8cc78cb None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:57.533166 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e3586-146b-4817-8210-e024e8cc78cb None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:57.533931 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e3586-146b-4817-8210-e024e8cc78cb None admin] RBAC: Adding query filter params (type=compute) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:57.534232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e3586-146b-4817-8210-e024e8cc78cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:57.535645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e3586-146b-4817-8210-e024e8cc78cb None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:57.541827 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 477/960] 10.222.0.90 () {56 vars in 1112 bytes} [Wed Nov 2 12:39:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:57.544430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c354fe-6633-4360-95e5-526ad520eb2d None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:57.544716 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c354fe-6633-4360-95e5-526ad520eb2d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:57.545144 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c354fe-6633-4360-95e5-526ad520eb2d None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:57.548330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 484/961] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:57.553871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a4e24-ee32-4fe6-87db-f2e0b1263e61 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:57.554174 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a4e24-ee32-4fe6-87db-f2e0b1263e61 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:57.554422 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a4e24-ee32-4fe6-87db-f2e0b1263e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:57.575694 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-9f4a4e24-ee32-4fe6-87db-f2e0b1263e61 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:57.577642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-9f4a4e24-ee32-4fe6-87db-f2e0b1263e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:57.651283 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 478/962] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:39:57.675496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c354fe-6633-4360-95e5-526ad520eb2d None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:57.789776 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c354fe-6633-4360-95e5-526ad520eb2d None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:57.824515 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2b19a-4f58-4c15-b5b3-56d00fd4cf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:57.825366 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2b19a-4f58-4c15-b5b3-56d00fd4cf1f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:57.825646 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2b19a-4f58-4c15-b5b3-56d00fd4cf1f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:57.825940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2b19a-4f58-4c15-b5b3-56d00fd4cf1f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:57.836730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2b19a-4f58-4c15-b5b3-56d00fd4cf1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:39:57.845338 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-72b2b19a-4f58-4c15-b5b3-56d00fd4cf1f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 12:39:57.846970 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 485/963] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Nov 2 12:39:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:57.852847 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a4e24-ee32-4fe6-87db-f2e0b1263e61 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:57.951910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aee36-392d-4899-9692-a2f193aca7a7 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:57.952258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aee36-392d-4899-9692-a2f193aca7a7 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:57.952487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aee36-392d-4899-9692-a2f193aca7a7 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:57.954528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 486/964] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:57.958281 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a4e24-ee32-4fe6-87db-f2e0b1263e61 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:57.959737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8182a5-94ba-4667-8475-6003f57b494c None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:57.960237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8182a5-94ba-4667-8475-6003f57b494c None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:57.960719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8182a5-94ba-4667-8475-6003f57b494c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:57.978397 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-9d8182a5-94ba-4667-8475-6003f57b494c None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:57.980035 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-9d8182a5-94ba-4667-8475-6003f57b494c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:58.001187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542880ba-ffd2-43fe-94ed-d56498065705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:58.001906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542880ba-ffd2-43fe-94ed-d56498065705 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:58.002212 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542880ba-ffd2-43fe-94ed-d56498065705 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:58.002486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542880ba-ffd2-43fe-94ed-d56498065705 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:58.003278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542880ba-ffd2-43fe-94ed-d56498065705 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:58.003605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542880ba-ffd2-43fe-94ed-d56498065705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:58.005604 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542880ba-ffd2-43fe-94ed-d56498065705 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:58.021799 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 479/965] 10.222.0.90 () {56 vars in 1115 bytes} [Wed Nov 2 12:39:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:58.022853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542880ba-ffd2-43fe-94ed-d56498065705 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:58.068669 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 487/966] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:39:58.088131 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8182a5-94ba-4667-8475-6003f57b494c None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:58.129596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542880ba-ffd2-43fe-94ed-d56498065705 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:58.163707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d5f59-08e6-41f9-b655-d3d5d7eb8d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:58.164608 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d5f59-08e6-41f9-b655-d3d5d7eb8d49 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:58.164889 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d5f59-08e6-41f9-b655-d3d5d7eb8d49 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:58.165185 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d5f59-08e6-41f9-b655-d3d5d7eb8d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:58.176416 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d5f59-08e6-41f9-b655-d3d5d7eb8d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:58.177952 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d5f59-08e6-41f9-b655-d3d5d7eb8d49 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:58.189516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8182a5-94ba-4667-8475-6003f57b494c None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:58.196171 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-419d5f59-08e6-41f9-b655-d3d5d7eb8d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:58.202866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 480/967] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:58.203884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d5f59-08e6-41f9-b655-d3d5d7eb8d49 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:58.224924 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86312996-48a0-4ff5-9f8b-b76c6008d991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:58.225978 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86312996-48a0-4ff5-9f8b-b76c6008d991 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:58.226450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86312996-48a0-4ff5-9f8b-b76c6008d991 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:58.226977 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86312996-48a0-4ff5-9f8b-b76c6008d991 None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:58.227891 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86312996-48a0-4ff5-9f8b-b76c6008d991 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:58.229742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86312996-48a0-4ff5-9f8b-b76c6008d991 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:58.243463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.sql.core [None req-86312996-48a0-4ff5-9f8b-b76c6008d991 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 12:39:58.243463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 12:39:58.243463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [parameters: {'user_id': 'cd1e40aeb02642dfa3f61a54fb664b9c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 12:39:58.243463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86736) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 12:39:58.250431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-86312996-48a0-4ff5-9f8b-b76c6008d991 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 12:39:58.257212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 488/968] 10.222.0.90 () {60 vars in 1131 bytes} [Wed Nov 2 12:39:58 2022] POST /identity/v3/users => generated 160 bytes in 165 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:58.258589 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86312996-48a0-4ff5-9f8b-b76c6008d991 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:58.308942 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d5f59-08e6-41f9-b655-d3d5d7eb8d49 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:58.344742 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff717f-3afe-48c1-a89e-a8cc33a209c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:58.345297 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff717f-3afe-48c1-a89e-a8cc33a209c0 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:58.345615 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff717f-3afe-48c1-a89e-a8cc33a209c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:58.345876 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff717f-3afe-48c1-a89e-a8cc33a209c0 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:58.346772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff717f-3afe-48c1-a89e-a8cc33a209c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:58.346890 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff717f-3afe-48c1-a89e-a8cc33a209c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:58.348388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff717f-3afe-48c1-a89e-a8cc33a209c0 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:58.365679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86312996-48a0-4ff5-9f8b-b76c6008d991 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:58.366973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 481/969] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:58.367981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff717f-3afe-48c1-a89e-a8cc33a209c0 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:58.402195 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e3e5b-0e06-4318-8e3f-298ee1e5465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:58.403419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e3e5b-0e06-4318-8e3f-298ee1e5465c None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:58.403903 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e3e5b-0e06-4318-8e3f-298ee1e5465c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:58.404506 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e3e5b-0e06-4318-8e3f-298ee1e5465c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:58.413269 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e3e5b-0e06-4318-8e3f-298ee1e5465c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:58.415299 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e3e5b-0e06-4318-8e3f-298ee1e5465c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:58.432788 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c18e3e5b-0e06-4318-8e3f-298ee1e5465c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 12:39:58.439248 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 489/970] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:39:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:58.441005 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e3e5b-0e06-4318-8e3f-298ee1e5465c None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:58.485199 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff717f-3afe-48c1-a89e-a8cc33a209c0 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:58.529628 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357c71a-697e-4920-b43a-1dc957640743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:58.530614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357c71a-697e-4920-b43a-1dc957640743 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:58.531112 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357c71a-697e-4920-b43a-1dc957640743 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:58.531451 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357c71a-697e-4920-b43a-1dc957640743 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:58.541328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357c71a-697e-4920-b43a-1dc957640743 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:58.542939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357c71a-697e-4920-b43a-1dc957640743 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:58.562616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-5357c71a-697e-4920-b43a-1dc957640743 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 12:39:58.564788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 482/971] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Nov 2 12:39:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:39:58.569828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357c71a-697e-4920-b43a-1dc957640743 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:58.575705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e3e5b-0e06-4318-8e3f-298ee1e5465c None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:58.611790 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791e75d-7da0-470b-985d-9c970a399587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:58.612670 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791e75d-7da0-470b-985d-9c970a399587 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:58.613052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791e75d-7da0-470b-985d-9c970a399587 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:58.613423 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791e75d-7da0-470b-985d-9c970a399587 None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:58.614380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791e75d-7da0-470b-985d-9c970a399587 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:58.614784 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791e75d-7da0-470b-985d-9c970a399587 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:58.616431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791e75d-7da0-470b-985d-9c970a399587 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:58.660703 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 490/972] 10.222.0.90 () {56 vars in 1101 bytes} [Wed Nov 2 12:39:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:58.672321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357c71a-697e-4920-b43a-1dc957640743 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:58.711687 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a9fcf-5e82-40fc-9792-a4a27f8a756d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:58.712450 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a9fcf-5e82-40fc-9792-a4a27f8a756d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:58.712786 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a9fcf-5e82-40fc-9792-a4a27f8a756d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:58.713127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a9fcf-5e82-40fc-9792-a4a27f8a756d None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:58.713974 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a9fcf-5e82-40fc-9792-a4a27f8a756d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:58.714280 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a9fcf-5e82-40fc-9792-a4a27f8a756d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:58.715798 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a9fcf-5e82-40fc-9792-a4a27f8a756d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:58.740567 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 483/973] 10.222.0.90 () {56 vars in 1149 bytes} [Wed Nov 2 12:39:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:58.742212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791e75d-7da0-470b-985d-9c970a399587 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:58.854936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791e75d-7da0-470b-985d-9c970a399587 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:58.894373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d9161-2863-4354-accb-bede9b15fd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:58.895052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d9161-2863-4354-accb-bede9b15fd0e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:58.895358 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d9161-2863-4354-accb-bede9b15fd0e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:58.895633 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d9161-2863-4354-accb-bede9b15fd0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:58.969603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d9161-2863-4354-accb-bede9b15fd0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:58.971443 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d9161-2863-4354-accb-bede9b15fd0e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:59.075769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 491/974] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:39:58 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:39:59.077159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a9fcf-5e82-40fc-9792-a4a27f8a756d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:59.175102 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a9fcf-5e82-40fc-9792-a4a27f8a756d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:59.199533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ac871-7a20-4bdb-8032-1f004d2ba284 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:59.199847 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ac871-7a20-4bdb-8032-1f004d2ba284 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:59.200086 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ac871-7a20-4bdb-8032-1f004d2ba284 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:59.202168 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 492/975] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:39:59.207120 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd776f18-1156-4950-8085-bffef19bd18f None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:59.207701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd776f18-1156-4950-8085-bffef19bd18f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:59.207701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd776f18-1156-4950-8085-bffef19bd18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:59.208726 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2778ed-1adc-4acc-86f8-25067daef1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:59.209517 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2778ed-1adc-4acc-86f8-25067daef1b6 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:59.209796 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2778ed-1adc-4acc-86f8-25067daef1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:59.210066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2778ed-1adc-4acc-86f8-25067daef1b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:59.220493 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2778ed-1adc-4acc-86f8-25067daef1b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:59.222048 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2778ed-1adc-4acc-86f8-25067daef1b6 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:59.225236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-bd776f18-1156-4950-8085-bffef19bd18f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:59.226712 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-bd776f18-1156-4950-8085-bffef19bd18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:59.239317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-ab2778ed-1adc-4acc-86f8-25067daef1b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:39:59.245270 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 484/976] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:59.246098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2778ed-1adc-4acc-86f8-25067daef1b6 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:59.292962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 493/977] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:39:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:39:59.316036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd776f18-1156-4950-8085-bffef19bd18f None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:59.362645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2778ed-1adc-4acc-86f8-25067daef1b6 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:59.395577 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265973c0-3500-4b32-bc15-d9bd5da0ea82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:59.397478 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265973c0-3500-4b32-bc15-d9bd5da0ea82 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:59.397932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265973c0-3500-4b32-bc15-d9bd5da0ea82 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:59.398374 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265973c0-3500-4b32-bc15-d9bd5da0ea82 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:59.399281 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265973c0-3500-4b32-bc15-d9bd5da0ea82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:59.399766 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265973c0-3500-4b32-bc15-d9bd5da0ea82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:59.401461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265973c0-3500-4b32-bc15-d9bd5da0ea82 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:59.410899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd776f18-1156-4950-8085-bffef19bd18f None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:59.414725 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 485/978] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:59.420253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265973c0-3500-4b32-bc15-d9bd5da0ea82 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:59.445958 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672720e1-ff86-4616-9204-f398d5913396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:59.446698 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672720e1-ff86-4616-9204-f398d5913396 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:59.446978 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672720e1-ff86-4616-9204-f398d5913396 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:59.447250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672720e1-ff86-4616-9204-f398d5913396 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:59.447934 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672720e1-ff86-4616-9204-f398d5913396 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:59.449350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672720e1-ff86-4616-9204-f398d5913396 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:59.462874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-672720e1-ff86-4616-9204-f398d5913396 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:39:59.462874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 494/979] 10.222.0.90 () {56 vars in 1126 bytes} [Wed Nov 2 12:39:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:59.467524 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672720e1-ff86-4616-9204-f398d5913396 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:59.525748 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265973c0-3500-4b32-bc15-d9bd5da0ea82 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:59.559317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88628b44-dc9d-4400-af54-6a790d64e03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:59.560106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88628b44-dc9d-4400-af54-6a790d64e03a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:59.560410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88628b44-dc9d-4400-af54-6a790d64e03a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:59.560679 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88628b44-dc9d-4400-af54-6a790d64e03a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:59.567386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88628b44-dc9d-4400-af54-6a790d64e03a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:59.568015 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672720e1-ff86-4616-9204-f398d5913396 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:59.568858 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88628b44-dc9d-4400-af54-6a790d64e03a None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:59.583687 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-88628b44-dc9d-4400-af54-6a790d64e03a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:39:59.584932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 486/980] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:39:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:39:59.590785 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88628b44-dc9d-4400-af54-6a790d64e03a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:59.602678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548321f2-9d6d-46cd-8212-e175790664af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:59.603603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548321f2-9d6d-46cd-8212-e175790664af None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:59.604034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548321f2-9d6d-46cd-8212-e175790664af None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:59.604488 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548321f2-9d6d-46cd-8212-e175790664af None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:59.605322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548321f2-9d6d-46cd-8212-e175790664af None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:59.605763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548321f2-9d6d-46cd-8212-e175790664af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:59.607275 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548321f2-9d6d-46cd-8212-e175790664af None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:59.613754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 495/981] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Nov 2 12:39:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:59.619382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548321f2-9d6d-46cd-8212-e175790664af None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:59.695188 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88628b44-dc9d-4400-af54-6a790d64e03a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:59.722215 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548321f2-9d6d-46cd-8212-e175790664af None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:59.735864 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361b43c-ae95-4e20-a8c5-d5e84e42757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:59.736778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361b43c-ae95-4e20-a8c5-d5e84e42757a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:59.737057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361b43c-ae95-4e20-a8c5-d5e84e42757a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:59.737326 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361b43c-ae95-4e20-a8c5-d5e84e42757a None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:59.738108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361b43c-ae95-4e20-a8c5-d5e84e42757a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:59.738510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361b43c-ae95-4e20-a8c5-d5e84e42757a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:59.739866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361b43c-ae95-4e20-a8c5-d5e84e42757a None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:59.752317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 487/982] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:39:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:59.755898 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9e5a5-b5aa-4cad-beb2-ba64b5c32d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:59.756942 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9e5a5-b5aa-4cad-beb2-ba64b5c32d04 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:59.757415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9e5a5-b5aa-4cad-beb2-ba64b5c32d04 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:59.757682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9e5a5-b5aa-4cad-beb2-ba64b5c32d04 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:59.758043 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361b43c-ae95-4e20-a8c5-d5e84e42757a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:59.758394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9e5a5-b5aa-4cad-beb2-ba64b5c32d04 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:59.758706 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9e5a5-b5aa-4cad-beb2-ba64b5c32d04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:59.760173 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9e5a5-b5aa-4cad-beb2-ba64b5c32d04 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:59.765304 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 496/983] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Nov 2 12:39:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:59.771276 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9e5a5-b5aa-4cad-beb2-ba64b5c32d04 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:59.859681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361b43c-ae95-4e20-a8c5-d5e84e42757a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:59.865489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9e5a5-b5aa-4cad-beb2-ba64b5c32d04 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:59.893632 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e6819-5e51-4170-91ab-37cc8a4a640f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:59.894296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e6819-5e51-4170-91ab-37cc8a4a640f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:59.894574 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e6819-5e51-4170-91ab-37cc8a4a640f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:59.894844 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e6819-5e51-4170-91ab-37cc8a4a640f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:59.895670 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e6819-5e51-4170-91ab-37cc8a4a640f None admin] RBAC: Adding query filter params (role.id=32037682fb594c0a9fe6a908cde45c99, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=fef95ce95d4447a58063233a549adfe5) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:59.895984 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e6819-5e51-4170-91ab-37cc8a4a640f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:59.897455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e6819-5e51-4170-91ab-37cc8a4a640f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:59.901561 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761ab41-b9b5-4f21-9074-ecd18cc7f2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:59.902532 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ab41-b9b5-4f21-9074-ecd18cc7f2ea None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:59.902806 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ab41-b9b5-4f21-9074-ecd18cc7f2ea None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:59.903071 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ab41-b9b5-4f21-9074-ecd18cc7f2ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:59.903868 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761ab41-b9b5-4f21-9074-ecd18cc7f2ea None admin] RBAC: Adding query filter params (interface=admin, service_id=ff18c4aefcbd41b797662f27a082791c, region_id=RegionOne) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:59.904178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761ab41-b9b5-4f21-9074-ecd18cc7f2ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:59.904918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 488/984] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:39:59 2022] GET /identity/v3/role_assignments?user.id=fef95ce95d4447a58063233a549adfe5&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=32037682fb594c0a9fe6a908cde45c99 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:59.905676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761ab41-b9b5-4f21-9074-ecd18cc7f2ea None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:59.917455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 497/985] 10.222.0.90 () {56 vars in 1249 bytes} [Wed Nov 2 12:39:59 2022] GET /identity/v3/endpoints?service_id=ff18c4aefcbd41b797662f27a082791c&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:59.922951 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e6819-5e51-4170-91ab-37cc8a4a640f None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:00.005194 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc53759-164d-430e-94e5-924e7c978c76 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:00.005395 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc53759-164d-430e-94e5-924e7c978c76 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:00.005669 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc53759-164d-430e-94e5-924e7c978c76 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:00.007941 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 498/986] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:00.013755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778a0a0-c25e-4578-b8a7-85f10c87740f None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:00.014254 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778a0a0-c25e-4578-b8a7-85f10c87740f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:00.014627 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778a0a0-c25e-4578-b8a7-85f10c87740f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:00.029672 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e6819-5e51-4170-91ab-37cc8a4a640f None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:00.032358 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-b778a0a0-c25e-4578-b8a7-85f10c87740f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:00.033644 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-b778a0a0-c25e-4578-b8a7-85f10c87740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:00.066567 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630df290-fd76-43a3-be83-5a5cdd7c29fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:00.067335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df290-fd76-43a3-be83-5a5cdd7c29fa None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:00.067683 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df290-fd76-43a3-be83-5a5cdd7c29fa None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:00.068026 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df290-fd76-43a3-be83-5a5cdd7c29fa None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:00.068790 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630df290-fd76-43a3-be83-5a5cdd7c29fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:00.071429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630df290-fd76-43a3-be83-5a5cdd7c29fa None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:00.078274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 489/987] 10.222.0.90 () {56 vars in 1087 bytes} [Wed Nov 2 12:39:59 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:40:00.104267 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 499/988] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:00.127865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630df290-fd76-43a3-be83-5a5cdd7c29fa None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:00.232791 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630df290-fd76-43a3-be83-5a5cdd7c29fa None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:00.270170 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5512d-bbee-4967-8412-4c91546ba988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:00.270765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5512d-bbee-4967-8412-4c91546ba988 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:00.271045 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5512d-bbee-4967-8412-4c91546ba988 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:00.271323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5512d-bbee-4967-8412-4c91546ba988 None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:00.272054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5512d-bbee-4967-8412-4c91546ba988 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:00.273473 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5512d-bbee-4967-8412-4c91546ba988 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:00.289009 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 490/989] 10.222.0.90 () {60 vars in 1141 bytes} [Wed Nov 2 12:40:00 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:02.275824 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2edf74-c27c-4eba-9764-181edffb8144 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:02.276440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2edf74-c27c-4eba-9764-181edffb8144 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:02.276440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2edf74-c27c-4eba-9764-181edffb8144 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:02.278314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 500/990] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:02.284135 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d0f0f-e54e-4ed5-8bf6-1923f9ad7450 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:02.284586 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d0f0f-e54e-4ed5-8bf6-1923f9ad7450 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:02.284684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d0f0f-e54e-4ed5-8bf6-1923f9ad7450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:02.303211 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-ac9d0f0f-e54e-4ed5-8bf6-1923f9ad7450 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:02.304434 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ac9d0f0f-e54e-4ed5-8bf6-1923f9ad7450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:02.377945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 491/991] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:02.400188 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2edf74-c27c-4eba-9764-181edffb8144 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:02.402308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a418fb-8797-4807-91ff-764edc7e2c03 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:02.402618 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a418fb-8797-4807-91ff-764edc7e2c03 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:02.402895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a418fb-8797-4807-91ff-764edc7e2c03 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:02.404735 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 492/992] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:02.410426 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bde634-5c85-46ec-ab51-f0e841158800 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:02.410713 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bde634-5c85-46ec-ab51-f0e841158800 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:02.410992 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bde634-5c85-46ec-ab51-f0e841158800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:02.427911 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-e2bde634-5c85-46ec-ab51-f0e841158800 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:02.429089 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e2bde634-5c85-46ec-ab51-f0e841158800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:02.504891 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 493/993] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:40:02.513762 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2edf74-c27c-4eba-9764-181edffb8144 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:02.528239 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bde634-5c85-46ec-ab51-f0e841158800 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:02.548051 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366419e-b8a5-4cb6-a300-25baf2e59317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:02.549066 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366419e-b8a5-4cb6-a300-25baf2e59317 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:02.549516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366419e-b8a5-4cb6-a300-25baf2e59317 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:02.549933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366419e-b8a5-4cb6-a300-25baf2e59317 None admin] PATH_INFO: `/v3/services/image` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:02.550718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366419e-b8a5-4cb6-a300-25baf2e59317 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:02.552244 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366419e-b8a5-4cb6-a300-25baf2e59317 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:02.563456 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-8366419e-b8a5-4cb6-a300-25baf2e59317 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 12:40:02.564967 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 501/994] 10.222.0.90 () {56 vars in 1105 bytes} [Wed Nov 2 12:40:02 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:02.571562 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366419e-b8a5-4cb6-a300-25baf2e59317 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:02.623987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bde634-5c85-46ec-ab51-f0e841158800 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:02.656750 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d624d46-8a57-448d-b96f-19ecb0ea84bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:02.657564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d624d46-8a57-448d-b96f-19ecb0ea84bc None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:02.657846 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d624d46-8a57-448d-b96f-19ecb0ea84bc None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:02.658213 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d624d46-8a57-448d-b96f-19ecb0ea84bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:02.658876 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d624d46-8a57-448d-b96f-19ecb0ea84bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:02.660290 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d624d46-8a57-448d-b96f-19ecb0ea84bc None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:02.672874 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-9d624d46-8a57-448d-b96f-19ecb0ea84bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:40:02.674277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 494/995] 10.222.0.90 () {56 vars in 1126 bytes} [Wed Nov 2 12:40:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:40:02.675627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ac35b-d52e-4211-b66c-88b25eed1c8f None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:02.675929 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ac35b-d52e-4211-b66c-88b25eed1c8f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:02.676185 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ac35b-d52e-4211-b66c-88b25eed1c8f None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:02.678257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 495/996] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:02.680718 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ac35b-d52e-4211-b66c-88b25eed1c8f None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:02.681499 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366419e-b8a5-4cb6-a300-25baf2e59317 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:02.714117 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399513f-4be5-46a7-9663-3634de23478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:02.714867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399513f-4be5-46a7-9663-3634de23478f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:02.715144 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399513f-4be5-46a7-9663-3634de23478f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:02.715413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399513f-4be5-46a7-9663-3634de23478f None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:02.716109 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399513f-4be5-46a7-9663-3634de23478f None admin] RBAC: Adding query filter params (name=image) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:02.716429 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399513f-4be5-46a7-9663-3634de23478f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:02.717976 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399513f-4be5-46a7-9663-3634de23478f None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:02.727979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 502/997] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:02.727979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2c579-757b-4a81-9ed2-d80b50aa10f6 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:02.727979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2c579-757b-4a81-9ed2-d80b50aa10f6 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:02.727979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2c579-757b-4a81-9ed2-d80b50aa10f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:02.742929 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-cec2c579-757b-4a81-9ed2-d80b50aa10f6 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:02.744141 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-cec2c579-757b-4a81-9ed2-d80b50aa10f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:02.782960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ac35b-d52e-4211-b66c-88b25eed1c8f None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:02.809719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 503/998] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:02.810690 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2c579-757b-4a81-9ed2-d80b50aa10f6 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:02.816991 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156307c6-20a1-45c6-a45f-349ebf117b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:02.817741 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156307c6-20a1-45c6-a45f-349ebf117b3d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:02.818029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156307c6-20a1-45c6-a45f-349ebf117b3d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:02.818304 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156307c6-20a1-45c6-a45f-349ebf117b3d None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:02.819006 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156307c6-20a1-45c6-a45f-349ebf117b3d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:02.819308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156307c6-20a1-45c6-a45f-349ebf117b3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:02.820708 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156307c6-20a1-45c6-a45f-349ebf117b3d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:02.825528 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 496/999] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Nov 2 12:40:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:02.831296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156307c6-20a1-45c6-a45f-349ebf117b3d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:02.905985 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2c579-757b-4a81-9ed2-d80b50aa10f6 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:02.927358 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156307c6-20a1-45c6-a45f-349ebf117b3d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:02.937585 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66761ab2-aff1-4f29-ba7d-a74fb03b8150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:02.938243 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66761ab2-aff1-4f29-ba7d-a74fb03b8150 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:02.938519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66761ab2-aff1-4f29-ba7d-a74fb03b8150 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:02.938788 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66761ab2-aff1-4f29-ba7d-a74fb03b8150 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:02.939487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66761ab2-aff1-4f29-ba7d-a74fb03b8150 None admin] RBAC: Adding query filter params (type=image) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:02.939786 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66761ab2-aff1-4f29-ba7d-a74fb03b8150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:02.941174 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66761ab2-aff1-4f29-ba7d-a74fb03b8150 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:02.945535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 504/1000] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:02.946325 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66761ab2-aff1-4f29-ba7d-a74fb03b8150 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:02.963308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c76429-cab6-40ea-994d-b5ff3cfa4f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:02.964000 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c76429-cab6-40ea-994d-b5ff3cfa4f01 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:02.964290 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c76429-cab6-40ea-994d-b5ff3cfa4f01 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:02.964565 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c76429-cab6-40ea-994d-b5ff3cfa4f01 None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:02.965320 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c76429-cab6-40ea-994d-b5ff3cfa4f01 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:02.965609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c76429-cab6-40ea-994d-b5ff3cfa4f01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:02.967028 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c76429-cab6-40ea-994d-b5ff3cfa4f01 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:02.972815 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 497/1001] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Nov 2 12:40:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:02.978523 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c76429-cab6-40ea-994d-b5ff3cfa4f01 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:03.054809 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66761ab2-aff1-4f29-ba7d-a74fb03b8150 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:03.089070 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c76429-cab6-40ea-994d-b5ff3cfa4f01 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:03.097111 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d190f1-b82e-4c68-bb2a-ae0e3f7263fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:03.097972 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d190f1-b82e-4c68-bb2a-ae0e3f7263fb None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:03.098278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d190f1-b82e-4c68-bb2a-ae0e3f7263fb None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:03.098570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d190f1-b82e-4c68-bb2a-ae0e3f7263fb None admin] PATH_INFO: `/v3/services/compute` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:03.099244 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d190f1-b82e-4c68-bb2a-ae0e3f7263fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:03.100705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d190f1-b82e-4c68-bb2a-ae0e3f7263fb None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:03.112277 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-d2d190f1-b82e-4c68-bb2a-ae0e3f7263fb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 12:40:03.116668 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 505/1002] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:40:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:03.119766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d190f1-b82e-4c68-bb2a-ae0e3f7263fb None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:03.125759 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb152ec-7ac4-4aa4-aa5e-068d471776bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:03.126455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb152ec-7ac4-4aa4-aa5e-068d471776bb None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:03.126764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb152ec-7ac4-4aa4-aa5e-068d471776bb None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:03.127092 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb152ec-7ac4-4aa4-aa5e-068d471776bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:03.127802 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb152ec-7ac4-4aa4-aa5e-068d471776bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:03.129268 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb152ec-7ac4-4aa4-aa5e-068d471776bb None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:03.149462 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 498/1003] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:40:02 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:03.231581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d190f1-b82e-4c68-bb2a-ae0e3f7263fb None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:03.274455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16b168-5ca5-4360-80a5-f2490e9eecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:03.275132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16b168-5ca5-4360-80a5-f2490e9eecd8 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:03.275494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16b168-5ca5-4360-80a5-f2490e9eecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:03.275744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16b168-5ca5-4360-80a5-f2490e9eecd8 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:03.276475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16b168-5ca5-4360-80a5-f2490e9eecd8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:03.277315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16b168-5ca5-4360-80a5-f2490e9eecd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:03.278455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16b168-5ca5-4360-80a5-f2490e9eecd8 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:03.283931 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 506/1004] 10.222.0.90 () {56 vars in 1112 bytes} [Wed Nov 2 12:40:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:03.290653 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb152ec-7ac4-4aa4-aa5e-068d471776bb None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:03.395978 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb152ec-7ac4-4aa4-aa5e-068d471776bb None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:03.428666 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb26d1-739e-4832-a022-2f00d3a741ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:03.429352 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb26d1-739e-4832-a022-2f00d3a741ae None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:03.429635 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb26d1-739e-4832-a022-2f00d3a741ae None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:03.429907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb26d1-739e-4832-a022-2f00d3a741ae None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:03.430612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb26d1-739e-4832-a022-2f00d3a741ae None admin] RBAC: Adding query filter params (type=compute) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:03.430923 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb26d1-739e-4832-a022-2f00d3a741ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:03.432372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb26d1-739e-4832-a022-2f00d3a741ae None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:03.437792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 499/1005] 10.222.0.90 () {56 vars in 1112 bytes} [Wed Nov 2 12:40:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:03.443656 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16b168-5ca5-4360-80a5-f2490e9eecd8 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:03.547114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16b168-5ca5-4360-80a5-f2490e9eecd8 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:03.581303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f48206-81ed-4c45-9c26-6d493f69e8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:03.581961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48206-81ed-4c45-9c26-6d493f69e8f8 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:03.582242 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48206-81ed-4c45-9c26-6d493f69e8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:03.582512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48206-81ed-4c45-9c26-6d493f69e8f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:03.583285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f48206-81ed-4c45-9c26-6d493f69e8f8 None admin] RBAC: Adding query filter params (interface=public, service_id=3b0234fd5f944860bd35e631423eec94, region_id=RegionOne) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:03.583589 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f48206-81ed-4c45-9c26-6d493f69e8f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:03.584971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f48206-81ed-4c45-9c26-6d493f69e8f8 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:03.594507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 507/1006] 10.222.0.90 () {56 vars in 1251 bytes} [Wed Nov 2 12:40:03 2022] GET /identity/v3/endpoints?service_id=3b0234fd5f944860bd35e631423eec94&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:03.595735 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb26d1-739e-4832-a022-2f00d3a741ae None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:03.696310 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb26d1-739e-4832-a022-2f00d3a741ae None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:03.728594 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a5d10-1022-44a2-8302-42526c92632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:03.729256 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a5d10-1022-44a2-8302-42526c92632f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:03.729541 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a5d10-1022-44a2-8302-42526c92632f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:03.729809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a5d10-1022-44a2-8302-42526c92632f None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:03.730482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a5d10-1022-44a2-8302-42526c92632f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:03.731851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a5d10-1022-44a2-8302-42526c92632f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:03.738290 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 500/1007] 10.222.0.90 () {56 vars in 1087 bytes} [Wed Nov 2 12:40:03 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:05.321678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65764-4c25-4555-98fd-ad30bfdcb3f4 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:05.322246 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65764-4c25-4555-98fd-ad30bfdcb3f4 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:05.322330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65764-4c25-4555-98fd-ad30bfdcb3f4 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:05.324122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 508/1008] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:05.329360 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7d92c-cc5c-457c-8670-4829382568ad None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:05.329782 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7d92c-cc5c-457c-8670-4829382568ad None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:05.329963 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7d92c-cc5c-457c-8670-4829382568ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:05.346593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-13e7d92c-cc5c-457c-8670-4829382568ad None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:05.347765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-13e7d92c-cc5c-457c-8670-4829382568ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:05.415167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 501/1009] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:05.438489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65764-4c25-4555-98fd-ad30bfdcb3f4 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:05.506064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7bdc3-f957-4c3d-871f-aad0170d4b71 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:05.506396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7bdc3-f957-4c3d-871f-aad0170d4b71 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:05.506573 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7bdc3-f957-4c3d-871f-aad0170d4b71 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:05.508537 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 502/1010] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:40:05.513407 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79ece0-6618-4c80-8dca-f310d198a58a None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:05.513865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79ece0-6618-4c80-8dca-f310d198a58a None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:05.514145 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79ece0-6618-4c80-8dca-f310d198a58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:05.532463 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-8d79ece0-6618-4c80-8dca-f310d198a58a None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:05.533618 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8d79ece0-6618-4c80-8dca-f310d198a58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:05.544506 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65764-4c25-4555-98fd-ad30bfdcb3f4 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:05.578661 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdba0a2-6ef6-43e2-833a-52f75ddd6cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:05.579612 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdba0a2-6ef6-43e2-833a-52f75ddd6cff None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:05.580056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdba0a2-6ef6-43e2-833a-52f75ddd6cff None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:05.580508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdba0a2-6ef6-43e2-833a-52f75ddd6cff None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:05.581380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdba0a2-6ef6-43e2-833a-52f75ddd6cff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:05.582902 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdba0a2-6ef6-43e2-833a-52f75ddd6cff None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:05.601219 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 509/1011] 10.222.0.90 () {60 vars in 1141 bytes} [Wed Nov 2 12:40:05 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:05.612260 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 503/1012] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:05 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:40:05.633540 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdba0a2-6ef6-43e2-833a-52f75ddd6cff None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:05.744486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdba0a2-6ef6-43e2-833a-52f75ddd6cff None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:05.780049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5782ac1-b5d7-4602-996a-da2a4353e028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:05.780887 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5782ac1-b5d7-4602-996a-da2a4353e028 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:05.781164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5782ac1-b5d7-4602-996a-da2a4353e028 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:05.781438 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5782ac1-b5d7-4602-996a-da2a4353e028 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:05.782657 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5782ac1-b5d7-4602-996a-da2a4353e028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:05.784119 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5782ac1-b5d7-4602-996a-da2a4353e028 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:05.785997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 510/1013] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:05.791851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79ece0-6618-4c80-8dca-f310d198a58a None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:05.892161 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79ece0-6618-4c80-8dca-f310d198a58a None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:05.926396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0fff5-66e5-4d2f-af51-b888d07f11bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:05.927064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0fff5-66e5-4d2f-af51-b888d07f11bc None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:05.927344 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0fff5-66e5-4d2f-af51-b888d07f11bc None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:05.927614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0fff5-66e5-4d2f-af51-b888d07f11bc None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:05.928341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0fff5-66e5-4d2f-af51-b888d07f11bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:05.929776 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0fff5-66e5-4d2f-af51-b888d07f11bc None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:05.956178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 504/1014] 10.222.0.90 () {60 vars in 1141 bytes} [Wed Nov 2 12:40:05 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:40:06.069597 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd1c4-ae5c-4497-ab07-7119c67b85f4 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:06.069845 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd1c4-ae5c-4497-ab07-7119c67b85f4 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:06.070133 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd1c4-ae5c-4497-ab07-7119c67b85f4 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:06.072085 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 511/1015] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:06.078082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237515c2-4160-4eae-9daa-e29bf33bc768 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:06.078455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237515c2-4160-4eae-9daa-e29bf33bc768 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:06.078834 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237515c2-4160-4eae-9daa-e29bf33bc768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:06.097752 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-237515c2-4160-4eae-9daa-e29bf33bc768 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:06.098951 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-237515c2-4160-4eae-9daa-e29bf33bc768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:06.171477 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 505/1016] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:06 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:06.194876 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffd1c4-ae5c-4497-ab07-7119c67b85f4 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:06.293555 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffd1c4-ae5c-4497-ab07-7119c67b85f4 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:06.325747 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9f515-7a4f-4984-8088-7f4a2b820fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:06.326735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9f515-7a4f-4984-8088-7f4a2b820fa6 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:06.326923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9f515-7a4f-4984-8088-7f4a2b820fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:06.327202 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9f515-7a4f-4984-8088-7f4a2b820fa6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:06.327874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9f515-7a4f-4984-8088-7f4a2b820fa6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:06.329334 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9f515-7a4f-4984-8088-7f4a2b820fa6 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:06.340417 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-dcd9f515-7a4f-4984-8088-7f4a2b820fa6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 12:40:06.342011 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 512/1017] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:40:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:06.348056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237515c2-4160-4eae-9daa-e29bf33bc768 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:06.445046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237515c2-4160-4eae-9daa-e29bf33bc768 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:06.479220 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464234e0-568d-46c4-83b4-8a49cc5b6c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:06.479886 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464234e0-568d-46c4-83b4-8a49cc5b6c79 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:06.480160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464234e0-568d-46c4-83b4-8a49cc5b6c79 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:06.480450 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464234e0-568d-46c4-83b4-8a49cc5b6c79 None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:06.481146 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464234e0-568d-46c4-83b4-8a49cc5b6c79 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:06.481445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464234e0-568d-46c4-83b4-8a49cc5b6c79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:06.482882 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464234e0-568d-46c4-83b4-8a49cc5b6c79 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:06.487894 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 506/1018] 10.222.0.90 () {56 vars in 1112 bytes} [Wed Nov 2 12:40:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:06.493407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9f515-7a4f-4984-8088-7f4a2b820fa6 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:06.603155 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9f515-7a4f-4984-8088-7f4a2b820fa6 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:06.642024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e8545-ed4a-47e0-a4e6-51f8a714d2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:06.642864 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e8545-ed4a-47e0-a4e6-51f8a714d2ba None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:06.643198 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e8545-ed4a-47e0-a4e6-51f8a714d2ba None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:06.643532 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e8545-ed4a-47e0-a4e6-51f8a714d2ba None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:06.644477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e8545-ed4a-47e0-a4e6-51f8a714d2ba None admin] RBAC: Adding query filter params (type=compute) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:06.644862 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e8545-ed4a-47e0-a4e6-51f8a714d2ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:06.646506 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e8545-ed4a-47e0-a4e6-51f8a714d2ba None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:06.652955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 513/1019] 10.222.0.90 () {56 vars in 1112 bytes} [Wed Nov 2 12:40:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:06.659268 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464234e0-568d-46c4-83b4-8a49cc5b6c79 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:06.761695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464234e0-568d-46c4-83b4-8a49cc5b6c79 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:06.799079 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55972f42-466a-44f2-a407-4a3b823b7c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:06.799747 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55972f42-466a-44f2-a407-4a3b823b7c13 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:06.800017 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55972f42-466a-44f2-a407-4a3b823b7c13 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:06.800333 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55972f42-466a-44f2-a407-4a3b823b7c13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:06.801132 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55972f42-466a-44f2-a407-4a3b823b7c13 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:06.802628 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55972f42-466a-44f2-a407-4a3b823b7c13 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:06.823335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 507/1020] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:40:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:07.979225 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da663f75-927d-498b-9a8c-06318e56d60d None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:07.979808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da663f75-927d-498b-9a8c-06318e56d60d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:07.979808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da663f75-927d-498b-9a8c-06318e56d60d None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:07.981597 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 514/1021] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:07.988236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0ab44-e201-4068-8cc4-846009732bbd None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:07.988784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0ab44-e201-4068-8cc4-846009732bbd None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:07.988784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0ab44-e201-4068-8cc4-846009732bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.006709 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-deb0ab44-e201-4068-8cc4-846009732bbd None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:08.007943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-deb0ab44-e201-4068-8cc4-846009732bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:08.082957 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 508/1022] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:08.106153 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da663f75-927d-498b-9a8c-06318e56d60d None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:08.206184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da663f75-927d-498b-9a8c-06318e56d60d None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:08.238297 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69624d4e-5205-4019-866e-3429599ee93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:08.239010 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69624d4e-5205-4019-866e-3429599ee93c None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:08.239284 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69624d4e-5205-4019-866e-3429599ee93c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:08.239553 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69624d4e-5205-4019-866e-3429599ee93c None admin] PATH_INFO: `/v3/services/image` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.240193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69624d4e-5205-4019-866e-3429599ee93c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:08.241573 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69624d4e-5205-4019-866e-3429599ee93c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:08.252159 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-69624d4e-5205-4019-866e-3429599ee93c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 12:40:08.253634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 515/1023] 10.222.0.90 () {56 vars in 1105 bytes} [Wed Nov 2 12:40:08 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:08.259439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0ab44-e201-4068-8cc4-846009732bbd None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:08.327262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5770f9-6c42-4554-b277-83fce0166992 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:08.327262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5770f9-6c42-4554-b277-83fce0166992 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:08.327262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5770f9-6c42-4554-b277-83fce0166992 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.327997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 516/1024] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:08.333071 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ba00d-3fe1-4dcd-8df0-58ec42d495cc None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:08.333372 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ba00d-3fe1-4dcd-8df0-58ec42d495cc None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:08.333648 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ba00d-3fe1-4dcd-8df0-58ec42d495cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.353118 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-cb6ba00d-3fe1-4dcd-8df0-58ec42d495cc None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:08.354340 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-cb6ba00d-3fe1-4dcd-8df0-58ec42d495cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:08.359286 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0ab44-e201-4068-8cc4-846009732bbd None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:08.395113 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8eb00-fb03-4f54-8ee2-af889344d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:08.395779 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8eb00-fb03-4f54-8ee2-af889344d9e8 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:08.396054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8eb00-fb03-4f54-8ee2-af889344d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:08.396346 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8eb00-fb03-4f54-8ee2-af889344d9e8 None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.397136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8eb00-fb03-4f54-8ee2-af889344d9e8 None admin] RBAC: Adding query filter params (name=image) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:08.397435 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8eb00-fb03-4f54-8ee2-af889344d9e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:08.398865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8eb00-fb03-4f54-8ee2-af889344d9e8 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:08.404568 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 509/1025] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:08.410204 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8eb00-fb03-4f54-8ee2-af889344d9e8 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:08.425157 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 517/1026] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:40:08.451265 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ba00d-3fe1-4dcd-8df0-58ec42d495cc None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:08.508338 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8eb00-fb03-4f54-8ee2-af889344d9e8 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:08.540711 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521c75f-347a-4bfa-ba77-a8843258155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:08.541509 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521c75f-347a-4bfa-ba77-a8843258155b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:08.541783 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521c75f-347a-4bfa-ba77-a8843258155b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:08.542053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521c75f-347a-4bfa-ba77-a8843258155b None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.542777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521c75f-347a-4bfa-ba77-a8843258155b None admin] RBAC: Adding query filter params (type=image) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:08.543077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521c75f-347a-4bfa-ba77-a8843258155b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:08.544498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521c75f-347a-4bfa-ba77-a8843258155b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:08.549640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 510/1027] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:08.553817 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ba00d-3fe1-4dcd-8df0-58ec42d495cc None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:08.555311 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521c75f-347a-4bfa-ba77-a8843258155b None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:08.587289 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f8321-1a20-46df-b026-4520da99df1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:08.588354 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f8321-1a20-46df-b026-4520da99df1e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:08.588633 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f8321-1a20-46df-b026-4520da99df1e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:08.588950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f8321-1a20-46df-b026-4520da99df1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.590173 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f8321-1a20-46df-b026-4520da99df1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:08.591674 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f8321-1a20-46df-b026-4520da99df1e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:08.598247 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 518/1028] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:08.600147 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f8321-1a20-46df-b026-4520da99df1e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:08.651991 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521c75f-347a-4bfa-ba77-a8843258155b None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:08.687074 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a06f72-dfd4-4200-adb3-6aa51f0692b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:08.687776 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a06f72-dfd4-4200-adb3-6aa51f0692b3 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:08.687969 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a06f72-dfd4-4200-adb3-6aa51f0692b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:08.688258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a06f72-dfd4-4200-adb3-6aa51f0692b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.689033 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a06f72-dfd4-4200-adb3-6aa51f0692b3 None admin] RBAC: Adding query filter params (interface=public, service_id=5a8adc6386d2402486b81b3ced617efb, region_id=RegionOne) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:08.689338 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a06f72-dfd4-4200-adb3-6aa51f0692b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:08.690715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a06f72-dfd4-4200-adb3-6aa51f0692b3 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:08.695757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 511/1029] 10.222.0.90 () {56 vars in 1251 bytes} [Wed Nov 2 12:40:08 2022] GET /identity/v3/endpoints?service_id=5a8adc6386d2402486b81b3ced617efb&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:08.697368 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f8321-1a20-46df-b026-4520da99df1e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:08.701639 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a06f72-dfd4-4200-adb3-6aa51f0692b3 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:08.731111 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea4756-e2d5-4a60-9cc2-0f76b17a2848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:08.732095 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4756-e2d5-4a60-9cc2-0f76b17a2848 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:08.732095 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4756-e2d5-4a60-9cc2-0f76b17a2848 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:08.733839 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4756-e2d5-4a60-9cc2-0f76b17a2848 None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.733839 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea4756-e2d5-4a60-9cc2-0f76b17a2848 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:08.734520 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea4756-e2d5-4a60-9cc2-0f76b17a2848 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:08.764324 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 519/1030] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:40:08 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:08.807749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a06f72-dfd4-4200-adb3-6aa51f0692b3 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:08.844394 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83587cb6-49d8-42c6-a469-6c569edcb4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:08.845073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83587cb6-49d8-42c6-a469-6c569edcb4e8 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:08.845347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83587cb6-49d8-42c6-a469-6c569edcb4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:08.845616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83587cb6-49d8-42c6-a469-6c569edcb4e8 None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.846292 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83587cb6-49d8-42c6-a469-6c569edcb4e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:08.847673 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83587cb6-49d8-42c6-a469-6c569edcb4e8 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:08.855171 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 512/1031] 10.222.0.90 () {56 vars in 1087 bytes} [Wed Nov 2 12:40:08 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:40:09.368261 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c948f5c-6749-45f5-b608-6cb0f223def7 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:09.368798 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c948f5c-6749-45f5-b608-6cb0f223def7 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:09.368798 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c948f5c-6749-45f5-b608-6cb0f223def7 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:09.370710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 520/1032] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:09.376190 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10101723-745b-4e02-999c-87054ff0e4cf None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:09.376712 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10101723-745b-4e02-999c-87054ff0e4cf None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:09.376904 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10101723-745b-4e02-999c-87054ff0e4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:09.394814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-10101723-745b-4e02-999c-87054ff0e4cf None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:09.395984 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-10101723-745b-4e02-999c-87054ff0e4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:09.468241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 513/1033] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:09.490302 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c948f5c-6749-45f5-b608-6cb0f223def7 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:09.596449 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c948f5c-6749-45f5-b608-6cb0f223def7 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:09.629780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d06c8-55a7-456e-a2cf-3859cb363b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:09.630554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d06c8-55a7-456e-a2cf-3859cb363b8a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:09.630832 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d06c8-55a7-456e-a2cf-3859cb363b8a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:09.631105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d06c8-55a7-456e-a2cf-3859cb363b8a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:09.642041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d06c8-55a7-456e-a2cf-3859cb363b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:40:09.649393 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-2d2d06c8-55a7-456e-a2cf-3859cb363b8a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 12:40:09.650865 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 521/1034] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Nov 2 12:40:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:09.657606 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10101723-745b-4e02-999c-87054ff0e4cf None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:09.758698 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10101723-745b-4e02-999c-87054ff0e4cf None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:09.792059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8bd74-e9bb-4b0d-9948-81584370915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:09.793003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8bd74-e9bb-4b0d-9948-81584370915e None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:09.793445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8bd74-e9bb-4b0d-9948-81584370915e None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:09.793852 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8bd74-e9bb-4b0d-9948-81584370915e None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:09.794823 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8bd74-e9bb-4b0d-9948-81584370915e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:09.795266 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8bd74-e9bb-4b0d-9948-81584370915e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:09.796793 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8bd74-e9bb-4b0d-9948-81584370915e None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:09.805331 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 514/1035] 10.222.0.90 () {56 vars in 1115 bytes} [Wed Nov 2 12:40:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:09.811220 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d06c8-55a7-456e-a2cf-3859cb363b8a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:09.911497 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d06c8-55a7-456e-a2cf-3859cb363b8a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:09.945626 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c6265-41fd-4c84-88d6-ff277444f2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:09.946419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c6265-41fd-4c84-88d6-ff277444f2e0 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:09.946682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c6265-41fd-4c84-88d6-ff277444f2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:09.946952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c6265-41fd-4c84-88d6-ff277444f2e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:09.957748 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c6265-41fd-4c84-88d6-ff277444f2e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:09.959278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c6265-41fd-4c84-88d6-ff277444f2e0 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:09.977743 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-747c6265-41fd-4c84-88d6-ff277444f2e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:40:09.979227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 522/1036] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:09.985351 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8bd74-e9bb-4b0d-9948-81584370915e None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:10.088482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8bd74-e9bb-4b0d-9948-81584370915e None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:10.121472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12700f-580a-4f7e-be07-1af18dcbfc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:10.122142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12700f-580a-4f7e-be07-1af18dcbfc82 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:10.122418 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12700f-580a-4f7e-be07-1af18dcbfc82 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:10.123086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12700f-580a-4f7e-be07-1af18dcbfc82 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:10.123726 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12700f-580a-4f7e-be07-1af18dcbfc82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:10.124066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12700f-580a-4f7e-be07-1af18dcbfc82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:10.125561 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12700f-580a-4f7e-be07-1af18dcbfc82 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:10.141931 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 515/1037] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:10.143581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c6265-41fd-4c84-88d6-ff277444f2e0 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:10.241605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c6265-41fd-4c84-88d6-ff277444f2e0 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:10.274554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cde1c3-f7f5-4dfb-a5ff-ed7147833145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:10.275363 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cde1c3-f7f5-4dfb-a5ff-ed7147833145 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:10.275638 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cde1c3-f7f5-4dfb-a5ff-ed7147833145 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:10.275912 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cde1c3-f7f5-4dfb-a5ff-ed7147833145 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:10.283937 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cde1c3-f7f5-4dfb-a5ff-ed7147833145 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:10.285418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cde1c3-f7f5-4dfb-a5ff-ed7147833145 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:10.298636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c8cde1c3-f7f5-4dfb-a5ff-ed7147833145 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:40:10.304489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 523/1038] 10.222.0.90 () {56 vars in 1093 bytes} [Wed Nov 2 12:40:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:10.306075 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12700f-580a-4f7e-be07-1af18dcbfc82 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:10.403266 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12700f-580a-4f7e-be07-1af18dcbfc82 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:10.436804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647377d2-9e7e-4beb-b19f-1823a7194bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:10.437613 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647377d2-9e7e-4beb-b19f-1823a7194bab None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:10.437963 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647377d2-9e7e-4beb-b19f-1823a7194bab None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:10.438200 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647377d2-9e7e-4beb-b19f-1823a7194bab None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:10.439138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647377d2-9e7e-4beb-b19f-1823a7194bab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:10.439490 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647377d2-9e7e-4beb-b19f-1823a7194bab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:10.441054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647377d2-9e7e-4beb-b19f-1823a7194bab None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:10.460548 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 516/1039] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Nov 2 12:40:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:10.469412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cde1c3-f7f5-4dfb-a5ff-ed7147833145 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:10.572303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cde1c3-f7f5-4dfb-a5ff-ed7147833145 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:10.605639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293a6ad-ea07-49bf-9913-e18c26008095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:10.606289 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293a6ad-ea07-49bf-9913-e18c26008095 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:10.606560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293a6ad-ea07-49bf-9913-e18c26008095 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:10.606897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293a6ad-ea07-49bf-9913-e18c26008095 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:10.673943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293a6ad-ea07-49bf-9913-e18c26008095 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:10.675398 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293a6ad-ea07-49bf-9913-e18c26008095 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:10.778136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 524/1040] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:40:10 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:40:10.784262 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647377d2-9e7e-4beb-b19f-1823a7194bab None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:10.889654 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647377d2-9e7e-4beb-b19f-1823a7194bab None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:10.925493 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2bd74-849c-4743-b24a-8ad0e703a98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:10.926684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2bd74-849c-4743-b24a-8ad0e703a98f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:10.927184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2bd74-849c-4743-b24a-8ad0e703a98f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:10.927676 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2bd74-849c-4743-b24a-8ad0e703a98f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:10.938311 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2bd74-849c-4743-b24a-8ad0e703a98f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:10.940038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2bd74-849c-4743-b24a-8ad0e703a98f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:10.957452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-4fc2bd74-849c-4743-b24a-8ad0e703a98f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:40:10.959218 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 517/1041] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:10.965086 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293a6ad-ea07-49bf-9913-e18c26008095 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:11.061420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293a6ad-ea07-49bf-9913-e18c26008095 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:11.095728 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42903286-92b0-45e2-983f-320e04f8345b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:11.096422 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42903286-92b0-45e2-983f-320e04f8345b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:11.096701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42903286-92b0-45e2-983f-320e04f8345b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:11.096972 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42903286-92b0-45e2-983f-320e04f8345b None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:11.097684 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42903286-92b0-45e2-983f-320e04f8345b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:11.097987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42903286-92b0-45e2-983f-320e04f8345b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:11.099344 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42903286-92b0-45e2-983f-320e04f8345b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:11.115223 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 525/1042] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:11.116874 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2bd74-849c-4743-b24a-8ad0e703a98f None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:11.154262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aff83-8f97-4d75-bb50-28b4ff2aa2d3 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:11.154550 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aff83-8f97-4d75-bb50-28b4ff2aa2d3 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:11.154739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aff83-8f97-4d75-bb50-28b4ff2aa2d3 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:11.156875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 526/1043] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:40:11.163003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b49640-8cb1-407f-a532-a9b872bcb287 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:11.163291 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b49640-8cb1-407f-a532-a9b872bcb287 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:11.163576 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b49640-8cb1-407f-a532-a9b872bcb287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:11.180401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-f6b49640-8cb1-407f-a532-a9b872bcb287 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:11.181647 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f6b49640-8cb1-407f-a532-a9b872bcb287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:11.217137 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2bd74-849c-4743-b24a-8ad0e703a98f None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:11.246168 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 527/1044] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:11.247603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34850c54-3e63-478b-a48c-8fcfcca8b1ec None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:11.247897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34850c54-3e63-478b-a48c-8fcfcca8b1ec None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:11.248469 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34850c54-3e63-478b-a48c-8fcfcca8b1ec None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:11.250292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 528/1045] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:11.250671 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598893b-8161-4e3e-bcba-5ba6deea69b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:11.251527 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598893b-8161-4e3e-bcba-5ba6deea69b5 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:11.251803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598893b-8161-4e3e-bcba-5ba6deea69b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:11.252066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598893b-8161-4e3e-bcba-5ba6deea69b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:11.255259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13022e7e-092f-4514-ae51-1403fdfcab71 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:11.255549 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13022e7e-092f-4514-ae51-1403fdfcab71 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:11.255827 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13022e7e-092f-4514-ae51-1403fdfcab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:11.260752 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598893b-8161-4e3e-bcba-5ba6deea69b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:11.262191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598893b-8161-4e3e-bcba-5ba6deea69b5 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:11.271842 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-13022e7e-092f-4514-ae51-1403fdfcab71 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:11.273082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-13022e7e-092f-4514-ae51-1403fdfcab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:11.275288 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-4598893b-8161-4e3e-bcba-5ba6deea69b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:40:11.276865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 518/1046] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:11.277626 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598893b-8161-4e3e-bcba-5ba6deea69b5 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:11.337494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 529/1047] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:40:11.338386 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13022e7e-092f-4514-ae51-1403fdfcab71 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:11.376933 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598893b-8161-4e3e-bcba-5ba6deea69b5 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:11.410960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823c048-11a9-455f-a10d-715f1bd5866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:11.411678 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823c048-11a9-455f-a10d-715f1bd5866d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:11.411957 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823c048-11a9-455f-a10d-715f1bd5866d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:11.412226 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823c048-11a9-455f-a10d-715f1bd5866d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:11.422203 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823c048-11a9-455f-a10d-715f1bd5866d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:40:11.429133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-4823c048-11a9-455f-a10d-715f1bd5866d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:40:11.430347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 519/1048] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:40:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:11.431107 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823c048-11a9-455f-a10d-715f1bd5866d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:11.435657 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13022e7e-092f-4514-ae51-1403fdfcab71 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:11.469700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f5a83-062b-445a-8fd7-f37df509abcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:11.470374 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f5a83-062b-445a-8fd7-f37df509abcf None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:11.470647 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f5a83-062b-445a-8fd7-f37df509abcf None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:11.470916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f5a83-062b-445a-8fd7-f37df509abcf None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:11.471697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f5a83-062b-445a-8fd7-f37df509abcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:11.471999 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f5a83-062b-445a-8fd7-f37df509abcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:11.473522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f5a83-062b-445a-8fd7-f37df509abcf None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:11.485585 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 530/1049] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:11.486461 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f5a83-062b-445a-8fd7-f37df509abcf None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:11.530401 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823c048-11a9-455f-a10d-715f1bd5866d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:11.562851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d015a-7a58-446d-a02b-3bf0c07ac717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:11.563635 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d015a-7a58-446d-a02b-3bf0c07ac717 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:11.563908 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d015a-7a58-446d-a02b-3bf0c07ac717 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:11.564173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d015a-7a58-446d-a02b-3bf0c07ac717 None admin] PATH_INFO: `/v3/services/image` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:11.564855 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d015a-7a58-446d-a02b-3bf0c07ac717 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:11.566220 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d015a-7a58-446d-a02b-3bf0c07ac717 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:11.576664 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-7f2d015a-7a58-446d-a02b-3bf0c07ac717 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 12:40:11.582894 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 520/1050] 10.222.0.90 () {56 vars in 1105 bytes} [Wed Nov 2 12:40:11 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:11.582894 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d015a-7a58-446d-a02b-3bf0c07ac717 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:11.583127 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f5a83-062b-445a-8fd7-f37df509abcf None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:11.616024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5defbf-842c-47fd-9e1a-6e325142fc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:11.616712 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5defbf-842c-47fd-9e1a-6e325142fc29 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:11.616987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5defbf-842c-47fd-9e1a-6e325142fc29 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:11.617236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5defbf-842c-47fd-9e1a-6e325142fc29 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:11.617968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5defbf-842c-47fd-9e1a-6e325142fc29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:11.618272 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5defbf-842c-47fd-9e1a-6e325142fc29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:11.619678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5defbf-842c-47fd-9e1a-6e325142fc29 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:11.628730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 531/1051] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:40:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:11.629507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5defbf-842c-47fd-9e1a-6e325142fc29 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:11.675128 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d015a-7a58-446d-a02b-3bf0c07ac717 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:11.708260 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0104c-a09f-44af-a3a3-e78fc648f9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:11.708909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0104c-a09f-44af-a3a3-e78fc648f9bb None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:11.709184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0104c-a09f-44af-a3a3-e78fc648f9bb None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:11.709455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0104c-a09f-44af-a3a3-e78fc648f9bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:11.710277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0104c-a09f-44af-a3a3-e78fc648f9bb None admin] RBAC: Adding query filter params (role.id=32037682fb594c0a9fe6a908cde45c99, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=fbcda58f298444eebf4f08ce01deffc0) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:11.710580 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0104c-a09f-44af-a3a3-e78fc648f9bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:11.712008 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0104c-a09f-44af-a3a3-e78fc648f9bb None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:11.717369 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 521/1052] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:40:11 2022] GET /identity/v3/role_assignments?user.id=fbcda58f298444eebf4f08ce01deffc0&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=32037682fb594c0a9fe6a908cde45c99 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:11.718130 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0104c-a09f-44af-a3a3-e78fc648f9bb None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:11.723336 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5defbf-842c-47fd-9e1a-6e325142fc29 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:11.759819 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228f62c-9a47-4eb1-a77e-4d5780cb012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:11.760533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228f62c-9a47-4eb1-a77e-4d5780cb012e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:11.760811 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228f62c-9a47-4eb1-a77e-4d5780cb012e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:11.761109 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228f62c-9a47-4eb1-a77e-4d5780cb012e None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:11.761793 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228f62c-9a47-4eb1-a77e-4d5780cb012e None admin] RBAC: Adding query filter params (name=image) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:11.762095 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228f62c-9a47-4eb1-a77e-4d5780cb012e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:11.763721 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228f62c-9a47-4eb1-a77e-4d5780cb012e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:11.774105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 532/1053] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:11.775026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228f62c-9a47-4eb1-a77e-4d5780cb012e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:11.825332 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0104c-a09f-44af-a3a3-e78fc648f9bb None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:11.859707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2135c42-8ea9-4622-9c71-8a97688fff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:11.860740 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2135c42-8ea9-4622-9c71-8a97688fff3c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:11.861014 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2135c42-8ea9-4622-9c71-8a97688fff3c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:11.861278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2135c42-8ea9-4622-9c71-8a97688fff3c None admin] PATH_INFO: `/v3/users/8aa190107db8438c99502506fa320213` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:11.875520 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2135c42-8ea9-4622-9c71-8a97688fff3c None admin] RBAC: Authorizing `identity:get_user(user_id=8aa190107db8438c99502506fa320213)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:11.877030 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2135c42-8ea9-4622-9c71-8a97688fff3c None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:11.877461 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228f62c-9a47-4eb1-a77e-4d5780cb012e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:11.878945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 522/1054] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:40:11 2022] GET /identity/v3/users/8aa190107db8438c99502506fa320213 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:11.884797 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2135c42-8ea9-4622-9c71-8a97688fff3c None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:11.912799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1f257-3d08-40db-8ea6-70c27a92f7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:11.913473 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1f257-3d08-40db-8ea6-70c27a92f7d2 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:11.913752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1f257-3d08-40db-8ea6-70c27a92f7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:11.914026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1f257-3d08-40db-8ea6-70c27a92f7d2 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:11.914731 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1f257-3d08-40db-8ea6-70c27a92f7d2 None admin] RBAC: Adding query filter params (type=image) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:11.915033 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1f257-3d08-40db-8ea6-70c27a92f7d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:11.916545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1f257-3d08-40db-8ea6-70c27a92f7d2 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:11.921486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 533/1055] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:11.928854 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1f257-3d08-40db-8ea6-70c27a92f7d2 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:11.988887 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2135c42-8ea9-4622-9c71-8a97688fff3c None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:12.022554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60fede-c816-4172-8490-2303dfbbb2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:12.023197 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60fede-c816-4172-8490-2303dfbbb2a0 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:12.023473 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60fede-c816-4172-8490-2303dfbbb2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:12.023737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60fede-c816-4172-8490-2303dfbbb2a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:12.037003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1f257-3d08-40db-8ea6-70c27a92f7d2 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:12.070989 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77efd7-6dd0-493e-aab3-f1e9a225362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:12.071669 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77efd7-6dd0-493e-aab3-f1e9a225362e None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:12.071977 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77efd7-6dd0-493e-aab3-f1e9a225362e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:12.072271 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77efd7-6dd0-493e-aab3-f1e9a225362e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:12.073007 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77efd7-6dd0-493e-aab3-f1e9a225362e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:12.074382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77efd7-6dd0-493e-aab3-f1e9a225362e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:12.094220 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60fede-c816-4172-8490-2303dfbbb2a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:12.095809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60fede-c816-4172-8490-2303dfbbb2a0 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:12.108541 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 534/1056] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:40:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:40:12.205477 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 523/1057] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:40:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 12:40:12.211533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77efd7-6dd0-493e-aab3-f1e9a225362e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:12.323742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77efd7-6dd0-493e-aab3-f1e9a225362e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:12.355931 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d676626-5fb7-453b-adbb-7e9e5577d2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:12.357051 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d676626-5fb7-453b-adbb-7e9e5577d2b0 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:12.357293 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d676626-5fb7-453b-adbb-7e9e5577d2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:12.357564 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d676626-5fb7-453b-adbb-7e9e5577d2b0 None admin] PATH_INFO: `/v3/projects/53c94b2d783f4d76b65368ee7ff9884c` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:12.358753 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d676626-5fb7-453b-adbb-7e9e5577d2b0 None admin] RBAC: Authorizing `identity:get_project(project_id=53c94b2d783f4d76b65368ee7ff9884c)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:12.360180 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d676626-5fb7-453b-adbb-7e9e5577d2b0 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:12.362036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 535/1058] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:40:12 2022] GET /identity/v3/projects/53c94b2d783f4d76b65368ee7ff9884c => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:12.368502 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60fede-c816-4172-8490-2303dfbbb2a0 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:12.470088 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60fede-c816-4172-8490-2303dfbbb2a0 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:12.507939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030166f-df3a-4a49-9b73-0da5ef501fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:12.509012 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030166f-df3a-4a49-9b73-0da5ef501fb4 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:12.509593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030166f-df3a-4a49-9b73-0da5ef501fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:12.510067 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030166f-df3a-4a49-9b73-0da5ef501fb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:12.511096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030166f-df3a-4a49-9b73-0da5ef501fb4 None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=53c94b2d783f4d76b65368ee7ff9884c, user.id=8aa190107db8438c99502506fa320213) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:12.511633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030166f-df3a-4a49-9b73-0da5ef501fb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:12.513291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030166f-df3a-4a49-9b73-0da5ef501fb4 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:12.519625 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 524/1059] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:40:12 2022] GET /identity/v3/role_assignments?user.id=8aa190107db8438c99502506fa320213&scope.project.id=53c94b2d783f4d76b65368ee7ff9884c&role.id=85136c55809b4d9db97c263a72392ad1 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:14.050720 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65783e1-a7b3-4fbf-bed2-e5411c625189 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:14.051296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65783e1-a7b3-4fbf-bed2-e5411c625189 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:14.051296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65783e1-a7b3-4fbf-bed2-e5411c625189 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:14.053238 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 536/1060] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:14.058399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d1808-e23f-4107-ac9a-0c6287b30298 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:14.058826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d1808-e23f-4107-ac9a-0c6287b30298 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:14.058936 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d1808-e23f-4107-ac9a-0c6287b30298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:14.077574 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-940d1808-e23f-4107-ac9a-0c6287b30298 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:14.078811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-940d1808-e23f-4107-ac9a-0c6287b30298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:14.149308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 525/1061] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:14.172812 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65783e1-a7b3-4fbf-bed2-e5411c625189 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:14.275442 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65783e1-a7b3-4fbf-bed2-e5411c625189 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:14.310439 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fc53e-e7d0-4899-8bc1-5a6176b2c92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:14.311227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fc53e-e7d0-4899-8bc1-5a6176b2c92a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:14.311504 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fc53e-e7d0-4899-8bc1-5a6176b2c92a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:14.311799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fc53e-e7d0-4899-8bc1-5a6176b2c92a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:14.322230 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fc53e-e7d0-4899-8bc1-5a6176b2c92a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:40:14.329561 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-b89fc53e-e7d0-4899-8bc1-5a6176b2c92a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 12:40:14.330971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 537/1062] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Nov 2 12:40:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:14.337233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d1808-e23f-4107-ac9a-0c6287b30298 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:14.440579 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d1808-e23f-4107-ac9a-0c6287b30298 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:14.444445 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e46a02-0cda-4623-b14b-8d6510fdda3e None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:14.444739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e46a02-0cda-4623-b14b-8d6510fdda3e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:14.445024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e46a02-0cda-4623-b14b-8d6510fdda3e None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:14.446930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 538/1063] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:14.453061 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec870e-1724-45e4-a1ab-dd9cbcd32c38 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:14.453416 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec870e-1724-45e4-a1ab-dd9cbcd32c38 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:14.453626 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec870e-1724-45e4-a1ab-dd9cbcd32c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:14.477362 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-14ec870e-1724-45e4-a1ab-dd9cbcd32c38 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:14.478628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-14ec870e-1724-45e4-a1ab-dd9cbcd32c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:14.555644 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 539/1064] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:40:14.579413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec870e-1724-45e4-a1ab-dd9cbcd32c38 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:14.607559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aa4d1-5e15-4f90-bcdb-501408dda388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:14.608449 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aa4d1-5e15-4f90-bcdb-501408dda388 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:14.608626 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aa4d1-5e15-4f90-bcdb-501408dda388 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:14.608977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aa4d1-5e15-4f90-bcdb-501408dda388 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:14.609740 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649aa4d1-5e15-4f90-bcdb-501408dda388 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:14.610077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649aa4d1-5e15-4f90-bcdb-501408dda388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:14.611527 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649aa4d1-5e15-4f90-bcdb-501408dda388 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:14.625361 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 526/1065] 10.222.0.90 () {56 vars in 1115 bytes} [Wed Nov 2 12:40:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:14.626203 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aa4d1-5e15-4f90-bcdb-501408dda388 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:14.680529 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec870e-1724-45e4-a1ab-dd9cbcd32c38 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:14.717157 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da03e6-9e7f-4a6c-8d60-e34b2877790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:14.717850 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da03e6-9e7f-4a6c-8d60-e34b2877790d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:14.718097 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da03e6-9e7f-4a6c-8d60-e34b2877790d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:14.718372 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da03e6-9e7f-4a6c-8d60-e34b2877790d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:14.732539 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aa4d1-5e15-4f90-bcdb-501408dda388 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:14.769925 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127c6e0-8c6f-4cec-aba7-b4f5dcbe4ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:14.770759 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127c6e0-8c6f-4cec-aba7-b4f5dcbe4ed9 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:14.771034 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127c6e0-8c6f-4cec-aba7-b4f5dcbe4ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:14.771303 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127c6e0-8c6f-4cec-aba7-b4f5dcbe4ed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:14.783782 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127c6e0-8c6f-4cec-aba7-b4f5dcbe4ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:14.785312 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127c6e0-8c6f-4cec-aba7-b4f5dcbe4ed9 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:14.786395 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da03e6-9e7f-4a6c-8d60-e34b2877790d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:14.787958 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da03e6-9e7f-4a6c-8d60-e34b2877790d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:14.802881 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-f127c6e0-8c6f-4cec-aba7-b4f5dcbe4ed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:40:14.804250 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 527/1066] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:14.809743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127c6e0-8c6f-4cec-aba7-b4f5dcbe4ed9 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:14.883941 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 540/1067] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:40:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 12:40:14.885141 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf19584-cd44-42ee-be59-f7f55bd59241 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:14.885435 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf19584-cd44-42ee-be59-f7f55bd59241 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:14.885737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf19584-cd44-42ee-be59-f7f55bd59241 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:14.888250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 541/1068] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:14.890139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf19584-cd44-42ee-be59-f7f55bd59241 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:14.907661 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127c6e0-8c6f-4cec-aba7-b4f5dcbe4ed9 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:14.940057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3667b-9f7e-44ab-8ae8-7aacb0fcfce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:14.940823 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3667b-9f7e-44ab-8ae8-7aacb0fcfce4 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:14.941104 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3667b-9f7e-44ab-8ae8-7aacb0fcfce4 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:14.941374 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3667b-9f7e-44ab-8ae8-7aacb0fcfce4 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:14.942113 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3667b-9f7e-44ab-8ae8-7aacb0fcfce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:14.942412 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3667b-9f7e-44ab-8ae8-7aacb0fcfce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:14.943876 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3667b-9f7e-44ab-8ae8-7aacb0fcfce4 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:14.954604 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 528/1069] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:14.955782 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0791e4-e28d-442d-b3c0-c2f964b75c9b None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:14.956067 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0791e4-e28d-442d-b3c0-c2f964b75c9b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:14.956361 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0791e4-e28d-442d-b3c0-c2f964b75c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:14.971964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-ba0791e4-e28d-442d-b3c0-c2f964b75c9b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:14.973160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ba0791e4-e28d-442d-b3c0-c2f964b75c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:14.989052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf19584-cd44-42ee-be59-f7f55bd59241 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:15.021394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdad6b-047c-41bc-b522-0c98e73c6eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:15.022216 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdad6b-047c-41bc-b522-0c98e73c6eca None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.022516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdad6b-047c-41bc-b522-0c98e73c6eca None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.022787 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdad6b-047c-41bc-b522-0c98e73c6eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.035605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdad6b-047c-41bc-b522-0c98e73c6eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:15.037104 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdad6b-047c-41bc-b522-0c98e73c6eca None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:15.038557 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 529/1070] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:15.039383 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0791e4-e28d-442d-b3c0-c2f964b75c9b None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:15.055433 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-1ffdad6b-047c-41bc-b522-0c98e73c6eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:40:15.062326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 542/1071] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:40:15.063021 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdad6b-047c-41bc-b522-0c98e73c6eca None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:15.148790 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0791e4-e28d-442d-b3c0-c2f964b75c9b None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:15.160172 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdad6b-047c-41bc-b522-0c98e73c6eca None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:15.182642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069c5de-d7fd-4f8b-8b96-26e90a74a201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:15.183538 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069c5de-d7fd-4f8b-8b96-26e90a74a201 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.183867 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069c5de-d7fd-4f8b-8b96-26e90a74a201 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.184133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069c5de-d7fd-4f8b-8b96-26e90a74a201 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.191392 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069c5de-d7fd-4f8b-8b96-26e90a74a201 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:15.192873 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069c5de-d7fd-4f8b-8b96-26e90a74a201 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:15.193399 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77748f7-52cc-4df1-9839-0fc31bde67e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:15.194155 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77748f7-52cc-4df1-9839-0fc31bde67e4 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.194454 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77748f7-52cc-4df1-9839-0fc31bde67e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.194728 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77748f7-52cc-4df1-9839-0fc31bde67e4 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.195456 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77748f7-52cc-4df1-9839-0fc31bde67e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:15.195762 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77748f7-52cc-4df1-9839-0fc31bde67e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:15.197222 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77748f7-52cc-4df1-9839-0fc31bde67e4 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:15.206447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-1069c5de-d7fd-4f8b-8b96-26e90a74a201 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:40:15.207641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 530/1072] 10.222.0.90 () {56 vars in 1093 bytes} [Wed Nov 2 12:40:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:15.208592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 543/1073] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:15.208814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069c5de-d7fd-4f8b-8b96-26e90a74a201 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:15.213700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77748f7-52cc-4df1-9839-0fc31bde67e4 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:15.317055 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069c5de-d7fd-4f8b-8b96-26e90a74a201 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:15.326809 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77748f7-52cc-4df1-9839-0fc31bde67e4 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:15.353939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7fdb6-8d43-4f85-8f1f-868fcb886a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:15.355051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7fdb6-8d43-4f85-8f1f-868fcb886a5c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.355331 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7fdb6-8d43-4f85-8f1f-868fcb886a5c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.355672 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7fdb6-8d43-4f85-8f1f-868fcb886a5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.362472 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bfe18-6872-4d4f-8e22-75da66dea306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:15.363350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bfe18-6872-4d4f-8e22-75da66dea306 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.363628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bfe18-6872-4d4f-8e22-75da66dea306 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.363913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bfe18-6872-4d4f-8e22-75da66dea306 None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.364788 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bfe18-6872-4d4f-8e22-75da66dea306 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:15.365093 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bfe18-6872-4d4f-8e22-75da66dea306 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:15.366546 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bfe18-6872-4d4f-8e22-75da66dea306 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:15.366935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7fdb6-8d43-4f85-8f1f-868fcb886a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:40:15.374108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-1bb7fdb6-8d43-4f85-8f1f-868fcb886a5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:40:15.375425 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 531/1074] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:40:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:15.381925 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7fdb6-8d43-4f85-8f1f-868fcb886a5c None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:15.391132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 544/1075] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Nov 2 12:40:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:15.393026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bfe18-6872-4d4f-8e22-75da66dea306 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:15.498451 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7fdb6-8d43-4f85-8f1f-868fcb886a5c None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:15.511932 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bfe18-6872-4d4f-8e22-75da66dea306 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:15.533013 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7598b-82ff-46fe-810a-f472fb1d4d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:15.533682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7598b-82ff-46fe-810a-f472fb1d4d26 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.533958 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7598b-82ff-46fe-810a-f472fb1d4d26 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.534229 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7598b-82ff-46fe-810a-f472fb1d4d26 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.534981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7598b-82ff-46fe-810a-f472fb1d4d26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:15.535296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7598b-82ff-46fe-810a-f472fb1d4d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:15.536723 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7598b-82ff-46fe-810a-f472fb1d4d26 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:15.544728 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 532/1076] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:40:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:15.545178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85efced-ba5a-49b6-bf15-460c92f3c790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:15.546070 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85efced-ba5a-49b6-bf15-460c92f3c790 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.546353 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85efced-ba5a-49b6-bf15-460c92f3c790 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.546622 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85efced-ba5a-49b6-bf15-460c92f3c790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.550623 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7598b-82ff-46fe-810a-f472fb1d4d26 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:15.556747 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85efced-ba5a-49b6-bf15-460c92f3c790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:15.558193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85efced-ba5a-49b6-bf15-460c92f3c790 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:15.574686 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-e85efced-ba5a-49b6-bf15-460c92f3c790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:40:15.575879 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 545/1077] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:15.581548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85efced-ba5a-49b6-bf15-460c92f3c790 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:15.644490 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7598b-82ff-46fe-810a-f472fb1d4d26 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:15.676645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473ae67-0a46-4aaf-8e90-8af599be5744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:15.677512 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473ae67-0a46-4aaf-8e90-8af599be5744 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.677784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473ae67-0a46-4aaf-8e90-8af599be5744 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.678036 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473ae67-0a46-4aaf-8e90-8af599be5744 None admin] PATH_INFO: `/v3/users/8aa190107db8438c99502506fa320213` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.678153 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85efced-ba5a-49b6-bf15-460c92f3c790 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:15.679216 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473ae67-0a46-4aaf-8e90-8af599be5744 None admin] RBAC: Authorizing `identity:get_user(user_id=8aa190107db8438c99502506fa320213)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:15.680683 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473ae67-0a46-4aaf-8e90-8af599be5744 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:15.682271 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 533/1078] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:40:15 2022] GET /identity/v3/users/8aa190107db8438c99502506fa320213 => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:15.689063 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473ae67-0a46-4aaf-8e90-8af599be5744 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:15.712108 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22241945-3225-48a4-9431-34d6f658b065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:15.712830 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22241945-3225-48a4-9431-34d6f658b065 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.713107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22241945-3225-48a4-9431-34d6f658b065 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.713376 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22241945-3225-48a4-9431-34d6f658b065 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.714106 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22241945-3225-48a4-9431-34d6f658b065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:15.714412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22241945-3225-48a4-9431-34d6f658b065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:15.715855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22241945-3225-48a4-9431-34d6f658b065 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:15.726878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 546/1079] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:15.732964 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22241945-3225-48a4-9431-34d6f658b065 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:15.788463 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473ae67-0a46-4aaf-8e90-8af599be5744 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:15.819965 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f21b-962b-4248-824f-ef13945dc259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:15.820861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f21b-962b-4248-824f-ef13945dc259 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.821129 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f21b-962b-4248-824f-ef13945dc259 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.821395 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f21b-962b-4248-824f-ef13945dc259 None admin] PATH_INFO: `/v3/projects/53c94b2d783f4d76b65368ee7ff9884c` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.822570 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65f21b-962b-4248-824f-ef13945dc259 None admin] RBAC: Authorizing `identity:get_project(project_id=53c94b2d783f4d76b65368ee7ff9884c)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:15.823988 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65f21b-962b-4248-824f-ef13945dc259 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:15.825768 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 534/1080] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:40:15 2022] GET /identity/v3/projects/53c94b2d783f4d76b65368ee7ff9884c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:15.831870 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f21b-962b-4248-824f-ef13945dc259 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:15.835122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22241945-3225-48a4-9431-34d6f658b065 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:15.867392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d4d85-5bf4-4425-b48b-30afe9642d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:15.868178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d4d85-5bf4-4425-b48b-30afe9642d9b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.868478 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d4d85-5bf4-4425-b48b-30afe9642d9b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.868793 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d4d85-5bf4-4425-b48b-30afe9642d9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.875227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d4d85-5bf4-4425-b48b-30afe9642d9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:15.876779 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d4d85-5bf4-4425-b48b-30afe9642d9b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:15.889899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-f32d4d85-5bf4-4425-b48b-30afe9642d9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:40:15.891060 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 547/1081] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:40:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:40:15.897116 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d4d85-5bf4-4425-b48b-30afe9642d9b None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:15.927192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f21b-962b-4248-824f-ef13945dc259 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:15.958848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595b415-2ec6-4ba9-9dc4-e434a0a11897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:15.959749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595b415-2ec6-4ba9-9dc4-e434a0a11897 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.960023 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595b415-2ec6-4ba9-9dc4-e434a0a11897 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.960317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595b415-2ec6-4ba9-9dc4-e434a0a11897 None admin] PATH_INFO: `/v3/projects/53c94b2d783f4d76b65368ee7ff9884c/users/8aa190107db8438c99502506fa320213/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.962263 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595b415-2ec6-4ba9-9dc4-e434a0a11897 None admin] RBAC: Authorizing `identity:create_grant(project_id=53c94b2d783f4d76b65368ee7ff9884c, user_id=8aa190107db8438c99502506fa320213, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:15.963757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595b415-2ec6-4ba9-9dc4-e434a0a11897 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:15.977324 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 535/1082] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:40:15 2022] PUT /identity/v3/projects/53c94b2d783f4d76b65368ee7ff9884c/users/8aa190107db8438c99502506fa320213/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:40:15.991809 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d4d85-5bf4-4425-b48b-30afe9642d9b None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:16.028534 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83079d-8957-4713-93d6-5568d2bd98cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:16.029206 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83079d-8957-4713-93d6-5568d2bd98cc None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:16.029482 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83079d-8957-4713-93d6-5568d2bd98cc None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:16.029753 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83079d-8957-4713-93d6-5568d2bd98cc None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:16.030566 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83079d-8957-4713-93d6-5568d2bd98cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:16.030868 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83079d-8957-4713-93d6-5568d2bd98cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:16.032333 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83079d-8957-4713-93d6-5568d2bd98cc None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:16.044968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 548/1083] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:40:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:16.051530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595b415-2ec6-4ba9-9dc4-e434a0a11897 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:16.157540 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595b415-2ec6-4ba9-9dc4-e434a0a11897 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:16.193048 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acf295-51a3-4fd2-b64c-e2622adbbcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:16.193990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acf295-51a3-4fd2-b64c-e2622adbbcd8 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:16.194274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acf295-51a3-4fd2-b64c-e2622adbbcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:16.194535 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acf295-51a3-4fd2-b64c-e2622adbbcd8 None admin] PATH_INFO: `/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/fbcda58f298444eebf4f08ce01deffc0/roles/32037682fb594c0a9fe6a908cde45c99` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:16.196738 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acf295-51a3-4fd2-b64c-e2622adbbcd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a08ee6d287714297a10248ad8e4522bc, user_id=fbcda58f298444eebf4f08ce01deffc0, role_id=32037682fb594c0a9fe6a908cde45c99)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:16.198220 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acf295-51a3-4fd2-b64c-e2622adbbcd8 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:16.211906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 536/1084] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:40:16 2022] PUT /identity/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/fbcda58f298444eebf4f08ce01deffc0/roles/32037682fb594c0a9fe6a908cde45c99 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:18.281678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9dd18-0942-477c-979f-e40357be7141 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:18.282227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9dd18-0942-477c-979f-e40357be7141 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:18.282227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9dd18-0942-477c-979f-e40357be7141 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:18.283955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 549/1085] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:18.289540 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828355bf-59de-446f-b08c-828af156121c None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:18.289943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828355bf-59de-446f-b08c-828af156121c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:18.290113 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828355bf-59de-446f-b08c-828af156121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:18.308439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-828355bf-59de-446f-b08c-828af156121c None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:18.309615 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-828355bf-59de-446f-b08c-828af156121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:18.377966 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 537/1086] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:18.402047 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9dd18-0942-477c-979f-e40357be7141 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:18.512363 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9dd18-0942-477c-979f-e40357be7141 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:18.515821 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee44706-b60a-4834-8243-e74eb1b35ead None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:18.516107 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee44706-b60a-4834-8243-e74eb1b35ead None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:18.516412 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee44706-b60a-4834-8243-e74eb1b35ead None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:18.518179 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 538/1087] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:18.523211 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55e428-5fd8-4800-b65f-00b6cd79d025 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:18.523492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55e428-5fd8-4800-b65f-00b6cd79d025 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:18.523777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55e428-5fd8-4800-b65f-00b6cd79d025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:18.540552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-0d55e428-5fd8-4800-b65f-00b6cd79d025 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:18.541735 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0d55e428-5fd8-4800-b65f-00b6cd79d025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:18.547759 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c538f4-37d5-40f1-9389-5a0326d41ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:18.548738 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c538f4-37d5-40f1-9389-5a0326d41ff0 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:18.549018 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c538f4-37d5-40f1-9389-5a0326d41ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:18.549292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c538f4-37d5-40f1-9389-5a0326d41ff0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:18.560462 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c538f4-37d5-40f1-9389-5a0326d41ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:40:18.567318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-f1c538f4-37d5-40f1-9389-5a0326d41ff0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:40:18.568583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 550/1088] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:40:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:18.574806 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c538f4-37d5-40f1-9389-5a0326d41ff0 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:18.607448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 539/1089] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:40:18.631143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55e428-5fd8-4800-b65f-00b6cd79d025 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:18.673307 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c538f4-37d5-40f1-9389-5a0326d41ff0 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:18.706539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101d90a-8127-49e6-ba7d-30f7dea8aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:18.707183 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101d90a-8127-49e6-ba7d-30f7dea8aa6a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:18.707456 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101d90a-8127-49e6-ba7d-30f7dea8aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:18.707722 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101d90a-8127-49e6-ba7d-30f7dea8aa6a None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:18.708569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101d90a-8127-49e6-ba7d-30f7dea8aa6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:18.708867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101d90a-8127-49e6-ba7d-30f7dea8aa6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:18.710252 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101d90a-8127-49e6-ba7d-30f7dea8aa6a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:18.718136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 551/1090] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:40:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:18.724245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101d90a-8127-49e6-ba7d-30f7dea8aa6a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:18.730992 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55e428-5fd8-4800-b65f-00b6cd79d025 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:18.764472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cf798-ac5a-4e1e-b4fb-465076fd9e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:18.765272 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cf798-ac5a-4e1e-b4fb-465076fd9e5a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:18.765544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cf798-ac5a-4e1e-b4fb-465076fd9e5a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:18.765807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cf798-ac5a-4e1e-b4fb-465076fd9e5a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:18.775529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7cf798-ac5a-4e1e-b4fb-465076fd9e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:40:18.783156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-bd7cf798-ac5a-4e1e-b4fb-465076fd9e5a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 12:40:18.784346 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 540/1091] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Nov 2 12:40:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:40:18.790277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cf798-ac5a-4e1e-b4fb-465076fd9e5a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:18.820591 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101d90a-8127-49e6-ba7d-30f7dea8aa6a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:18.852127 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060bc5e-8644-4b53-a30f-5a335beb0982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:18.853034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060bc5e-8644-4b53-a30f-5a335beb0982 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:18.854416 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060bc5e-8644-4b53-a30f-5a335beb0982 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:18.854416 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060bc5e-8644-4b53-a30f-5a335beb0982 None admin] PATH_INFO: `/v3/users/8aa190107db8438c99502506fa320213` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:18.857787 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060bc5e-8644-4b53-a30f-5a335beb0982 None admin] RBAC: Authorizing `identity:get_user(user_id=8aa190107db8438c99502506fa320213)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:18.857787 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060bc5e-8644-4b53-a30f-5a335beb0982 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:18.857787 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 552/1092] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:40:18 2022] GET /identity/v3/users/8aa190107db8438c99502506fa320213 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:18.864567 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060bc5e-8644-4b53-a30f-5a335beb0982 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:18.890914 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cf798-ac5a-4e1e-b4fb-465076fd9e5a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:18.924488 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8206c82-601b-4b86-a8d3-eee942546e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:18.925253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8206c82-601b-4b86-a8d3-eee942546e01 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:18.925538 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8206c82-601b-4b86-a8d3-eee942546e01 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:18.925805 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8206c82-601b-4b86-a8d3-eee942546e01 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:18.926559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8206c82-601b-4b86-a8d3-eee942546e01 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:18.926858 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8206c82-601b-4b86-a8d3-eee942546e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:18.928277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8206c82-601b-4b86-a8d3-eee942546e01 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:18.936409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 541/1093] 10.222.0.90 () {56 vars in 1115 bytes} [Wed Nov 2 12:40:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:18.942646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8206c82-601b-4b86-a8d3-eee942546e01 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:18.967111 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060bc5e-8644-4b53-a30f-5a335beb0982 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:19.001472 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb7078-995e-4813-a2cd-0033c6463e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:19.002127 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb7078-995e-4813-a2cd-0033c6463e6b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:19.002404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb7078-995e-4813-a2cd-0033c6463e6b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:19.002675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb7078-995e-4813-a2cd-0033c6463e6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:19.039562 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8206c82-601b-4b86-a8d3-eee942546e01 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:19.067169 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb7078-995e-4813-a2cd-0033c6463e6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:19.068822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb7078-995e-4813-a2cd-0033c6463e6b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:19.072675 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770db546-0a33-4d75-8d60-9d960c50749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:19.073404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770db546-0a33-4d75-8d60-9d960c50749c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:19.073675 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770db546-0a33-4d75-8d60-9d960c50749c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:19.073938 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770db546-0a33-4d75-8d60-9d960c50749c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:19.084537 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770db546-0a33-4d75-8d60-9d960c50749c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:19.085977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770db546-0a33-4d75-8d60-9d960c50749c None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:19.102360 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-770db546-0a33-4d75-8d60-9d960c50749c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:40:19.103564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 542/1094] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:40:19.109448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770db546-0a33-4d75-8d60-9d960c50749c None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:19.163799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 553/1095] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:40:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:40:19.169801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb7078-995e-4813-a2cd-0033c6463e6b None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:19.205584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770db546-0a33-4d75-8d60-9d960c50749c None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:19.238046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a692d9-1c39-4468-a87f-3d1d7766efc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:19.238759 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a692d9-1c39-4468-a87f-3d1d7766efc1 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:19.239033 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a692d9-1c39-4468-a87f-3d1d7766efc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:19.239303 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a692d9-1c39-4468-a87f-3d1d7766efc1 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:19.240066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a692d9-1c39-4468-a87f-3d1d7766efc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:19.240399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a692d9-1c39-4468-a87f-3d1d7766efc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:19.241835 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a692d9-1c39-4468-a87f-3d1d7766efc1 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:19.254047 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 543/1096] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:19.260443 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a692d9-1c39-4468-a87f-3d1d7766efc1 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:19.264050 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb7078-995e-4813-a2cd-0033c6463e6b None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:19.296390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173a27f-4683-43ad-a16a-fba0f04f1a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:19.297246 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173a27f-4683-43ad-a16a-fba0f04f1a0e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:19.297523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173a27f-4683-43ad-a16a-fba0f04f1a0e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:19.297790 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173a27f-4683-43ad-a16a-fba0f04f1a0e None admin] PATH_INFO: `/v3/projects/53c94b2d783f4d76b65368ee7ff9884c` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:19.298942 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173a27f-4683-43ad-a16a-fba0f04f1a0e None admin] RBAC: Authorizing `identity:get_project(project_id=53c94b2d783f4d76b65368ee7ff9884c)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:19.300400 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173a27f-4683-43ad-a16a-fba0f04f1a0e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:19.302118 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 554/1097] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:40:19 2022] GET /identity/v3/projects/53c94b2d783f4d76b65368ee7ff9884c => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:19.308267 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173a27f-4683-43ad-a16a-fba0f04f1a0e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:19.357386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a692d9-1c39-4468-a87f-3d1d7766efc1 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:19.390984 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebbe3e-cd2f-4ccc-9404-f418c971e314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:19.391764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebbe3e-cd2f-4ccc-9404-f418c971e314 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:19.392034 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebbe3e-cd2f-4ccc-9404-f418c971e314 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:19.392325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebbe3e-cd2f-4ccc-9404-f418c971e314 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:19.399059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebbe3e-cd2f-4ccc-9404-f418c971e314 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:19.400542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebbe3e-cd2f-4ccc-9404-f418c971e314 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:19.404708 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173a27f-4683-43ad-a16a-fba0f04f1a0e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:19.414189 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-ebebbe3e-cd2f-4ccc-9404-f418c971e314 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:40:19.415331 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 544/1098] 10.222.0.90 () {56 vars in 1093 bytes} [Wed Nov 2 12:40:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:19.421311 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebbe3e-cd2f-4ccc-9404-f418c971e314 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:19.440425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb66daf-492a-44cb-b79e-4489b25ec805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:19.441321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb66daf-492a-44cb-b79e-4489b25ec805 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:19.441709 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb66daf-492a-44cb-b79e-4489b25ec805 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:19.442140 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb66daf-492a-44cb-b79e-4489b25ec805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:19.443454 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb66daf-492a-44cb-b79e-4489b25ec805 None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=53c94b2d783f4d76b65368ee7ff9884c, user.id=8aa190107db8438c99502506fa320213) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:19.443914 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb66daf-492a-44cb-b79e-4489b25ec805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:19.446088 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb66daf-492a-44cb-b79e-4489b25ec805 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:19.452748 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 555/1099] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:40:19 2022] GET /identity/v3/role_assignments?user.id=8aa190107db8438c99502506fa320213&scope.project.id=53c94b2d783f4d76b65368ee7ff9884c&role.id=85136c55809b4d9db97c263a72392ad1 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:19.526851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebbe3e-cd2f-4ccc-9404-f418c971e314 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:19.563778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be14255-bd94-4cf0-b2fd-872561a96c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:19.564492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be14255-bd94-4cf0-b2fd-872561a96c74 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:19.564768 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be14255-bd94-4cf0-b2fd-872561a96c74 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:19.565038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be14255-bd94-4cf0-b2fd-872561a96c74 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:19.565872 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be14255-bd94-4cf0-b2fd-872561a96c74 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:19.566173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be14255-bd94-4cf0-b2fd-872561a96c74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:19.567604 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be14255-bd94-4cf0-b2fd-872561a96c74 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:19.586548 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 545/1100] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Nov 2 12:40:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:19.592794 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb66daf-492a-44cb-b79e-4489b25ec805 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:19.695157 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb66daf-492a-44cb-b79e-4489b25ec805 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:19.729568 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817e8d2-5dd6-49e0-8f41-9ba6ed3a1c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:19.730223 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817e8d2-5dd6-49e0-8f41-9ba6ed3a1c88 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:19.730502 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817e8d2-5dd6-49e0-8f41-9ba6ed3a1c88 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:19.730772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817e8d2-5dd6-49e0-8f41-9ba6ed3a1c88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:19.797240 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817e8d2-5dd6-49e0-8f41-9ba6ed3a1c88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:19.798672 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817e8d2-5dd6-49e0-8f41-9ba6ed3a1c88 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:19.894020 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 556/1101] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:40:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:40:19.900176 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be14255-bd94-4cf0-b2fd-872561a96c74 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:19.995389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be14255-bd94-4cf0-b2fd-872561a96c74 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:20.030066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6113b67-1b8c-4a57-b681-fd45676acbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:20.030962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6113b67-1b8c-4a57-b681-fd45676acbd4 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:20.031238 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6113b67-1b8c-4a57-b681-fd45676acbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:20.031504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6113b67-1b8c-4a57-b681-fd45676acbd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:20.042175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6113b67-1b8c-4a57-b681-fd45676acbd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:20.043642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6113b67-1b8c-4a57-b681-fd45676acbd4 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:20.059748 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-e6113b67-1b8c-4a57-b681-fd45676acbd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:40:20.061032 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 546/1102] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:20.066981 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817e8d2-5dd6-49e0-8f41-9ba6ed3a1c88 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:20.166652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817e8d2-5dd6-49e0-8f41-9ba6ed3a1c88 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:20.200223 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be705f6-419a-4a57-9603-dd712229e6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:20.200987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be705f6-419a-4a57-9603-dd712229e6f5 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:20.201258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be705f6-419a-4a57-9603-dd712229e6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:20.201524 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be705f6-419a-4a57-9603-dd712229e6f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:20.202229 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be705f6-419a-4a57-9603-dd712229e6f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:20.202525 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be705f6-419a-4a57-9603-dd712229e6f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:20.203886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be705f6-419a-4a57-9603-dd712229e6f5 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:20.215023 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 557/1103] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:20.220826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6113b67-1b8c-4a57-b681-fd45676acbd4 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:20.321651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6113b67-1b8c-4a57-b681-fd45676acbd4 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:20.357452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534862ec-fe3f-4d1a-a4de-77507af0900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:20.358238 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534862ec-fe3f-4d1a-a4de-77507af0900c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:20.358544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534862ec-fe3f-4d1a-a4de-77507af0900c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:20.358777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534862ec-fe3f-4d1a-a4de-77507af0900c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:20.365593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534862ec-fe3f-4d1a-a4de-77507af0900c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:20.367026 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534862ec-fe3f-4d1a-a4de-77507af0900c None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:20.380493 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-534862ec-fe3f-4d1a-a4de-77507af0900c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:40:20.381826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 547/1104] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:40:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:20.387801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be705f6-419a-4a57-9603-dd712229e6f5 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:20.489127 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be705f6-419a-4a57-9603-dd712229e6f5 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:20.528446 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7d815-61ec-4adc-962e-baf543f783e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:20.529256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7d815-61ec-4adc-962e-baf543f783e7 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:20.529530 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7d815-61ec-4adc-962e-baf543f783e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:20.529798 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7d815-61ec-4adc-962e-baf543f783e7 None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:20.530582 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7d815-61ec-4adc-962e-baf543f783e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:20.530886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7d815-61ec-4adc-962e-baf543f783e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:20.532361 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7d815-61ec-4adc-962e-baf543f783e7 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:20.544769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 558/1105] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:40:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:20.551127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534862ec-fe3f-4d1a-a4de-77507af0900c None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:20.653615 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534862ec-fe3f-4d1a-a4de-77507af0900c None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:20.687261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773814c5-6525-43f0-a938-b477a3498e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:20.687896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773814c5-6525-43f0-a938-b477a3498e28 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:20.688166 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773814c5-6525-43f0-a938-b477a3498e28 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:20.688459 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773814c5-6525-43f0-a938-b477a3498e28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:20.689274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773814c5-6525-43f0-a938-b477a3498e28 None admin] RBAC: Adding query filter params (role.id=32037682fb594c0a9fe6a908cde45c99, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=fbcda58f298444eebf4f08ce01deffc0) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:20.689576 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773814c5-6525-43f0-a938-b477a3498e28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:20.690999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773814c5-6525-43f0-a938-b477a3498e28 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:20.696623 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 548/1106] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:40:20 2022] GET /identity/v3/role_assignments?user.id=fbcda58f298444eebf4f08ce01deffc0&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=32037682fb594c0a9fe6a908cde45c99 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:21.818801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf23ed3-7325-4cda-a646-449bca2ee68a None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:21.819640 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf23ed3-7325-4cda-a646-449bca2ee68a None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:21.819640 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf23ed3-7325-4cda-a646-449bca2ee68a None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:21.822474 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 559/1107] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:21.827895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6e5e2-422d-4e0d-a0b2-be2f4d786cb2 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:21.828355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6e5e2-422d-4e0d-a0b2-be2f4d786cb2 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:21.828445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6e5e2-422d-4e0d-a0b2-be2f4d786cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:21.846698 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-0bb6e5e2-422d-4e0d-a0b2-be2f4d786cb2 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:21.847862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0bb6e5e2-422d-4e0d-a0b2-be2f4d786cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:21.923989 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 549/1108] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:21.951746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf23ed3-7325-4cda-a646-449bca2ee68a None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:22.062248 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf23ed3-7325-4cda-a646-449bca2ee68a None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:22.104942 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ba54b-9882-440a-bb36-2e11f0049e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:22.106111 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ba54b-9882-440a-bb36-2e11f0049e85 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:22.106589 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ba54b-9882-440a-bb36-2e11f0049e85 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:22.107043 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ba54b-9882-440a-bb36-2e11f0049e85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:22.109128 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ba54b-9882-440a-bb36-2e11f0049e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:22.111456 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ba54b-9882-440a-bb36-2e11f0049e85 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:22.114139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 560/1109] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:22.123216 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6e5e2-422d-4e0d-a0b2-be2f4d786cb2 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:22.220965 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6e5e2-422d-4e0d-a0b2-be2f4d786cb2 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:22.253439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5ae3f-8417-40d5-9470-31b8a0a6bdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:22.254101 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5ae3f-8417-40d5-9470-31b8a0a6bdf1 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:22.254404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5ae3f-8417-40d5-9470-31b8a0a6bdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:22.254644 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5ae3f-8417-40d5-9470-31b8a0a6bdf1 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:22.255350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5ae3f-8417-40d5-9470-31b8a0a6bdf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:22.256838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5ae3f-8417-40d5-9470-31b8a0a6bdf1 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:22.284399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 550/1110] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:40:22 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:24.663037 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32fec3-3e54-4483-b02e-166bfc23cf7f None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:24.663867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32fec3-3e54-4483-b02e-166bfc23cf7f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:24.663867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32fec3-3e54-4483-b02e-166bfc23cf7f None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:24.666816 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 561/1111] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:24.672238 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de641d09-4ef6-42ca-aca0-e90960d8a516 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:24.672669 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de641d09-4ef6-42ca-aca0-e90960d8a516 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:24.672799 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de641d09-4ef6-42ca-aca0-e90960d8a516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:24.691489 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-de641d09-4ef6-42ca-aca0-e90960d8a516 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:24.692704 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-de641d09-4ef6-42ca-aca0-e90960d8a516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:24.766163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 551/1112] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:24.790842 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32fec3-3e54-4483-b02e-166bfc23cf7f None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:24.889454 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32fec3-3e54-4483-b02e-166bfc23cf7f None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:24.927968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a08d0-1333-4687-bdae-4178ba69521e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:24.928833 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a08d0-1333-4687-bdae-4178ba69521e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:24.929108 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a08d0-1333-4687-bdae-4178ba69521e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:24.929376 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a08d0-1333-4687-bdae-4178ba69521e None admin] PATH_INFO: `/v3/roles/7b4e238c731941f18493cd62e30b1e4f` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:24.930963 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a08d0-1333-4687-bdae-4178ba69521e None admin] RBAC: Authorizing `identity:get_role(role_id=7b4e238c731941f18493cd62e30b1e4f)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:24.932381 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a08d0-1333-4687-bdae-4178ba69521e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:24.933754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 562/1113] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:40:24 2022] GET /identity/v3/roles/7b4e238c731941f18493cd62e30b1e4f => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:24.943251 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de641d09-4ef6-42ca-aca0-e90960d8a516 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:25.049072 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de641d09-4ef6-42ca-aca0-e90960d8a516 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:25.083027 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e7018-164e-4d25-9cc9-f0fe0dc49b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:25.083874 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e7018-164e-4d25-9cc9-f0fe0dc49b08 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:25.084147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e7018-164e-4d25-9cc9-f0fe0dc49b08 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:25.084439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e7018-164e-4d25-9cc9-f0fe0dc49b08 None admin] PATH_INFO: `/v3/users/3c50eb02731241bab26cc7f5ce96dd84` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:25.097585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e7018-164e-4d25-9cc9-f0fe0dc49b08 None admin] RBAC: Authorizing `identity:get_user(user_id=3c50eb02731241bab26cc7f5ce96dd84)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:25.099014 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e7018-164e-4d25-9cc9-f0fe0dc49b08 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:25.100660 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 552/1114] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:40:24 2022] GET /identity/v3/users/3c50eb02731241bab26cc7f5ce96dd84 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:25.107112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a08d0-1333-4687-bdae-4178ba69521e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:25.229461 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a08d0-1333-4687-bdae-4178ba69521e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:25.264672 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf84c17-b153-41a1-af3e-f21f4ddd630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:25.265320 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf84c17-b153-41a1-af3e-f21f4ddd630b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:25.265610 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf84c17-b153-41a1-af3e-f21f4ddd630b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:25.265881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf84c17-b153-41a1-af3e-f21f4ddd630b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:25.328870 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf84c17-b153-41a1-af3e-f21f4ddd630b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:25.330260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf84c17-b153-41a1-af3e-f21f4ddd630b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:25.428804 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 563/1115] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:40:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:40:25.435915 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e7018-164e-4d25-9cc9-f0fe0dc49b08 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:25.543901 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e7018-164e-4d25-9cc9-f0fe0dc49b08 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:25.582641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abda67-8717-4f80-8f2e-9166e2d42616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:25.583434 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abda67-8717-4f80-8f2e-9166e2d42616 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:25.583713 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abda67-8717-4f80-8f2e-9166e2d42616 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:25.583983 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abda67-8717-4f80-8f2e-9166e2d42616 None admin] PATH_INFO: `/v3/projects/53c94b2d783f4d76b65368ee7ff9884c` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:25.585277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abda67-8717-4f80-8f2e-9166e2d42616 None admin] RBAC: Authorizing `identity:get_project(project_id=53c94b2d783f4d76b65368ee7ff9884c)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:25.586708 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abda67-8717-4f80-8f2e-9166e2d42616 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:25.588602 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 553/1116] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:40:25 2022] GET /identity/v3/projects/53c94b2d783f4d76b65368ee7ff9884c => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:25.598791 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf84c17-b153-41a1-af3e-f21f4ddd630b None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:25.717644 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf84c17-b153-41a1-af3e-f21f4ddd630b None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:25.764916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6e66a-8f89-4863-ac23-f98be33cf58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:25.765902 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6e66a-8f89-4863-ac23-f98be33cf58a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:25.766362 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6e66a-8f89-4863-ac23-f98be33cf58a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:25.766789 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6e66a-8f89-4863-ac23-f98be33cf58a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:25.768151 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6e66a-8f89-4863-ac23-f98be33cf58a None admin] RBAC: Adding query filter params (role.id=7b4e238c731941f18493cd62e30b1e4f, scope.project.id=53c94b2d783f4d76b65368ee7ff9884c, user.id=3c50eb02731241bab26cc7f5ce96dd84) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:25.768636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6e66a-8f89-4863-ac23-f98be33cf58a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:25.770972 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6e66a-8f89-4863-ac23-f98be33cf58a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:25.779108 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 564/1117] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:40:25 2022] GET /identity/v3/role_assignments?user.id=3c50eb02731241bab26cc7f5ce96dd84&scope.project.id=53c94b2d783f4d76b65368ee7ff9884c&role.id=7b4e238c731941f18493cd62e30b1e4f => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:28.052890 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7930a1f-753f-418e-b83c-8eada8383741 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:28.053469 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7930a1f-753f-418e-b83c-8eada8383741 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:28.053469 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7930a1f-753f-418e-b83c-8eada8383741 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:28.055189 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 554/1118] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:28.062275 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a0a0a-edbe-49d7-99c5-2da23ce2cbe3 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:28.062945 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a0a0a-edbe-49d7-99c5-2da23ce2cbe3 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:28.063060 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a0a0a-edbe-49d7-99c5-2da23ce2cbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:28.089703 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-ec6a0a0a-edbe-49d7-99c5-2da23ce2cbe3 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:28.090899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ec6a0a0a-edbe-49d7-99c5-2da23ce2cbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:28.160550 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 565/1119] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:28.184416 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7930a1f-753f-418e-b83c-8eada8383741 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:28.296899 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7930a1f-753f-418e-b83c-8eada8383741 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:28.342029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac8359-a4e6-4782-b737-e46effe1d222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:28.342819 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac8359-a4e6-4782-b737-e46effe1d222 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:28.343095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac8359-a4e6-4782-b737-e46effe1d222 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:28.343361 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac8359-a4e6-4782-b737-e46effe1d222 None admin] PATH_INFO: `/v3/roles/7b4e238c731941f18493cd62e30b1e4f` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:28.344906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac8359-a4e6-4782-b737-e46effe1d222 None admin] RBAC: Authorizing `identity:get_role(role_id=7b4e238c731941f18493cd62e30b1e4f)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:28.346286 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac8359-a4e6-4782-b737-e46effe1d222 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:28.347608 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 555/1120] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:40:28 2022] GET /identity/v3/roles/7b4e238c731941f18493cd62e30b1e4f => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:28.354349 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a0a0a-edbe-49d7-99c5-2da23ce2cbe3 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:28.470215 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a0a0a-edbe-49d7-99c5-2da23ce2cbe3 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:28.504344 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e63ff0-29a9-41c3-9cdd-946f34a29f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:28.505234 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e63ff0-29a9-41c3-9cdd-946f34a29f8c None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:28.505513 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e63ff0-29a9-41c3-9cdd-946f34a29f8c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:28.505788 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e63ff0-29a9-41c3-9cdd-946f34a29f8c None admin] PATH_INFO: `/v3/users/3c50eb02731241bab26cc7f5ce96dd84` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:28.507074 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e63ff0-29a9-41c3-9cdd-946f34a29f8c None admin] RBAC: Authorizing `identity:get_user(user_id=3c50eb02731241bab26cc7f5ce96dd84)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:28.508570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e63ff0-29a9-41c3-9cdd-946f34a29f8c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:28.510322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 566/1121] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:40:28 2022] GET /identity/v3/users/3c50eb02731241bab26cc7f5ce96dd84 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:28.516264 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac8359-a4e6-4782-b737-e46effe1d222 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:28.629633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac8359-a4e6-4782-b737-e46effe1d222 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:28.662445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d84c3-ed51-4784-9a83-8b79c67f21a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:28.663288 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d84c3-ed51-4784-9a83-8b79c67f21a6 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:28.663569 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d84c3-ed51-4784-9a83-8b79c67f21a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:28.663833 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d84c3-ed51-4784-9a83-8b79c67f21a6 None admin] PATH_INFO: `/v3/projects/53c94b2d783f4d76b65368ee7ff9884c` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:28.665015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d84c3-ed51-4784-9a83-8b79c67f21a6 None admin] RBAC: Authorizing `identity:get_project(project_id=53c94b2d783f4d76b65368ee7ff9884c)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:28.666452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d84c3-ed51-4784-9a83-8b79c67f21a6 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:28.668105 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 556/1122] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:40:28 2022] GET /identity/v3/projects/53c94b2d783f4d76b65368ee7ff9884c => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:28.678485 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e63ff0-29a9-41c3-9cdd-946f34a29f8c None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:28.787619 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e63ff0-29a9-41c3-9cdd-946f34a29f8c None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:28.822730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c56d7-c861-4332-b0ff-f654e94605bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:28.823607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c56d7-c861-4332-b0ff-f654e94605bb None admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:28.823886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c56d7-c861-4332-b0ff-f654e94605bb None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:28.824155 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c56d7-c861-4332-b0ff-f654e94605bb None admin] PATH_INFO: `/v3/projects/53c94b2d783f4d76b65368ee7ff9884c/users/3c50eb02731241bab26cc7f5ce96dd84/roles/7b4e238c731941f18493cd62e30b1e4f` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:28.826545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c56d7-c861-4332-b0ff-f654e94605bb None admin] RBAC: Authorizing `identity:create_grant(project_id=53c94b2d783f4d76b65368ee7ff9884c, user_id=3c50eb02731241bab26cc7f5ce96dd84, role_id=7b4e238c731941f18493cd62e30b1e4f)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:28.827974 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c56d7-c861-4332-b0ff-f654e94605bb None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:28.844367 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 567/1123] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:40:28 2022] PUT /identity/v3/projects/53c94b2d783f4d76b65368ee7ff9884c/users/3c50eb02731241bab26cc7f5ce96dd84/roles/7b4e238c731941f18493cd62e30b1e4f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:31.137757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7558de0-d3b8-4ddf-8c3f-38e38b5786e9 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:31.138637 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7558de0-d3b8-4ddf-8c3f-38e38b5786e9 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:31.138637 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7558de0-d3b8-4ddf-8c3f-38e38b5786e9 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:31.143937 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 557/1124] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:31.153124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0ab8-945c-4f14-9a87-30c692201963 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:31.153794 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0ab8-945c-4f14-9a87-30c692201963 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:31.154037 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0ab8-945c-4f14-9a87-30c692201963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:31.175956 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-d1dd0ab8-945c-4f14-9a87-30c692201963 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:31.177182 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-d1dd0ab8-945c-4f14-9a87-30c692201963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:31.246107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 568/1125] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:31.270569 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7558de0-d3b8-4ddf-8c3f-38e38b5786e9 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:31.378881 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7558de0-d3b8-4ddf-8c3f-38e38b5786e9 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:31.411600 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cccbc-56fc-49cb-a171-2369f7a1db6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:31.412402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cccbc-56fc-49cb-a171-2369f7a1db6c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:31.412677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cccbc-56fc-49cb-a171-2369f7a1db6c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:31.412941 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cccbc-56fc-49cb-a171-2369f7a1db6c None admin] PATH_INFO: `/v3/roles/7b4e238c731941f18493cd62e30b1e4f` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:31.414389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cccbc-56fc-49cb-a171-2369f7a1db6c None admin] RBAC: Authorizing `identity:get_role(role_id=7b4e238c731941f18493cd62e30b1e4f)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:31.415846 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cccbc-56fc-49cb-a171-2369f7a1db6c None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:31.417205 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 558/1126] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:40:31 2022] GET /identity/v3/roles/7b4e238c731941f18493cd62e30b1e4f => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:31.423411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd0ab8-945c-4f14-9a87-30c692201963 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:31.539499 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd0ab8-945c-4f14-9a87-30c692201963 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:31.578042 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b67695-2d64-496b-b27e-bfcb541d5675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:31.578946 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b67695-2d64-496b-b27e-bfcb541d5675 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:31.579222 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b67695-2d64-496b-b27e-bfcb541d5675 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:31.579490 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b67695-2d64-496b-b27e-bfcb541d5675 None admin] PATH_INFO: `/v3/users/3c50eb02731241bab26cc7f5ce96dd84` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:31.580819 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b67695-2d64-496b-b27e-bfcb541d5675 None admin] RBAC: Authorizing `identity:get_user(user_id=3c50eb02731241bab26cc7f5ce96dd84)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:31.582257 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b67695-2d64-496b-b27e-bfcb541d5675 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:31.583917 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 569/1127] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:40:31 2022] GET /identity/v3/users/3c50eb02731241bab26cc7f5ce96dd84 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:31.592742 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cccbc-56fc-49cb-a171-2369f7a1db6c None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:31.710872 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cccbc-56fc-49cb-a171-2369f7a1db6c None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:31.742752 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71063bcf-01a2-4ebb-a81c-6dee832b1246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:31.743389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71063bcf-01a2-4ebb-a81c-6dee832b1246 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:31.743719 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71063bcf-01a2-4ebb-a81c-6dee832b1246 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:31.743995 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71063bcf-01a2-4ebb-a81c-6dee832b1246 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:31.807642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71063bcf-01a2-4ebb-a81c-6dee832b1246 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:31.809222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71063bcf-01a2-4ebb-a81c-6dee832b1246 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:31.910289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 559/1128] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:40:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:40:31.917844 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b67695-2d64-496b-b27e-bfcb541d5675 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:32.033651 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b67695-2d64-496b-b27e-bfcb541d5675 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:32.067850 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e0e8d-d5ed-4571-874d-7ebdedfd6542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:32.068705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e0e8d-d5ed-4571-874d-7ebdedfd6542 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:32.068981 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e0e8d-d5ed-4571-874d-7ebdedfd6542 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:32.069250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e0e8d-d5ed-4571-874d-7ebdedfd6542 None admin] PATH_INFO: `/v3/projects/53c94b2d783f4d76b65368ee7ff9884c` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:32.070431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e0e8d-d5ed-4571-874d-7ebdedfd6542 None admin] RBAC: Authorizing `identity:get_project(project_id=53c94b2d783f4d76b65368ee7ff9884c)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:32.071974 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e0e8d-d5ed-4571-874d-7ebdedfd6542 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:32.073705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 570/1129] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:40:31 2022] GET /identity/v3/projects/53c94b2d783f4d76b65368ee7ff9884c => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:32.084026 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71063bcf-01a2-4ebb-a81c-6dee832b1246 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:32.194618 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71063bcf-01a2-4ebb-a81c-6dee832b1246 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:32.228173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e420f83-8d75-4413-bb1f-2a26e0450493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:32.228832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e420f83-8d75-4413-bb1f-2a26e0450493 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:32.229101 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e420f83-8d75-4413-bb1f-2a26e0450493 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:32.229366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e420f83-8d75-4413-bb1f-2a26e0450493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:32.230175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e420f83-8d75-4413-bb1f-2a26e0450493 None admin] RBAC: Adding query filter params (role.id=7b4e238c731941f18493cd62e30b1e4f, scope.project.id=53c94b2d783f4d76b65368ee7ff9884c, user.id=3c50eb02731241bab26cc7f5ce96dd84) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:32.230482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e420f83-8d75-4413-bb1f-2a26e0450493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:32.232181 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e420f83-8d75-4413-bb1f-2a26e0450493 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:32.237784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 560/1130] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:40:32 2022] GET /identity/v3/role_assignments?user.id=3c50eb02731241bab26cc7f5ce96dd84&scope.project.id=53c94b2d783f4d76b65368ee7ff9884c&role.id=7b4e238c731941f18493cd62e30b1e4f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:34.581430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d74b8c-cb85-4b31-934e-ca00e79ef0da None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:34.582025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d74b8c-cb85-4b31-934e-ca00e79ef0da None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:34.582025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d74b8c-cb85-4b31-934e-ca00e79ef0da None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:34.583849 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 571/1131] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:34.590170 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6c5dd-5d76-4ac9-be86-3eb660074656 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:34.590844 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6c5dd-5d76-4ac9-be86-3eb660074656 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:34.591018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6c5dd-5d76-4ac9-be86-3eb660074656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:34.618679 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-aca6c5dd-5d76-4ac9-be86-3eb660074656 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:34.619933 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-aca6c5dd-5d76-4ac9-be86-3eb660074656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:34.702968 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 561/1132] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:34.731322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d74b8c-cb85-4b31-934e-ca00e79ef0da None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:34.838327 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d74b8c-cb85-4b31-934e-ca00e79ef0da None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:34.871336 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c346d0-9cf6-4887-b4bb-01851353bf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:34.872273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c346d0-9cf6-4887-b4bb-01851353bf06 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:34.872575 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c346d0-9cf6-4887-b4bb-01851353bf06 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:34.872840 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c346d0-9cf6-4887-b4bb-01851353bf06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:34.875322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c346d0-9cf6-4887-b4bb-01851353bf06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:34.876780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c346d0-9cf6-4887-b4bb-01851353bf06 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:34.878440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 572/1133] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:34.884762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6c5dd-5d76-4ac9-be86-3eb660074656 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:34.985828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6c5dd-5d76-4ac9-be86-3eb660074656 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:35.022583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e44e4-cd8e-45ff-8530-4c2ff2a8d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:35.023228 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e44e4-cd8e-45ff-8530-4c2ff2a8d943 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:35.023508 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e44e4-cd8e-45ff-8530-4c2ff2a8d943 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:35.023773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e44e4-cd8e-45ff-8530-4c2ff2a8d943 None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:35.024504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e44e4-cd8e-45ff-8530-4c2ff2a8d943 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:35.026377 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e44e4-cd8e-45ff-8530-4c2ff2a8d943 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:35.062312 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 562/1134] 10.222.0.90 () {60 vars in 1141 bytes} [Wed Nov 2 12:40:34 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:37.418039 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4cf32-f3f4-435a-a745-0b5b23253bc1 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:37.418631 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4cf32-f3f4-435a-a745-0b5b23253bc1 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:37.418800 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4cf32-f3f4-435a-a745-0b5b23253bc1 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:37.420587 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 573/1135] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:37.427323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8956646-9158-4fd3-8e2c-9c99ecd93526 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:37.428078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8956646-9158-4fd3-8e2c-9c99ecd93526 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:37.428195 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8956646-9158-4fd3-8e2c-9c99ecd93526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:37.454692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-c8956646-9158-4fd3-8e2c-9c99ecd93526 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:37.455897 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-c8956646-9158-4fd3-8e2c-9c99ecd93526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:37.528513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 563/1136] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:37.553111 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4cf32-f3f4-435a-a745-0b5b23253bc1 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:37.659530 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4cf32-f3f4-435a-a745-0b5b23253bc1 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:37.693022 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002667f-cfd7-4177-b642-f4c81dc34874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:37.693790 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002667f-cfd7-4177-b642-f4c81dc34874 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:37.694060 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002667f-cfd7-4177-b642-f4c81dc34874 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:37.694328 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002667f-cfd7-4177-b642-f4c81dc34874 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:37.695591 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002667f-cfd7-4177-b642-f4c81dc34874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:37.697162 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002667f-cfd7-4177-b642-f4c81dc34874 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:37.698778 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 574/1137] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:40:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:37.705253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8956646-9158-4fd3-8e2c-9c99ecd93526 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:37.805187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8956646-9158-4fd3-8e2c-9c99ecd93526 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:37.838949 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d7f10-542d-4579-b3c8-9da7db092151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:37.839616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d7f10-542d-4579-b3c8-9da7db092151 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:37.839899 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d7f10-542d-4579-b3c8-9da7db092151 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:37.840172 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d7f10-542d-4579-b3c8-9da7db092151 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:37.840909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d7f10-542d-4579-b3c8-9da7db092151 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:37.842400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d7f10-542d-4579-b3c8-9da7db092151 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:37.868105 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 564/1138] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:40:37 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:40.212574 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089c2b0-45e5-4157-9366-1204facb9d78 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:40.213412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089c2b0-45e5-4157-9366-1204facb9d78 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:40.213412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089c2b0-45e5-4157-9366-1204facb9d78 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:40.216681 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 575/1139] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:40.224678 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7ae99-5b3a-4846-9eef-d1dceb177328 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:40.225143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7ae99-5b3a-4846-9eef-d1dceb177328 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:40.225234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7ae99-5b3a-4846-9eef-d1dceb177328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:40.242772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-04a7ae99-5b3a-4846-9eef-d1dceb177328 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:40.243961 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-04a7ae99-5b3a-4846-9eef-d1dceb177328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:40.312987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 565/1140] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:40:40.340663 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089c2b0-45e5-4157-9366-1204facb9d78 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:40.466560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089c2b0-45e5-4157-9366-1204facb9d78 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:40.500802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd134b-3294-443e-a985-cf62ee277cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:40.501620 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd134b-3294-443e-a985-cf62ee277cd7 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:40.501889 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd134b-3294-443e-a985-cf62ee277cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:40.502161 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd134b-3294-443e-a985-cf62ee277cd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:40.513587 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd134b-3294-443e-a985-cf62ee277cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:40:40.520372 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-17bd134b-3294-443e-a985-cf62ee277cd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:40:40.521599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 576/1141] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:40:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:40.529315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7ae99-5b3a-4846-9eef-d1dceb177328 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:40.635542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7ae99-5b3a-4846-9eef-d1dceb177328 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:40.678109 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dc892-a658-4d84-a5dd-e30d2991a796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:40.679089 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dc892-a658-4d84-a5dd-e30d2991a796 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:40.679481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dc892-a658-4d84-a5dd-e30d2991a796 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:40.679860 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dc892-a658-4d84-a5dd-e30d2991a796 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:40.681063 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dc892-a658-4d84-a5dd-e30d2991a796 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:40.681601 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dc892-a658-4d84-a5dd-e30d2991a796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:40.682972 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dc892-a658-4d84-a5dd-e30d2991a796 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:40.691712 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 566/1142] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:40:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:40.700246 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd134b-3294-443e-a985-cf62ee277cd7 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:40.804035 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd134b-3294-443e-a985-cf62ee277cd7 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:40.837062 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c17af-f05c-42eb-9b04-c764cf23ba0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:40.837978 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c17af-f05c-42eb-9b04-c764cf23ba0b None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:40.838245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c17af-f05c-42eb-9b04-c764cf23ba0b None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:40.838508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c17af-f05c-42eb-9b04-c764cf23ba0b None admin] PATH_INFO: `/v3/users/7f118ac90e0a4250a7ed5b61a9362df9` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:40.852136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c17af-f05c-42eb-9b04-c764cf23ba0b None admin] RBAC: Authorizing `identity:get_user(user_id=7f118ac90e0a4250a7ed5b61a9362df9)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:40.853623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c17af-f05c-42eb-9b04-c764cf23ba0b None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:40.855293 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 577/1143] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:40:40 2022] GET /identity/v3/users/7f118ac90e0a4250a7ed5b61a9362df9 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:40.861917 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dc892-a658-4d84-a5dd-e30d2991a796 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:40.967019 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dc892-a658-4d84-a5dd-e30d2991a796 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:40.999886 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b0558-caf3-44f8-87a6-c557fa3af608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:41.000548 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b0558-caf3-44f8-87a6-c557fa3af608 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:41.000826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b0558-caf3-44f8-87a6-c557fa3af608 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:41.001061 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b0558-caf3-44f8-87a6-c557fa3af608 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:41.079199 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b0558-caf3-44f8-87a6-c557fa3af608 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:41.080705 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b0558-caf3-44f8-87a6-c557fa3af608 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:41.180660 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 567/1144] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:40:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:40:41.187071 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c17af-f05c-42eb-9b04-c764cf23ba0b None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:41.295226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c17af-f05c-42eb-9b04-c764cf23ba0b None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:41.329196 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924efeb-4975-4aa5-b465-e6f37cf95326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:41.330105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924efeb-4975-4aa5-b465-e6f37cf95326 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:41.330324 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924efeb-4975-4aa5-b465-e6f37cf95326 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:41.330569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924efeb-4975-4aa5-b465-e6f37cf95326 None admin] PATH_INFO: `/v3/projects/da0cc1440cb24a0080f399133d581400` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:41.331801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924efeb-4975-4aa5-b465-e6f37cf95326 None admin] RBAC: Authorizing `identity:get_project(project_id=da0cc1440cb24a0080f399133d581400)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:41.333250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924efeb-4975-4aa5-b465-e6f37cf95326 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:41.334905 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 578/1145] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:40:41 2022] GET /identity/v3/projects/da0cc1440cb24a0080f399133d581400 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:41.341398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b0558-caf3-44f8-87a6-c557fa3af608 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:41.450521 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b0558-caf3-44f8-87a6-c557fa3af608 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:41.488126 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c869d-1d5b-4e49-92ff-0207318822f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:41.488823 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c869d-1d5b-4e49-92ff-0207318822f6 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:41.489097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c869d-1d5b-4e49-92ff-0207318822f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:41.489367 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c869d-1d5b-4e49-92ff-0207318822f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:41.490187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c869d-1d5b-4e49-92ff-0207318822f6 None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=da0cc1440cb24a0080f399133d581400, user.id=7f118ac90e0a4250a7ed5b61a9362df9) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:41.490501 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c869d-1d5b-4e49-92ff-0207318822f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:41.491911 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c869d-1d5b-4e49-92ff-0207318822f6 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:41.498038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 568/1146] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:40:41 2022] GET /identity/v3/role_assignments?user.id=7f118ac90e0a4250a7ed5b61a9362df9&scope.project.id=da0cc1440cb24a0080f399133d581400&role.id=85136c55809b4d9db97c263a72392ad1 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:43.767084 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df53fbf-495d-4067-b57e-6287d51b3c70 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:43.767929 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df53fbf-495d-4067-b57e-6287d51b3c70 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:43.767929 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df53fbf-495d-4067-b57e-6287d51b3c70 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:43.770613 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 579/1147] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:43.777609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae8c4f-a775-4e1e-8fe5-16e624991b6d None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:43.778310 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae8c4f-a775-4e1e-8fe5-16e624991b6d None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:43.778310 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae8c4f-a775-4e1e-8fe5-16e624991b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:43.806524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-c4ae8c4f-a775-4e1e-8fe5-16e624991b6d None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:43.807714 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-c4ae8c4f-a775-4e1e-8fe5-16e624991b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:43.874205 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 569/1148] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:43.901444 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df53fbf-495d-4067-b57e-6287d51b3c70 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:44.010111 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df53fbf-495d-4067-b57e-6287d51b3c70 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:44.044321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9f939-5b1c-4485-a469-89b81ab13826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:44.044905 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9f939-5b1c-4485-a469-89b81ab13826 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:44.045186 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9f939-5b1c-4485-a469-89b81ab13826 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:44.045446 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9f939-5b1c-4485-a469-89b81ab13826 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:44.059241 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9f939-5b1c-4485-a469-89b81ab13826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:40:44.070431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-53a9f939-5b1c-4485-a469-89b81ab13826 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:40:44.072400 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 580/1149] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:44.082337 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae8c4f-a775-4e1e-8fe5-16e624991b6d None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:44.198386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae8c4f-a775-4e1e-8fe5-16e624991b6d None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:44.236242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c616d3-2907-4a37-a250-6166ed2060b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:44.236936 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c616d3-2907-4a37-a250-6166ed2060b6 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:44.237226 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c616d3-2907-4a37-a250-6166ed2060b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:44.237496 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c616d3-2907-4a37-a250-6166ed2060b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:44.238259 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c616d3-2907-4a37-a250-6166ed2060b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:44.238559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c616d3-2907-4a37-a250-6166ed2060b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:44.239964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c616d3-2907-4a37-a250-6166ed2060b6 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:44.247941 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 570/1150] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:44.254586 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9f939-5b1c-4485-a469-89b81ab13826 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:44.374092 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9f939-5b1c-4485-a469-89b81ab13826 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:44.408359 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24328d68-43ce-4d94-86b9-49dbaaaad591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:44.409218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24328d68-43ce-4d94-86b9-49dbaaaad591 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:44.409501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24328d68-43ce-4d94-86b9-49dbaaaad591 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:44.409773 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24328d68-43ce-4d94-86b9-49dbaaaad591 None admin] PATH_INFO: `/v3/users/7f118ac90e0a4250a7ed5b61a9362df9` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:44.411077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24328d68-43ce-4d94-86b9-49dbaaaad591 None admin] RBAC: Authorizing `identity:get_user(user_id=7f118ac90e0a4250a7ed5b61a9362df9)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:44.412553 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24328d68-43ce-4d94-86b9-49dbaaaad591 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:44.414186 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 581/1151] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:40:44 2022] GET /identity/v3/users/7f118ac90e0a4250a7ed5b61a9362df9 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:44.421255 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c616d3-2907-4a37-a250-6166ed2060b6 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:44.529448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c616d3-2907-4a37-a250-6166ed2060b6 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:44.563630 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb98bdd-b6be-41d0-aa7f-a247e3e0d4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:44.564468 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb98bdd-b6be-41d0-aa7f-a247e3e0d4ba None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:44.564782 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb98bdd-b6be-41d0-aa7f-a247e3e0d4ba None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:44.565037 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb98bdd-b6be-41d0-aa7f-a247e3e0d4ba None admin] PATH_INFO: `/v3/projects/da0cc1440cb24a0080f399133d581400` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:44.566334 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb98bdd-b6be-41d0-aa7f-a247e3e0d4ba None admin] RBAC: Authorizing `identity:get_project(project_id=da0cc1440cb24a0080f399133d581400)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:44.567775 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb98bdd-b6be-41d0-aa7f-a247e3e0d4ba None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:44.569511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 571/1152] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:40:44 2022] GET /identity/v3/projects/da0cc1440cb24a0080f399133d581400 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:44.578514 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24328d68-43ce-4d94-86b9-49dbaaaad591 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:44.682659 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24328d68-43ce-4d94-86b9-49dbaaaad591 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:44.718886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59da0d-de7e-40b0-98b2-16a040d1ae63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:44.719760 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59da0d-de7e-40b0-98b2-16a040d1ae63 None admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:44.720038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59da0d-de7e-40b0-98b2-16a040d1ae63 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:44.720322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59da0d-de7e-40b0-98b2-16a040d1ae63 None admin] PATH_INFO: `/v3/projects/da0cc1440cb24a0080f399133d581400/users/7f118ac90e0a4250a7ed5b61a9362df9/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:44.722522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59da0d-de7e-40b0-98b2-16a040d1ae63 None admin] RBAC: Authorizing `identity:create_grant(project_id=da0cc1440cb24a0080f399133d581400, user_id=7f118ac90e0a4250a7ed5b61a9362df9, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:44.723959 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59da0d-de7e-40b0-98b2-16a040d1ae63 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:44.739795 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 582/1153] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:40:44 2022] PUT /identity/v3/projects/da0cc1440cb24a0080f399133d581400/users/7f118ac90e0a4250a7ed5b61a9362df9/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:40:47.033853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460e2d-c76c-40f8-9410-034ed9543c97 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:47.034765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460e2d-c76c-40f8-9410-034ed9543c97 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:47.034765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460e2d-c76c-40f8-9410-034ed9543c97 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:47.037566 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 572/1154] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:47.043222 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf25f19-9ce7-4e49-953c-9269524cff87 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:47.043654 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf25f19-9ce7-4e49-953c-9269524cff87 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:47.043846 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf25f19-9ce7-4e49-953c-9269524cff87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:47.061704 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-0bf25f19-9ce7-4e49-953c-9269524cff87 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:47.062863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0bf25f19-9ce7-4e49-953c-9269524cff87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:47.129418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 583/1155] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:47.155551 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3460e2d-c76c-40f8-9410-034ed9543c97 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:47.264942 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3460e2d-c76c-40f8-9410-034ed9543c97 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:47.300420 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c7c9f-9f74-444a-8784-95bfcf727217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:47.301139 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c7c9f-9f74-444a-8784-95bfcf727217 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:47.301414 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c7c9f-9f74-444a-8784-95bfcf727217 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:47.301686 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c7c9f-9f74-444a-8784-95bfcf727217 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:47.313011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c7c9f-9f74-444a-8784-95bfcf727217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:40:47.319773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-295c7c9f-9f74-444a-8784-95bfcf727217 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:40:47.320993 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 573/1156] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:40:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:47.328062 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf25f19-9ce7-4e49-953c-9269524cff87 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:47.440240 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf25f19-9ce7-4e49-953c-9269524cff87 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:47.481687 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275fba4-205f-45c4-a38b-aaeed3ac773e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:47.482358 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275fba4-205f-45c4-a38b-aaeed3ac773e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:47.482636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275fba4-205f-45c4-a38b-aaeed3ac773e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:47.482912 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275fba4-205f-45c4-a38b-aaeed3ac773e None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:47.483655 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275fba4-205f-45c4-a38b-aaeed3ac773e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:47.483954 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275fba4-205f-45c4-a38b-aaeed3ac773e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:47.485386 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275fba4-205f-45c4-a38b-aaeed3ac773e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:47.493173 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 584/1157] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:40:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:47.499967 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c7c9f-9f74-444a-8784-95bfcf727217 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:47.609392 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c7c9f-9f74-444a-8784-95bfcf727217 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:47.642814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38caad5-7476-4d64-baa2-7ba47c91fa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:47.643668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38caad5-7476-4d64-baa2-7ba47c91fa8f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:47.643943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38caad5-7476-4d64-baa2-7ba47c91fa8f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:47.644244 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38caad5-7476-4d64-baa2-7ba47c91fa8f None admin] PATH_INFO: `/v3/users/7f118ac90e0a4250a7ed5b61a9362df9` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:47.645437 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38caad5-7476-4d64-baa2-7ba47c91fa8f None admin] RBAC: Authorizing `identity:get_user(user_id=7f118ac90e0a4250a7ed5b61a9362df9)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:47.646891 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38caad5-7476-4d64-baa2-7ba47c91fa8f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:47.648530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 574/1158] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:40:47 2022] GET /identity/v3/users/7f118ac90e0a4250a7ed5b61a9362df9 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:47.655529 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275fba4-205f-45c4-a38b-aaeed3ac773e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:47.774862 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275fba4-205f-45c4-a38b-aaeed3ac773e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:47.808089 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aa44d-164f-406a-ac26-075c0fc49af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:47.808757 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aa44d-164f-406a-ac26-075c0fc49af7 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:47.809106 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aa44d-164f-406a-ac26-075c0fc49af7 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:47.809375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aa44d-164f-406a-ac26-075c0fc49af7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:47.875400 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8aa44d-164f-406a-ac26-075c0fc49af7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:47.876821 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8aa44d-164f-406a-ac26-075c0fc49af7 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:47.979165 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 585/1159] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:40:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:40:47.986136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38caad5-7476-4d64-baa2-7ba47c91fa8f None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:48.086895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38caad5-7476-4d64-baa2-7ba47c91fa8f None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:48.119324 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e973d-8023-4706-8a91-ed4cd911735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:48.120164 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e973d-8023-4706-8a91-ed4cd911735d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:48.120477 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e973d-8023-4706-8a91-ed4cd911735d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:48.120747 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e973d-8023-4706-8a91-ed4cd911735d None admin] PATH_INFO: `/v3/projects/da0cc1440cb24a0080f399133d581400` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:48.121993 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e973d-8023-4706-8a91-ed4cd911735d None admin] RBAC: Authorizing `identity:get_project(project_id=da0cc1440cb24a0080f399133d581400)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:48.123440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e973d-8023-4706-8a91-ed4cd911735d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:48.125146 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 575/1160] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:40:47 2022] GET /identity/v3/projects/da0cc1440cb24a0080f399133d581400 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:48.131899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aa44d-164f-406a-ac26-075c0fc49af7 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:48.230930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aa44d-164f-406a-ac26-075c0fc49af7 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:48.269124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249b7de-2b5f-4562-92e6-8b7e6f74891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:48.269771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249b7de-2b5f-4562-92e6-8b7e6f74891d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:48.270043 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249b7de-2b5f-4562-92e6-8b7e6f74891d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:48.270311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249b7de-2b5f-4562-92e6-8b7e6f74891d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:48.271137 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249b7de-2b5f-4562-92e6-8b7e6f74891d None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=da0cc1440cb24a0080f399133d581400, user.id=7f118ac90e0a4250a7ed5b61a9362df9) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:48.271436 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249b7de-2b5f-4562-92e6-8b7e6f74891d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:48.272916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249b7de-2b5f-4562-92e6-8b7e6f74891d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:48.279313 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 586/1161] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:40:48 2022] GET /identity/v3/role_assignments?user.id=7f118ac90e0a4250a7ed5b61a9362df9&scope.project.id=da0cc1440cb24a0080f399133d581400&role.id=85136c55809b4d9db97c263a72392ad1 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:50.618462 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1b29a-dc90-430b-908c-017249dbbdf1 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:50.619379 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1b29a-dc90-430b-908c-017249dbbdf1 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:50.619379 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1b29a-dc90-430b-908c-017249dbbdf1 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:50.622231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 576/1162] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:50.628489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bdfb0-0094-450c-a850-dfa882774298 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:50.628933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bdfb0-0094-450c-a850-dfa882774298 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:50.629056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bdfb0-0094-450c-a850-dfa882774298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:50.648302 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-5f8bdfb0-0094-450c-a850-dfa882774298 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:50.649473 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5f8bdfb0-0094-450c-a850-dfa882774298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:50.718993 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 587/1163] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:50.745831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1b29a-dc90-430b-908c-017249dbbdf1 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:50.862484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1b29a-dc90-430b-908c-017249dbbdf1 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:50.896733 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae15b2-8fec-46e5-8c93-a3fb3374baf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:50.897367 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae15b2-8fec-46e5-8c93-a3fb3374baf9 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:50.897640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae15b2-8fec-46e5-8c93-a3fb3374baf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:50.897906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae15b2-8fec-46e5-8c93-a3fb3374baf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:50.965244 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae15b2-8fec-46e5-8c93-a3fb3374baf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:50.966676 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae15b2-8fec-46e5-8c93-a3fb3374baf9 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:51.064103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 577/1164] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:40:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:40:51.071075 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bdfb0-0094-450c-a850-dfa882774298 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:51.174772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bdfb0-0094-450c-a850-dfa882774298 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:51.208578 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df456a29-67d4-4277-8e40-261fcd5a9b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:51.209387 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df456a29-67d4-4277-8e40-261fcd5a9b83 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:51.209666 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df456a29-67d4-4277-8e40-261fcd5a9b83 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:51.209932 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df456a29-67d4-4277-8e40-261fcd5a9b83 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:51.216933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df456a29-67d4-4277-8e40-261fcd5a9b83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:51.218372 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df456a29-67d4-4277-8e40-261fcd5a9b83 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:51.231819 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-df456a29-67d4-4277-8e40-261fcd5a9b83 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 02 12:40:51.232995 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 588/1165] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Nov 2 12:40:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:40:51.242366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae15b2-8fec-46e5-8c93-a3fb3374baf9 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:51.352312 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae15b2-8fec-46e5-8c93-a3fb3374baf9 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:51.394963 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfb4fd-65ff-4d98-a8e8-c84d82dbbd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:51.395624 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfb4fd-65ff-4d98-a8e8-c84d82dbbd69 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:51.395867 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfb4fd-65ff-4d98-a8e8-c84d82dbbd69 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:51.396149 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfb4fd-65ff-4d98-a8e8-c84d82dbbd69 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:51.396943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfb4fd-65ff-4d98-a8e8-c84d82dbbd69 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:51.397243 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfb4fd-65ff-4d98-a8e8-c84d82dbbd69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:51.398608 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfb4fd-65ff-4d98-a8e8-c84d82dbbd69 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:51.406246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 578/1166] 10.222.0.90 () {56 vars in 1115 bytes} [Wed Nov 2 12:40:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:53.778432 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f2a24-8400-4938-873c-f20b86c46054 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:53.779277 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f2a24-8400-4938-873c-f20b86c46054 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:53.779277 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f2a24-8400-4938-873c-f20b86c46054 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:53.782136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 589/1167] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:53.788638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248bf39-4c25-447d-b4ef-56199d98e8cc None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:53.789307 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248bf39-4c25-447d-b4ef-56199d98e8cc None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:53.789520 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248bf39-4c25-447d-b4ef-56199d98e8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:53.810792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-3248bf39-4c25-447d-b4ef-56199d98e8cc None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:53.812744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-3248bf39-4c25-447d-b4ef-56199d98e8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:53.884739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 579/1168] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:53.909517 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f2a24-8400-4938-873c-f20b86c46054 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:54.027579 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f2a24-8400-4938-873c-f20b86c46054 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:54.059468 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccb526-c4b9-4fc1-8371-a63d1fe2f13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:54.060342 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccb526-c4b9-4fc1-8371-a63d1fe2f13d None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:54.060640 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccb526-c4b9-4fc1-8371-a63d1fe2f13d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:54.060988 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccb526-c4b9-4fc1-8371-a63d1fe2f13d None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:54.062072 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccb526-c4b9-4fc1-8371-a63d1fe2f13d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:54.063741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccb526-c4b9-4fc1-8371-a63d1fe2f13d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:54.080221 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 590/1169] 10.222.0.90 () {60 vars in 1138 bytes} [Wed Nov 2 12:40:53 2022] POST /identity/v3/domains => generated 267 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:56.425048 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9cdeb-9091-4b32-8606-8f1a627e61d8 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:56.425933 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9cdeb-9091-4b32-8606-8f1a627e61d8 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:56.425933 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9cdeb-9091-4b32-8606-8f1a627e61d8 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:56.428728 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 580/1170] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:56.435250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71254c30-4d41-4955-8008-6df9c28c6cca None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:56.435702 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71254c30-4d41-4955-8008-6df9c28c6cca None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:56.435806 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71254c30-4d41-4955-8008-6df9c28c6cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:56.457163 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-71254c30-4d41-4955-8008-6df9c28c6cca None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:56.458715 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-71254c30-4d41-4955-8008-6df9c28c6cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:56.529541 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 591/1171] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:40:56.553057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9cdeb-9091-4b32-8606-8f1a627e61d8 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:56.668811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9cdeb-9091-4b32-8606-8f1a627e61d8 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:56.702848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96dd8b-50c3-496a-86de-f75f2689e4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:56.703622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96dd8b-50c3-496a-86de-f75f2689e4c7 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:56.703896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96dd8b-50c3-496a-86de-f75f2689e4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:56.704172 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96dd8b-50c3-496a-86de-f75f2689e4c7 None admin] PATH_INFO: `/v3/domains/541f543c42c644b490547a0d768e655e` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:56.714927 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96dd8b-50c3-496a-86de-f75f2689e4c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=541f543c42c644b490547a0d768e655e)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:56.716398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96dd8b-50c3-496a-86de-f75f2689e4c7 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:56.717993 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 581/1172] 10.222.0.90 () {56 vars in 1183 bytes} [Wed Nov 2 12:40:56 2022] GET /identity/v3/domains/541f543c42c644b490547a0d768e655e => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:56.724370 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71254c30-4d41-4955-8008-6df9c28c6cca None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:56.833095 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71254c30-4d41-4955-8008-6df9c28c6cca None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:56.876392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e150169-b621-4ae7-9dac-173cba4eaf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:56.877048 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e150169-b621-4ae7-9dac-173cba4eaf7c None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:56.877323 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e150169-b621-4ae7-9dac-173cba4eaf7c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:56.877596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e150169-b621-4ae7-9dac-173cba4eaf7c None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:56.878296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e150169-b621-4ae7-9dac-173cba4eaf7c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:56.879737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e150169-b621-4ae7-9dac-173cba4eaf7c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:56.912740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 592/1173] 10.222.0.90 () {60 vars in 1141 bytes} [Wed Nov 2 12:40:56 2022] POST /identity/v3/projects => generated 361 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:59.261948 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b0ffd-da8c-497e-92b9-023bdb6e6113 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:59.262539 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b0ffd-da8c-497e-92b9-023bdb6e6113 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:59.262539 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b0ffd-da8c-497e-92b9-023bdb6e6113 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:59.264392 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 582/1174] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:40:59.270823 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7cab8-7992-4edf-ac79-fe5881225896 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:59.271519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7cab8-7992-4edf-ac79-fe5881225896 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:59.271748 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7cab8-7992-4edf-ac79-fe5881225896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:59.290657 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-80d7cab8-7992-4edf-ac79-fe5881225896 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:59.291838 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-80d7cab8-7992-4edf-ac79-fe5881225896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:59.362098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 593/1175] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:40:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:40:59.391324 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b0ffd-da8c-497e-92b9-023bdb6e6113 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:59.512311 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b0ffd-da8c-497e-92b9-023bdb6e6113 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:59.549213 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d8513-af83-41d3-99d1-97e384323b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:59.550061 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d8513-af83-41d3-99d1-97e384323b5e None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:59.550337 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d8513-af83-41d3-99d1-97e384323b5e None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:59.550607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d8513-af83-41d3-99d1-97e384323b5e None admin] PATH_INFO: `/v3/domains/541f543c42c644b490547a0d768e655e` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:59.551902 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d8513-af83-41d3-99d1-97e384323b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=541f543c42c644b490547a0d768e655e)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:59.553366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d8513-af83-41d3-99d1-97e384323b5e None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:59.554962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 583/1176] 10.222.0.90 () {56 vars in 1183 bytes} [Wed Nov 2 12:40:59 2022] GET /identity/v3/domains/541f543c42c644b490547a0d768e655e => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:59.561843 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7cab8-7992-4edf-ac79-fe5881225896 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:59.674126 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7cab8-7992-4edf-ac79-fe5881225896 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:59.708134 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e09a78-81af-4770-87f1-7755c306cc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:59.708822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e09a78-81af-4770-87f1-7755c306cc08 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:59.709103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e09a78-81af-4770-87f1-7755c306cc08 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:59.709376 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e09a78-81af-4770-87f1-7755c306cc08 None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:59.710082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e09a78-81af-4770-87f1-7755c306cc08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:59.711531 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e09a78-81af-4770-87f1-7755c306cc08 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:59.737227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 594/1177] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:40:59 2022] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:41:02.073673 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb9635-49c1-415c-bd00-98327489cb69 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:02.074696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb9635-49c1-415c-bd00-98327489cb69 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:02.074696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb9635-49c1-415c-bd00-98327489cb69 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:02.077475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 584/1178] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:41:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:41:02.085913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1e4e9-4433-4fea-bf12-3a12e9dd18a6 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:02.086585 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1e4e9-4433-4fea-bf12-3a12e9dd18a6 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:02.086826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1e4e9-4433-4fea-bf12-3a12e9dd18a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:02.110722 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-7db1e4e9-4433-4fea-bf12-3a12e9dd18a6 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:02.111896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7db1e4e9-4433-4fea-bf12-3a12e9dd18a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:02.179178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 595/1179] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:41:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:41:02.205562 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb9635-49c1-415c-bd00-98327489cb69 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:02.316597 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb9635-49c1-415c-bd00-98327489cb69 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:02.348351 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09e4c2-25a8-4fa6-9fa0-027980af4098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:02.349078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09e4c2-25a8-4fa6-9fa0-027980af4098 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:02.349351 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09e4c2-25a8-4fa6-9fa0-027980af4098 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:02.349627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09e4c2-25a8-4fa6-9fa0-027980af4098 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:02.359326 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09e4c2-25a8-4fa6-9fa0-027980af4098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:41:02.366139 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-4c09e4c2-25a8-4fa6-9fa0-027980af4098 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:41:02.367304 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 585/1180] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:41:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:41:02.374482 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1e4e9-4433-4fea-bf12-3a12e9dd18a6 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:02.486337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1e4e9-4433-4fea-bf12-3a12e9dd18a6 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:02.528532 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d03f7-9214-4220-9d3e-41bfeb9fd32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:02.529204 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d03f7-9214-4220-9d3e-41bfeb9fd32a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:02.529481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d03f7-9214-4220-9d3e-41bfeb9fd32a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:02.529750 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d03f7-9214-4220-9d3e-41bfeb9fd32a None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:02.530476 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d03f7-9214-4220-9d3e-41bfeb9fd32a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:41:02.530776 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d03f7-9214-4220-9d3e-41bfeb9fd32a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:02.532163 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d03f7-9214-4220-9d3e-41bfeb9fd32a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:02.540533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 596/1181] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:41:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:02.549715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09e4c2-25a8-4fa6-9fa0-027980af4098 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:02.654234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09e4c2-25a8-4fa6-9fa0-027980af4098 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:02.687434 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb0f01-eb14-42cb-8330-50d0f497623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:02.688317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb0f01-eb14-42cb-8330-50d0f497623c None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:02.688599 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb0f01-eb14-42cb-8330-50d0f497623c None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:02.688861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb0f01-eb14-42cb-8330-50d0f497623c None admin] PATH_INFO: `/v3/users/c8132360313b406cabe660264576f20c` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:02.702260 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb0f01-eb14-42cb-8330-50d0f497623c None admin] RBAC: Authorizing `identity:get_user(user_id=c8132360313b406cabe660264576f20c)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:02.703731 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb0f01-eb14-42cb-8330-50d0f497623c None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:02.705391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 586/1182] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:41:02 2022] GET /identity/v3/users/c8132360313b406cabe660264576f20c => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:02.711759 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d03f7-9214-4220-9d3e-41bfeb9fd32a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:02.836169 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d03f7-9214-4220-9d3e-41bfeb9fd32a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:02.869785 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06417987-0421-418f-98ad-6e068e389cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:02.870431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06417987-0421-418f-98ad-6e068e389cf4 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:02.870715 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06417987-0421-418f-98ad-6e068e389cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:02.870988 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06417987-0421-418f-98ad-6e068e389cf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:02.936959 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06417987-0421-418f-98ad-6e068e389cf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:02.938419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06417987-0421-418f-98ad-6e068e389cf4 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:03.057163 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 597/1183] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:41:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:41:03.063419 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb0f01-eb14-42cb-8330-50d0f497623c None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:03.165687 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb0f01-eb14-42cb-8330-50d0f497623c None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:03.199945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9c790-5960-40ad-84c0-04c84914247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:03.200804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9c790-5960-40ad-84c0-04c84914247a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:03.201083 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9c790-5960-40ad-84c0-04c84914247a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:03.201355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9c790-5960-40ad-84c0-04c84914247a None admin] PATH_INFO: `/v3/projects/1795099043e2471492f3850b5e1e6eef` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:03.202596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9c790-5960-40ad-84c0-04c84914247a None admin] RBAC: Authorizing `identity:get_project(project_id=1795099043e2471492f3850b5e1e6eef)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:03.204060 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9c790-5960-40ad-84c0-04c84914247a None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:03.205744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 587/1184] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:41:03 2022] GET /identity/v3/projects/1795099043e2471492f3850b5e1e6eef => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:03.213038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06417987-0421-418f-98ad-6e068e389cf4 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:03.336343 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06417987-0421-418f-98ad-6e068e389cf4 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:03.371208 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb3c0d-8c92-4f0b-926a-bcc11f8a95f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:03.371802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb3c0d-8c92-4f0b-926a-bcc11f8a95f9 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:03.372077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb3c0d-8c92-4f0b-926a-bcc11f8a95f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:03.372378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb3c0d-8c92-4f0b-926a-bcc11f8a95f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:03.373201 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb3c0d-8c92-4f0b-926a-bcc11f8a95f9 None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=1795099043e2471492f3850b5e1e6eef, user.id=c8132360313b406cabe660264576f20c) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:41:03.373516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb3c0d-8c92-4f0b-926a-bcc11f8a95f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:03.374937 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb3c0d-8c92-4f0b-926a-bcc11f8a95f9 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:03.381236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 598/1185] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:41:03 2022] GET /identity/v3/role_assignments?user.id=c8132360313b406cabe660264576f20c&scope.project.id=1795099043e2471492f3850b5e1e6eef&role.id=85136c55809b4d9db97c263a72392ad1 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:05.662024 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e484d9-48f1-49de-bbfa-3c6a937ad8fe None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:05.663005 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e484d9-48f1-49de-bbfa-3c6a937ad8fe None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:05.663005 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e484d9-48f1-49de-bbfa-3c6a937ad8fe None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:05.665686 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 588/1186] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:41:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:41:05.671237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91189a-88bd-485f-9135-490979510e20 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:05.671662 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91189a-88bd-485f-9135-490979510e20 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:05.671780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91189a-88bd-485f-9135-490979510e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:05.688878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-ad91189a-88bd-485f-9135-490979510e20 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:05.690056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ad91189a-88bd-485f-9135-490979510e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:05.760418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 599/1187] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:41:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:41:05.783385 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e484d9-48f1-49de-bbfa-3c6a937ad8fe None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:05.887834 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e484d9-48f1-49de-bbfa-3c6a937ad8fe None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:05.926225 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29f618-0617-4db4-9f31-6a5d85608c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:05.927027 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29f618-0617-4db4-9f31-6a5d85608c4a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:05.927299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29f618-0617-4db4-9f31-6a5d85608c4a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:05.927565 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29f618-0617-4db4-9f31-6a5d85608c4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:05.938838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29f618-0617-4db4-9f31-6a5d85608c4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:41:05.945582 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-cd29f618-0617-4db4-9f31-6a5d85608c4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:41:05.946813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 589/1188] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:41:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:41:05.953837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91189a-88bd-485f-9135-490979510e20 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:06.061430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91189a-88bd-485f-9135-490979510e20 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:06.098500 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c55ee-2b4d-4a47-8831-dd698dd3261c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:06.099156 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c55ee-2b4d-4a47-8831-dd698dd3261c None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:06.099434 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c55ee-2b4d-4a47-8831-dd698dd3261c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:06.099703 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c55ee-2b4d-4a47-8831-dd698dd3261c None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:06.100476 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c55ee-2b4d-4a47-8831-dd698dd3261c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:41:06.100785 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c55ee-2b4d-4a47-8831-dd698dd3261c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:06.102162 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c55ee-2b4d-4a47-8831-dd698dd3261c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:06.111174 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 600/1189] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:41:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:06.119967 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29f618-0617-4db4-9f31-6a5d85608c4a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:06.223842 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29f618-0617-4db4-9f31-6a5d85608c4a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:06.259178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f532a68-e30d-4002-aaf6-33f9a6fbb8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:06.260085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f532a68-e30d-4002-aaf6-33f9a6fbb8c2 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:06.260472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f532a68-e30d-4002-aaf6-33f9a6fbb8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:06.260747 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f532a68-e30d-4002-aaf6-33f9a6fbb8c2 None admin] PATH_INFO: `/v3/users/c8132360313b406cabe660264576f20c` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:06.262070 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f532a68-e30d-4002-aaf6-33f9a6fbb8c2 None admin] RBAC: Authorizing `identity:get_user(user_id=c8132360313b406cabe660264576f20c)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:06.263561 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f532a68-e30d-4002-aaf6-33f9a6fbb8c2 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:06.265182 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 590/1190] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:41:06 2022] GET /identity/v3/users/c8132360313b406cabe660264576f20c => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:06.271709 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c55ee-2b4d-4a47-8831-dd698dd3261c None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:06.376484 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c55ee-2b4d-4a47-8831-dd698dd3261c None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:06.411196 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505f9dc-00cd-4472-9886-d346692158ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:06.412050 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505f9dc-00cd-4472-9886-d346692158ed None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:06.412367 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505f9dc-00cd-4472-9886-d346692158ed None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:06.412639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505f9dc-00cd-4472-9886-d346692158ed None admin] PATH_INFO: `/v3/projects/1795099043e2471492f3850b5e1e6eef` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:06.413862 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505f9dc-00cd-4472-9886-d346692158ed None admin] RBAC: Authorizing `identity:get_project(project_id=1795099043e2471492f3850b5e1e6eef)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:06.415410 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505f9dc-00cd-4472-9886-d346692158ed None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:06.417160 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 601/1191] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:41:06 2022] GET /identity/v3/projects/1795099043e2471492f3850b5e1e6eef => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:06.423238 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f532a68-e30d-4002-aaf6-33f9a6fbb8c2 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:06.525016 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f532a68-e30d-4002-aaf6-33f9a6fbb8c2 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:06.560543 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c767a-f68a-4afd-a735-c0c6bf6409c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:06.561416 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c767a-f68a-4afd-a735-c0c6bf6409c3 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:06.561691 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c767a-f68a-4afd-a735-c0c6bf6409c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:06.561955 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c767a-f68a-4afd-a735-c0c6bf6409c3 None admin] PATH_INFO: `/v3/projects/1795099043e2471492f3850b5e1e6eef/users/c8132360313b406cabe660264576f20c/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:06.563970 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c767a-f68a-4afd-a735-c0c6bf6409c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1795099043e2471492f3850b5e1e6eef, user_id=c8132360313b406cabe660264576f20c, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:06.565427 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c767a-f68a-4afd-a735-c0c6bf6409c3 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:06.582120 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 591/1192] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:41:06 2022] PUT /identity/v3/projects/1795099043e2471492f3850b5e1e6eef/users/c8132360313b406cabe660264576f20c/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:08.867923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb71603-d2f2-4193-88be-1b330ae021d4 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:08.868824 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb71603-d2f2-4193-88be-1b330ae021d4 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:08.868824 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb71603-d2f2-4193-88be-1b330ae021d4 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:08.871606 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 602/1193] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:41:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:41:08.877013 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67266b8e-dd97-4b02-a0be-a29a073b04ca None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:08.877421 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67266b8e-dd97-4b02-a0be-a29a073b04ca None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:08.877509 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67266b8e-dd97-4b02-a0be-a29a073b04ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:08.896089 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-67266b8e-dd97-4b02-a0be-a29a073b04ca None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:08.897270 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-67266b8e-dd97-4b02-a0be-a29a073b04ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:08.979177 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 592/1194] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:41:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:41:09.008613 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb71603-d2f2-4193-88be-1b330ae021d4 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:09.252580 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb71603-d2f2-4193-88be-1b330ae021d4 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:09.295506 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d523236-4ff1-4939-8fcb-748703b0f6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:09.296656 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d523236-4ff1-4939-8fcb-748703b0f6f4 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:09.297009 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d523236-4ff1-4939-8fcb-748703b0f6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:09.297344 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d523236-4ff1-4939-8fcb-748703b0f6f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:09.311372 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d523236-4ff1-4939-8fcb-748703b0f6f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:41:09.318118 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-4d523236-4ff1-4939-8fcb-748703b0f6f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:41:09.319299 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 603/1195] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:41:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:41:09.326345 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67266b8e-dd97-4b02-a0be-a29a073b04ca None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:09.433788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67266b8e-dd97-4b02-a0be-a29a073b04ca None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:09.477709 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cb50e-c821-410d-94b0-e12e1ea74cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:09.478378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cb50e-c821-410d-94b0-e12e1ea74cdc None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:09.478653 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cb50e-c821-410d-94b0-e12e1ea74cdc None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:09.478919 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cb50e-c821-410d-94b0-e12e1ea74cdc None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:09.479657 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cb50e-c821-410d-94b0-e12e1ea74cdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:41:09.479986 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cb50e-c821-410d-94b0-e12e1ea74cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:09.481701 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cb50e-c821-410d-94b0-e12e1ea74cdc None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:09.490141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 593/1196] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:09.496439 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d523236-4ff1-4939-8fcb-748703b0f6f4 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:09.600492 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d523236-4ff1-4939-8fcb-748703b0f6f4 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:09.634895 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0987ea-0c61-4ed9-9044-9d08e7991c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:09.635752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0987ea-0c61-4ed9-9044-9d08e7991c26 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:09.636025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0987ea-0c61-4ed9-9044-9d08e7991c26 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:09.636318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0987ea-0c61-4ed9-9044-9d08e7991c26 None admin] PATH_INFO: `/v3/users/c8132360313b406cabe660264576f20c` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:09.637554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0987ea-0c61-4ed9-9044-9d08e7991c26 None admin] RBAC: Authorizing `identity:get_user(user_id=c8132360313b406cabe660264576f20c)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:09.639008 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0987ea-0c61-4ed9-9044-9d08e7991c26 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:09.640639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 604/1197] 10.222.0.90 () {56 vars in 1177 bytes} [Wed Nov 2 12:41:09 2022] GET /identity/v3/users/c8132360313b406cabe660264576f20c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:09.650284 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cb50e-c821-410d-94b0-e12e1ea74cdc None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:09.752322 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cb50e-c821-410d-94b0-e12e1ea74cdc None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:09.785750 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e0b7c-cf55-41bc-b663-365f28e63679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:09.786432 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e0b7c-cf55-41bc-b663-365f28e63679 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:09.786713 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e0b7c-cf55-41bc-b663-365f28e63679 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:09.786975 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e0b7c-cf55-41bc-b663-365f28e63679 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:09.851343 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e0b7c-cf55-41bc-b663-365f28e63679 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:09.852767 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e0b7c-cf55-41bc-b663-365f28e63679 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:09.951466 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 594/1198] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:41:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:41:09.957772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0987ea-0c61-4ed9-9044-9d08e7991c26 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:10.068640 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0987ea-0c61-4ed9-9044-9d08e7991c26 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:10.107520 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ae38f-4e8a-4faa-8c0c-31f62344ba9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:10.108926 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ae38f-4e8a-4faa-8c0c-31f62344ba9f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:10.109343 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ae38f-4e8a-4faa-8c0c-31f62344ba9f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:10.109791 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ae38f-4e8a-4faa-8c0c-31f62344ba9f None admin] PATH_INFO: `/v3/projects/1795099043e2471492f3850b5e1e6eef` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:10.111936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ae38f-4e8a-4faa-8c0c-31f62344ba9f None admin] RBAC: Authorizing `identity:get_project(project_id=1795099043e2471492f3850b5e1e6eef)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:10.114357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ae38f-4e8a-4faa-8c0c-31f62344ba9f None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:10.117192 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 605/1199] 10.222.0.90 () {56 vars in 1186 bytes} [Wed Nov 2 12:41:09 2022] GET /identity/v3/projects/1795099043e2471492f3850b5e1e6eef => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:10.124102 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e0b7c-cf55-41bc-b663-365f28e63679 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:10.226518 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e0b7c-cf55-41bc-b663-365f28e63679 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:10.272184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa4f01-058f-45e0-bbc3-b892725d914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:10.273081 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa4f01-058f-45e0-bbc3-b892725d914d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:10.273452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa4f01-058f-45e0-bbc3-b892725d914d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:10.273804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa4f01-058f-45e0-bbc3-b892725d914d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:10.275112 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa4f01-058f-45e0-bbc3-b892725d914d None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=1795099043e2471492f3850b5e1e6eef, user.id=c8132360313b406cabe660264576f20c) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:41:10.275405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa4f01-058f-45e0-bbc3-b892725d914d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:10.276867 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa4f01-058f-45e0-bbc3-b892725d914d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:10.282774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 595/1200] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:41:10 2022] GET /identity/v3/role_assignments?user.id=c8132360313b406cabe660264576f20c&scope.project.id=1795099043e2471492f3850b5e1e6eef&role.id=85136c55809b4d9db97c263a72392ad1 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:13.287587 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73125b11-c102-4d1b-9bf7-0c9c214fd7e4 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:13.288240 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73125b11-c102-4d1b-9bf7-0c9c214fd7e4 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:13.288240 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73125b11-c102-4d1b-9bf7-0c9c214fd7e4 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:13.290001 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 606/1201] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:42:13.295712 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d2e7b-8fe7-4cd6-ba99-3667576eebf9 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:13.296174 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d2e7b-8fe7-4cd6-ba99-3667576eebf9 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:13.296312 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d2e7b-8fe7-4cd6-ba99-3667576eebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:13.314470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-194d2e7b-8fe7-4cd6-ba99-3667576eebf9 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:13.315662 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-194d2e7b-8fe7-4cd6-ba99-3667576eebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:13.400192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 596/1202] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:42:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:42:13.422834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73125b11-c102-4d1b-9bf7-0c9c214fd7e4 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:13.538634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73125b11-c102-4d1b-9bf7-0c9c214fd7e4 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:13.578995 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7559927-ac8e-48cc-8077-86be2d866f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:13.579926 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7559927-ac8e-48cc-8077-86be2d866f02 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:13.580233 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7559927-ac8e-48cc-8077-86be2d866f02 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:13.580600 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7559927-ac8e-48cc-8077-86be2d866f02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:13.591796 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7559927-ac8e-48cc-8077-86be2d866f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:13.593399 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7559927-ac8e-48cc-8077-86be2d866f02 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:13.612237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-b7559927-ac8e-48cc-8077-86be2d866f02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:42:13.613548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 607/1203] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:13.620102 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d2e7b-8fe7-4cd6-ba99-3667576eebf9 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:13.730348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d2e7b-8fe7-4cd6-ba99-3667576eebf9 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:13.771962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e0263-aadf-4409-b62d-968bf88b6bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:13.772648 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e0263-aadf-4409-b62d-968bf88b6bf4 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:13.773256 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e0263-aadf-4409-b62d-968bf88b6bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:13.773525 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e0263-aadf-4409-b62d-968bf88b6bf4 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:13.774223 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e0263-aadf-4409-b62d-968bf88b6bf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:13.774511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e0263-aadf-4409-b62d-968bf88b6bf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:13.775956 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e0263-aadf-4409-b62d-968bf88b6bf4 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:13.788035 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 597/1204] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:13.795034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7559927-ac8e-48cc-8077-86be2d866f02 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:13.912147 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7559927-ac8e-48cc-8077-86be2d866f02 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:13.951186 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5159f-0457-4890-baf7-b136cb04db55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:13.952227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5159f-0457-4890-baf7-b136cb04db55 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:13.952610 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5159f-0457-4890-baf7-b136cb04db55 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:13.953042 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5159f-0457-4890-baf7-b136cb04db55 None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:13.953985 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5159f-0457-4890-baf7-b136cb04db55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:13.955582 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5159f-0457-4890-baf7-b136cb04db55 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:13.979698 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 608/1205] 10.222.0.90 () {60 vars in 1132 bytes} [Wed Nov 2 12:42:13 2022] POST /identity/v3/users => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:42:16.449333 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19110d-f9a2-4835-bd33-de39245b366d None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:16.449892 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19110d-f9a2-4835-bd33-de39245b366d None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:16.449892 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19110d-f9a2-4835-bd33-de39245b366d None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:16.451681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 598/1206] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:42:16.457956 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1426d2e-63f1-4804-9337-e55877c02132 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:16.459546 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1426d2e-63f1-4804-9337-e55877c02132 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:16.459546 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1426d2e-63f1-4804-9337-e55877c02132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:16.477462 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-b1426d2e-63f1-4804-9337-e55877c02132 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:16.478663 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-b1426d2e-63f1-4804-9337-e55877c02132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:16.547863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 609/1207] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:42:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:42:16.571115 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19110d-f9a2-4835-bd33-de39245b366d None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:16.680347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19110d-f9a2-4835-bd33-de39245b366d None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:16.718166 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b17aa4-5661-4206-a9db-50c377479b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:16.718957 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b17aa4-5661-4206-a9db-50c377479b82 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:16.719230 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b17aa4-5661-4206-a9db-50c377479b82 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:16.719480 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b17aa4-5661-4206-a9db-50c377479b82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:16.730599 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b17aa4-5661-4206-a9db-50c377479b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:42:16.738024 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-b2b17aa4-5661-4206-a9db-50c377479b82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:42:16.744271 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 599/1208] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:42:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:42:16.745818 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1426d2e-63f1-4804-9337-e55877c02132 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:16.849922 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1426d2e-63f1-4804-9337-e55877c02132 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:16.883967 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1c4f4-bedc-45d2-9207-aaaa50dacd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:16.884682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c4f4-bedc-45d2-9207-aaaa50dacd0d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:16.884960 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c4f4-bedc-45d2-9207-aaaa50dacd0d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:16.886478 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c4f4-bedc-45d2-9207-aaaa50dacd0d None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:16.886478 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1c4f4-bedc-45d2-9207-aaaa50dacd0d None admin] RBAC: Adding query filter params (name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:16.886478 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1c4f4-bedc-45d2-9207-aaaa50dacd0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:16.888130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1c4f4-bedc-45d2-9207-aaaa50dacd0d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:16.896485 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 610/1209] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:42:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:16.902472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b17aa4-5661-4206-a9db-50c377479b82 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:17.012879 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b17aa4-5661-4206-a9db-50c377479b82 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:17.049382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f565f-fe1a-49cf-9ff5-c36e43ef642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:17.050734 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f565f-fe1a-49cf-9ff5-c36e43ef642d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:17.050734 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f565f-fe1a-49cf-9ff5-c36e43ef642d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:17.050734 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f565f-fe1a-49cf-9ff5-c36e43ef642d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:17.063461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f565f-fe1a-49cf-9ff5-c36e43ef642d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:17.065185 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f565f-fe1a-49cf-9ff5-c36e43ef642d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:17.083920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-8c5f565f-fe1a-49cf-9ff5-c36e43ef642d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:42:17.085950 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 600/1210] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:17.093107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1c4f4-bedc-45d2-9207-aaaa50dacd0d None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:17.201066 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1c4f4-bedc-45d2-9207-aaaa50dacd0d None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:17.237235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5387550-c988-41e6-b357-b64526c37309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:17.238135 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5387550-c988-41e6-b357-b64526c37309 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:17.238514 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5387550-c988-41e6-b357-b64526c37309 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:17.238946 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5387550-c988-41e6-b357-b64526c37309 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:17.239846 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5387550-c988-41e6-b357-b64526c37309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:17.240296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5387550-c988-41e6-b357-b64526c37309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:17.241943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5387550-c988-41e6-b357-b64526c37309 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:17.256285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 611/1211] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:42:17.262215 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f565f-fe1a-49cf-9ff5-c36e43ef642d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:17.372020 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f565f-fe1a-49cf-9ff5-c36e43ef642d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:17.411184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a10ea-237f-4e4a-a1c9-19b4abea94e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:17.412012 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a10ea-237f-4e4a-a1c9-19b4abea94e2 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:17.412328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a10ea-237f-4e4a-a1c9-19b4abea94e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:17.412628 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a10ea-237f-4e4a-a1c9-19b4abea94e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:17.421558 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a10ea-237f-4e4a-a1c9-19b4abea94e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:17.423187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a10ea-237f-4e4a-a1c9-19b4abea94e2 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:17.437737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-fb2a10ea-237f-4e4a-a1c9-19b4abea94e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 12:42:17.438947 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 601/1212] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:17.445320 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5387550-c988-41e6-b357-b64526c37309 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:17.556906 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5387550-c988-41e6-b357-b64526c37309 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:17.597758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630cacb-e05c-48b7-8d0c-4ad73fe9c7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:17.599614 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630cacb-e05c-48b7-8d0c-4ad73fe9c7dc None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:17.599952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630cacb-e05c-48b7-8d0c-4ad73fe9c7dc None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:17.600305 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630cacb-e05c-48b7-8d0c-4ad73fe9c7dc None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:17.601144 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630cacb-e05c-48b7-8d0c-4ad73fe9c7dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:17.601452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630cacb-e05c-48b7-8d0c-4ad73fe9c7dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:17.602879 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630cacb-e05c-48b7-8d0c-4ad73fe9c7dc None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:17.621352 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 612/1213] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Nov 2 12:42:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:17.627225 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a10ea-237f-4e4a-a1c9-19b4abea94e2 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:17.734172 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a10ea-237f-4e4a-a1c9-19b4abea94e2 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:17.773869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3871f6-9aa5-4244-93e9-0b295025db29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:17.774569 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3871f6-9aa5-4244-93e9-0b295025db29 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:17.774866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3871f6-9aa5-4244-93e9-0b295025db29 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:17.775136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3871f6-9aa5-4244-93e9-0b295025db29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:17.848880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3871f6-9aa5-4244-93e9-0b295025db29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:17.850524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3871f6-9aa5-4244-93e9-0b295025db29 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:17.959823 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 602/1214] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:42:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:42:17.962056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630cacb-e05c-48b7-8d0c-4ad73fe9c7dc None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:18.069312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630cacb-e05c-48b7-8d0c-4ad73fe9c7dc None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:18.109852 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94accead-0b8a-40a7-8bba-cf634ea7cc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:18.111106 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94accead-0b8a-40a7-8bba-cf634ea7cc0f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:18.111584 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94accead-0b8a-40a7-8bba-cf634ea7cc0f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:18.112073 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94accead-0b8a-40a7-8bba-cf634ea7cc0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:18.124013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94accead-0b8a-40a7-8bba-cf634ea7cc0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:18.125538 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94accead-0b8a-40a7-8bba-cf634ea7cc0f None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:18.148636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-94accead-0b8a-40a7-8bba-cf634ea7cc0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:42:18.150121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 613/1215] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:42:18.156192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3871f6-9aa5-4244-93e9-0b295025db29 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:18.256518 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3871f6-9aa5-4244-93e9-0b295025db29 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:18.291673 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9dfa5-c639-49e8-87e9-de4db0bb084f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:18.293990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9dfa5-c639-49e8-87e9-de4db0bb084f None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:18.293990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9dfa5-c639-49e8-87e9-de4db0bb084f None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:18.293990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9dfa5-c639-49e8-87e9-de4db0bb084f None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:18.293990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9dfa5-c639-49e8-87e9-de4db0bb084f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:18.294883 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9dfa5-c639-49e8-87e9-de4db0bb084f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:18.296692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9dfa5-c639-49e8-87e9-de4db0bb084f None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:18.309038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 603/1216] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:18.316666 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94accead-0b8a-40a7-8bba-cf634ea7cc0f None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:18.426518 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94accead-0b8a-40a7-8bba-cf634ea7cc0f None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:18.464639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb9ace-ab4e-4223-b17e-aa949e546f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:18.465568 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb9ace-ab4e-4223-b17e-aa949e546f91 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:18.465883 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb9ace-ab4e-4223-b17e-aa949e546f91 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:18.466209 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb9ace-ab4e-4223-b17e-aa949e546f91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:18.474528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb9ace-ab4e-4223-b17e-aa949e546f91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:18.476150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb9ace-ab4e-4223-b17e-aa949e546f91 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:18.491306 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-f8cb9ace-ab4e-4223-b17e-aa949e546f91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:42:18.493142 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 614/1217] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:42:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:42:18.499255 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9dfa5-c639-49e8-87e9-de4db0bb084f None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:18.612058 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9dfa5-c639-49e8-87e9-de4db0bb084f None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:18.647344 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a34ef6-b347-4a53-9fc8-1d1e9df872e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:18.649173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a34ef6-b347-4a53-9fc8-1d1e9df872e3 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:18.649730 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a34ef6-b347-4a53-9fc8-1d1e9df872e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:18.650166 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a34ef6-b347-4a53-9fc8-1d1e9df872e3 None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:18.651234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a34ef6-b347-4a53-9fc8-1d1e9df872e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:18.651754 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a34ef6-b347-4a53-9fc8-1d1e9df872e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:18.653577 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a34ef6-b347-4a53-9fc8-1d1e9df872e3 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:18.667413 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 604/1218] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:42:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:18.673765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb9ace-ab4e-4223-b17e-aa949e546f91 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:18.781444 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb9ace-ab4e-4223-b17e-aa949e546f91 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:18.817788 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2e2aa-dd01-46cf-8888-587dfa5695d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:18.818441 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2e2aa-dd01-46cf-8888-587dfa5695d6 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:18.818745 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2e2aa-dd01-46cf-8888-587dfa5695d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:18.819036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2e2aa-dd01-46cf-8888-587dfa5695d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:18.819907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2e2aa-dd01-46cf-8888-587dfa5695d6 None admin] RBAC: Adding query filter params (role.id=63df47d6fc0740e6bc54a845c3f8a257, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=65e89359a42b4b0592db48f5a5a6e465) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:18.820245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2e2aa-dd01-46cf-8888-587dfa5695d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:18.821690 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2e2aa-dd01-46cf-8888-587dfa5695d6 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:18.827403 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 615/1219] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:42:18 2022] GET /identity/v3/role_assignments?user.id=65e89359a42b4b0592db48f5a5a6e465&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=63df47d6fc0740e6bc54a845c3f8a257 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:21.248298 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba4cf0-8ec2-4315-9ad3-d5dff253f39a None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:21.248840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba4cf0-8ec2-4315-9ad3-d5dff253f39a None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:21.248840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba4cf0-8ec2-4315-9ad3-d5dff253f39a None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:21.250612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 605/1220] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:42:21.256433 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccc88f-9f02-4f8d-9ed5-9e02187ba5be None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:21.256922 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccc88f-9f02-4f8d-9ed5-9e02187ba5be None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:21.257030 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccc88f-9f02-4f8d-9ed5-9e02187ba5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:21.274420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-a9ccc88f-9f02-4f8d-9ed5-9e02187ba5be None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:21.275594 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a9ccc88f-9f02-4f8d-9ed5-9e02187ba5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:21.350284 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 616/1221] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:42:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:42:21.374314 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba4cf0-8ec2-4315-9ad3-d5dff253f39a None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:21.481980 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba4cf0-8ec2-4315-9ad3-d5dff253f39a None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:21.517672 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33a07c-2a2d-4869-b7b8-bd9712503b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:21.518412 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33a07c-2a2d-4869-b7b8-bd9712503b16 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:21.518691 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33a07c-2a2d-4869-b7b8-bd9712503b16 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:21.518962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33a07c-2a2d-4869-b7b8-bd9712503b16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:21.531854 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33a07c-2a2d-4869-b7b8-bd9712503b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:42:21.538859 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-4c33a07c-2a2d-4869-b7b8-bd9712503b16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:42:21.540092 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 606/1222] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:42:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:42:21.546846 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccc88f-9f02-4f8d-9ed5-9e02187ba5be None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:21.652110 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccc88f-9f02-4f8d-9ed5-9e02187ba5be None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:21.688679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3229c-a254-44a7-b055-6daf8ae2f179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:21.689373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3229c-a254-44a7-b055-6daf8ae2f179 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:21.689672 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3229c-a254-44a7-b055-6daf8ae2f179 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:21.689949 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3229c-a254-44a7-b055-6daf8ae2f179 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:21.690680 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3229c-a254-44a7-b055-6daf8ae2f179 None admin] RBAC: Adding query filter params (name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:21.690960 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3229c-a254-44a7-b055-6daf8ae2f179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:21.692368 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3229c-a254-44a7-b055-6daf8ae2f179 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:21.700600 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 617/1223] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:42:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:21.706756 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33a07c-2a2d-4869-b7b8-bd9712503b16 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:21.820281 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33a07c-2a2d-4869-b7b8-bd9712503b16 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:21.863723 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3662a-cdce-4a90-9850-28d33eee4a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:21.864585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3662a-cdce-4a90-9850-28d33eee4a97 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:21.864860 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3662a-cdce-4a90-9850-28d33eee4a97 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:21.865142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3662a-cdce-4a90-9850-28d33eee4a97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:21.877198 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3662a-cdce-4a90-9850-28d33eee4a97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:21.878696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3662a-cdce-4a90-9850-28d33eee4a97 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:21.897030 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-deb3662a-cdce-4a90-9850-28d33eee4a97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:42:21.898727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 607/1224] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:21.905961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3229c-a254-44a7-b055-6daf8ae2f179 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:22.011912 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3229c-a254-44a7-b055-6daf8ae2f179 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:22.048719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ca043-5f05-4ddd-99a5-8361d234eaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:22.049511 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ca043-5f05-4ddd-99a5-8361d234eaba None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:22.049785 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ca043-5f05-4ddd-99a5-8361d234eaba None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:22.050063 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ca043-5f05-4ddd-99a5-8361d234eaba None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:22.050857 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ca043-5f05-4ddd-99a5-8361d234eaba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:22.051166 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ca043-5f05-4ddd-99a5-8361d234eaba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:22.052833 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ca043-5f05-4ddd-99a5-8361d234eaba None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:22.071227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 618/1225] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:42:22.073291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3662a-cdce-4a90-9850-28d33eee4a97 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:22.191418 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3662a-cdce-4a90-9850-28d33eee4a97 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:22.227613 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971236e-5e54-4f39-999f-60c4eae50db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:22.228811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971236e-5e54-4f39-999f-60c4eae50db0 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:22.228811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971236e-5e54-4f39-999f-60c4eae50db0 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:22.229068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971236e-5e54-4f39-999f-60c4eae50db0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:22.240232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971236e-5e54-4f39-999f-60c4eae50db0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:22.241789 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971236e-5e54-4f39-999f-60c4eae50db0 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:22.257701 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-f971236e-5e54-4f39-999f-60c4eae50db0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 12:42:22.258935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 608/1226] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:22.264997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ca043-5f05-4ddd-99a5-8361d234eaba None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:22.388009 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ca043-5f05-4ddd-99a5-8361d234eaba None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:22.431633 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9fe2d-7a10-4574-9b18-5689499acfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:22.432420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9fe2d-7a10-4574-9b18-5689499acfcb None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:22.432696 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9fe2d-7a10-4574-9b18-5689499acfcb None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:22.432963 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9fe2d-7a10-4574-9b18-5689499acfcb None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:22.433792 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9fe2d-7a10-4574-9b18-5689499acfcb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:22.434093 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9fe2d-7a10-4574-9b18-5689499acfcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:22.435681 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9fe2d-7a10-4574-9b18-5689499acfcb None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:22.455658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 619/1227] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Nov 2 12:42:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:22.467270 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971236e-5e54-4f39-999f-60c4eae50db0 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:22.586644 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971236e-5e54-4f39-999f-60c4eae50db0 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:22.624945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbd1fa-4527-4d16-aafd-5eed9783604e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:22.625801 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbd1fa-4527-4d16-aafd-5eed9783604e None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:22.626093 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbd1fa-4527-4d16-aafd-5eed9783604e None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:22.626347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbd1fa-4527-4d16-aafd-5eed9783604e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:22.638241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbd1fa-4527-4d16-aafd-5eed9783604e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:22.639651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbd1fa-4527-4d16-aafd-5eed9783604e None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:22.657478 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-5bdbd1fa-4527-4d16-aafd-5eed9783604e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:42:22.663990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 609/1228] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:22.665958 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9fe2d-7a10-4574-9b18-5689499acfcb None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:22.773779 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9fe2d-7a10-4574-9b18-5689499acfcb None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:22.816828 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc7ae3-a0e7-4d53-a323-91ecc0b8e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:22.817570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc7ae3-a0e7-4d53-a323-91ecc0b8e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:22.817932 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc7ae3-a0e7-4d53-a323-91ecc0b8e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:22.818304 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc7ae3-a0e7-4d53-a323-91ecc0b8e1b4 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:22.819167 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc7ae3-a0e7-4d53-a323-91ecc0b8e1b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:22.819535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc7ae3-a0e7-4d53-a323-91ecc0b8e1b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:22.821068 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc7ae3-a0e7-4d53-a323-91ecc0b8e1b4 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:22.833793 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 620/1229] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:22.840144 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbd1fa-4527-4d16-aafd-5eed9783604e None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:22.952345 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbd1fa-4527-4d16-aafd-5eed9783604e None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:22.985946 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b1927-7538-470d-9bb4-5a2bf4ca5c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:22.986851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b1927-7538-470d-9bb4-5a2bf4ca5c94 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:22.987083 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b1927-7538-470d-9bb4-5a2bf4ca5c94 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:22.987399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b1927-7538-470d-9bb4-5a2bf4ca5c94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:22.995077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b1927-7538-470d-9bb4-5a2bf4ca5c94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:22.996686 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b1927-7538-470d-9bb4-5a2bf4ca5c94 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:23.011953 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-573b1927-7538-470d-9bb4-5a2bf4ca5c94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:42:23.013300 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 610/1230] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:42:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:23.019655 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc7ae3-a0e7-4d53-a323-91ecc0b8e1b4 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:23.120560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc7ae3-a0e7-4d53-a323-91ecc0b8e1b4 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:23.154236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6c728-4f68-4400-8a37-cb16a166b7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:23.154936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6c728-4f68-4400-8a37-cb16a166b7c9 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:23.155205 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6c728-4f68-4400-8a37-cb16a166b7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:23.155472 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6c728-4f68-4400-8a37-cb16a166b7c9 None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:23.156268 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6c728-4f68-4400-8a37-cb16a166b7c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:23.156603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6c728-4f68-4400-8a37-cb16a166b7c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:23.158132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6c728-4f68-4400-8a37-cb16a166b7c9 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:23.170273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 621/1231] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:23.176821 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b1927-7538-470d-9bb4-5a2bf4ca5c94 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:23.288519 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b1927-7538-470d-9bb4-5a2bf4ca5c94 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:23.326319 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f2ac3-6625-4b65-a585-bbba60890da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:23.327370 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f2ac3-6625-4b65-a585-bbba60890da5 None admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:23.327649 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f2ac3-6625-4b65-a585-bbba60890da5 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:23.327950 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f2ac3-6625-4b65-a585-bbba60890da5 None admin] PATH_INFO: `/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/65e89359a42b4b0592db48f5a5a6e465/roles/63df47d6fc0740e6bc54a845c3f8a257` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:23.347697 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f2ac3-6625-4b65-a585-bbba60890da5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a08ee6d287714297a10248ad8e4522bc, user_id=65e89359a42b4b0592db48f5a5a6e465, role_id=63df47d6fc0740e6bc54a845c3f8a257)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:23.349307 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f2ac3-6625-4b65-a585-bbba60890da5 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:23.363066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 611/1232] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:42:23 2022] PUT /identity/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/65e89359a42b4b0592db48f5a5a6e465/roles/63df47d6fc0740e6bc54a845c3f8a257 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:42:25.796461 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ee7e9-0678-4485-92ab-08b26370f793 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:25.797081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ee7e9-0678-4485-92ab-08b26370f793 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:25.797081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ee7e9-0678-4485-92ab-08b26370f793 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:25.798845 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 622/1233] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:42:25.804715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2934b-19c7-4589-849c-1c80219ee6f6 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:25.805208 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2934b-19c7-4589-849c-1c80219ee6f6 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:25.805390 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2934b-19c7-4589-849c-1c80219ee6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:25.826834 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-2bd2934b-19c7-4589-849c-1c80219ee6f6 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:25.828092 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2bd2934b-19c7-4589-849c-1c80219ee6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:25.900259 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 612/1234] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:42:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:42:25.927140 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ee7e9-0678-4485-92ab-08b26370f793 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:26.034547 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ee7e9-0678-4485-92ab-08b26370f793 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:26.069233 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca3ae2-9a02-48bc-8ea8-e62cdea295e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:26.069998 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca3ae2-9a02-48bc-8ea8-e62cdea295e7 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:26.070273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca3ae2-9a02-48bc-8ea8-e62cdea295e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:26.070536 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca3ae2-9a02-48bc-8ea8-e62cdea295e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:26.080491 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca3ae2-9a02-48bc-8ea8-e62cdea295e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:42:26.087326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-abca3ae2-9a02-48bc-8ea8-e62cdea295e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:42:26.091244 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 623/1235] 10.222.0.90 () {56 vars in 1102 bytes} [Wed Nov 2 12:42:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:26.095121 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2934b-19c7-4589-849c-1c80219ee6f6 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:26.195108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2934b-19c7-4589-849c-1c80219ee6f6 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:26.229424 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84392e-b616-40fd-9c3d-44dbc39a67ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:26.230161 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84392e-b616-40fd-9c3d-44dbc39a67ad None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:26.230436 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84392e-b616-40fd-9c3d-44dbc39a67ad None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:26.230707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84392e-b616-40fd-9c3d-44dbc39a67ad None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:26.231475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84392e-b616-40fd-9c3d-44dbc39a67ad None admin] RBAC: Adding query filter params (name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:26.231850 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84392e-b616-40fd-9c3d-44dbc39a67ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:26.233358 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84392e-b616-40fd-9c3d-44dbc39a67ad None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:26.242530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 613/1236] 10.222.0.90 () {56 vars in 1103 bytes} [Wed Nov 2 12:42:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:26.248836 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca3ae2-9a02-48bc-8ea8-e62cdea295e7 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:26.354037 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca3ae2-9a02-48bc-8ea8-e62cdea295e7 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:26.392082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6c800-4622-42ea-986b-b8a93afcdce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:26.392946 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6c800-4622-42ea-986b-b8a93afcdce1 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:26.393372 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6c800-4622-42ea-986b-b8a93afcdce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:26.393683 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6c800-4622-42ea-986b-b8a93afcdce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:26.406133 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6c800-4622-42ea-986b-b8a93afcdce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:26.407593 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6c800-4622-42ea-986b-b8a93afcdce1 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:26.426769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-54d6c800-4622-42ea-986b-b8a93afcdce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:42:26.434264 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 624/1237] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:26.435725 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84392e-b616-40fd-9c3d-44dbc39a67ad None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:26.553173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84392e-b616-40fd-9c3d-44dbc39a67ad None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:26.588638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a34d20-9b4e-46d6-847c-cb4e03545691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:26.589440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a34d20-9b4e-46d6-847c-cb4e03545691 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:26.589720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a34d20-9b4e-46d6-847c-cb4e03545691 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:26.590045 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a34d20-9b4e-46d6-847c-cb4e03545691 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:26.590778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a34d20-9b4e-46d6-847c-cb4e03545691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:26.591102 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a34d20-9b4e-46d6-847c-cb4e03545691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:26.592591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a34d20-9b4e-46d6-847c-cb4e03545691 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:26.612238 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 614/1238] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:26.618327 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6c800-4622-42ea-986b-b8a93afcdce1 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:26.749258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6c800-4622-42ea-986b-b8a93afcdce1 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:26.790768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877dfb2-6e2c-4601-86fc-21f87246dd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:26.791612 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877dfb2-6e2c-4601-86fc-21f87246dd79 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:26.791888 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877dfb2-6e2c-4601-86fc-21f87246dd79 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:26.792152 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877dfb2-6e2c-4601-86fc-21f87246dd79 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:26.800934 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877dfb2-6e2c-4601-86fc-21f87246dd79 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:26.802405 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877dfb2-6e2c-4601-86fc-21f87246dd79 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:26.820070 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-5877dfb2-6e2c-4601-86fc-21f87246dd79 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 12:42:26.821878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 625/1239] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:26.832621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a34d20-9b4e-46d6-847c-cb4e03545691 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:26.963348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a34d20-9b4e-46d6-847c-cb4e03545691 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:27.001940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94d5ce-f7fc-4bda-95a6-d8f8fcdae384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:27.002629 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94d5ce-f7fc-4bda-95a6-d8f8fcdae384 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:27.003036 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94d5ce-f7fc-4bda-95a6-d8f8fcdae384 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:27.003334 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94d5ce-f7fc-4bda-95a6-d8f8fcdae384 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:27.004499 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94d5ce-f7fc-4bda-95a6-d8f8fcdae384 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:27.004932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94d5ce-f7fc-4bda-95a6-d8f8fcdae384 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:27.006895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94d5ce-f7fc-4bda-95a6-d8f8fcdae384 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:27.025014 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 615/1240] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Nov 2 12:42:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:27.031518 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877dfb2-6e2c-4601-86fc-21f87246dd79 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:27.152695 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877dfb2-6e2c-4601-86fc-21f87246dd79 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:27.189831 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7f877-1d1c-4981-ad85-ac834093c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:27.190596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7f877-1d1c-4981-ad85-ac834093c65c None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:27.190835 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7f877-1d1c-4981-ad85-ac834093c65c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:27.191135 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7f877-1d1c-4981-ad85-ac834093c65c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:27.270763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7f877-1d1c-4981-ad85-ac834093c65c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:27.272126 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7f877-1d1c-4981-ad85-ac834093c65c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:27.374576 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 626/1241] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:42:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:42:27.380512 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94d5ce-f7fc-4bda-95a6-d8f8fcdae384 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:27.488769 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94d5ce-f7fc-4bda-95a6-d8f8fcdae384 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:27.531867 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed202955-93a2-40af-b336-58e7a0ffbbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:27.532636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed202955-93a2-40af-b336-58e7a0ffbbe0 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:27.532914 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed202955-93a2-40af-b336-58e7a0ffbbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:27.533178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed202955-93a2-40af-b336-58e7a0ffbbe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:27.544221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed202955-93a2-40af-b336-58e7a0ffbbe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:27.545866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed202955-93a2-40af-b336-58e7a0ffbbe0 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:27.563192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-ed202955-93a2-40af-b336-58e7a0ffbbe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:42:27.564428 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 616/1242] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:42:27.571500 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7f877-1d1c-4981-ad85-ac834093c65c None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:27.676093 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7f877-1d1c-4981-ad85-ac834093c65c None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:27.710874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9bfc9-28ba-48b3-a897-91b8ebd8ca98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:27.711563 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9bfc9-28ba-48b3-a897-91b8ebd8ca98 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:27.711845 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9bfc9-28ba-48b3-a897-91b8ebd8ca98 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:27.712109 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9bfc9-28ba-48b3-a897-91b8ebd8ca98 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:27.712964 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9bfc9-28ba-48b3-a897-91b8ebd8ca98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:27.713274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9bfc9-28ba-48b3-a897-91b8ebd8ca98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:27.714802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9bfc9-28ba-48b3-a897-91b8ebd8ca98 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:27.727212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 627/1243] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:27.733384 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed202955-93a2-40af-b336-58e7a0ffbbe0 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:27.835064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed202955-93a2-40af-b336-58e7a0ffbbe0 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:27.872210 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62d163-ebb1-4a4d-890d-0537703dd937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:27.873111 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62d163-ebb1-4a4d-890d-0537703dd937 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:27.873400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62d163-ebb1-4a4d-890d-0537703dd937 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:27.873670 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62d163-ebb1-4a4d-890d-0537703dd937 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:27.880956 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62d163-ebb1-4a4d-890d-0537703dd937 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:27.882623 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62d163-ebb1-4a4d-890d-0537703dd937 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:27.897063 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-df62d163-ebb1-4a4d-890d-0537703dd937 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:42:27.898878 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 617/1244] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:42:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:27.905313 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9bfc9-28ba-48b3-a897-91b8ebd8ca98 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:28.016810 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9bfc9-28ba-48b3-a897-91b8ebd8ca98 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:28.054820 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbae6d7-21d1-4a2b-bb35-a59579e93227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:28.055514 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbae6d7-21d1-4a2b-bb35-a59579e93227 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:28.055834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbae6d7-21d1-4a2b-bb35-a59579e93227 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:28.056102 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbae6d7-21d1-4a2b-bb35-a59579e93227 None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:28.056928 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbae6d7-21d1-4a2b-bb35-a59579e93227 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:28.057352 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbae6d7-21d1-4a2b-bb35-a59579e93227 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:28.058846 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbae6d7-21d1-4a2b-bb35-a59579e93227 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:28.072078 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 628/1245] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:42:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:28.079246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62d163-ebb1-4a4d-890d-0537703dd937 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:28.197929 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62d163-ebb1-4a4d-890d-0537703dd937 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:28.236616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1b3b8-0e10-49dd-ab6b-c09c77f187c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:28.237380 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1b3b8-0e10-49dd-ab6b-c09c77f187c7 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:28.237654 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1b3b8-0e10-49dd-ab6b-c09c77f187c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:28.237918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1b3b8-0e10-49dd-ab6b-c09c77f187c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:28.238777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1b3b8-0e10-49dd-ab6b-c09c77f187c7 None admin] RBAC: Adding query filter params (role.id=63df47d6fc0740e6bc54a845c3f8a257, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=65e89359a42b4b0592db48f5a5a6e465) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:28.239094 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1b3b8-0e10-49dd-ab6b-c09c77f187c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:28.240629 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1b3b8-0e10-49dd-ab6b-c09c77f187c7 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:28.247144 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 618/1246] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:42:28 2022] GET /identity/v3/role_assignments?user.id=65e89359a42b4b0592db48f5a5a6e465&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=63df47d6fc0740e6bc54a845c3f8a257 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:30.740882 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902da67-59e1-4c96-a7c2-e12aa60244f6 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:30.741430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902da67-59e1-4c96-a7c2-e12aa60244f6 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:30.741430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902da67-59e1-4c96-a7c2-e12aa60244f6 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:30.743132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 629/1247] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:42:30.749230 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4ad5-1ea9-4925-9fde-4ad49c8a99ad None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:30.749781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4ad5-1ea9-4925-9fde-4ad49c8a99ad None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:30.749781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4ad5-1ea9-4925-9fde-4ad49c8a99ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:30.768818 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-912f4ad5-1ea9-4925-9fde-4ad49c8a99ad None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:30.770114 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-912f4ad5-1ea9-4925-9fde-4ad49c8a99ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:30.849820 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 619/1248] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:42:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:42:30.876644 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902da67-59e1-4c96-a7c2-e12aa60244f6 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:30.985407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902da67-59e1-4c96-a7c2-e12aa60244f6 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:31.021736 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ce179-2805-49b2-a80a-528487945544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:31.022464 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ce179-2805-49b2-a80a-528487945544 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:31.022741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ce179-2805-49b2-a80a-528487945544 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:31.023010 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ce179-2805-49b2-a80a-528487945544 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:31.035642 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ce179-2805-49b2-a80a-528487945544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:42:31.042799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-0c4ce179-2805-49b2-a80a-528487945544 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:42:31.044014 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 630/1249] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:42:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:31.050205 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4ad5-1ea9-4925-9fde-4ad49c8a99ad None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:31.155773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4ad5-1ea9-4925-9fde-4ad49c8a99ad None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:31.193954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd6ad8-6326-4ee8-a959-dfaf7e07a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:31.194707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd6ad8-6326-4ee8-a959-dfaf7e07a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:31.194981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd6ad8-6326-4ee8-a959-dfaf7e07a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:31.195247 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd6ad8-6326-4ee8-a959-dfaf7e07a6a5 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:31.196053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd6ad8-6326-4ee8-a959-dfaf7e07a6a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:31.196393 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd6ad8-6326-4ee8-a959-dfaf7e07a6a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:31.197922 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd6ad8-6326-4ee8-a959-dfaf7e07a6a5 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:31.207552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 620/1250] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:42:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:31.213372 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ce179-2805-49b2-a80a-528487945544 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:31.322814 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ce179-2805-49b2-a80a-528487945544 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:31.359344 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67de572-7e3c-4ca1-9f74-d10966e09773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:31.360255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67de572-7e3c-4ca1-9f74-d10966e09773 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:31.360533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67de572-7e3c-4ca1-9f74-d10966e09773 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:31.360804 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67de572-7e3c-4ca1-9f74-d10966e09773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:31.372298 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67de572-7e3c-4ca1-9f74-d10966e09773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:31.374101 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67de572-7e3c-4ca1-9f74-d10966e09773 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:31.390263 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-b67de572-7e3c-4ca1-9f74-d10966e09773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:42:31.391976 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 631/1251] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:31.399619 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd6ad8-6326-4ee8-a959-dfaf7e07a6a5 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:31.522696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd6ad8-6326-4ee8-a959-dfaf7e07a6a5 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:31.558793 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c9dc8-dfb5-4f3b-b275-114ecbba410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:31.559486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c9dc8-dfb5-4f3b-b275-114ecbba410e None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:31.559761 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c9dc8-dfb5-4f3b-b275-114ecbba410e None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:31.560029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c9dc8-dfb5-4f3b-b275-114ecbba410e None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:31.561015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c9dc8-dfb5-4f3b-b275-114ecbba410e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:31.561311 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c9dc8-dfb5-4f3b-b275-114ecbba410e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:31.562693 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c9dc8-dfb5-4f3b-b275-114ecbba410e None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:31.574818 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 621/1252] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:31.580786 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67de572-7e3c-4ca1-9f74-d10966e09773 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:31.690375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67de572-7e3c-4ca1-9f74-d10966e09773 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:31.727738 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae46417-a8ae-4282-bd95-c334315b7aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:31.728633 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae46417-a8ae-4282-bd95-c334315b7aed None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:31.728950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae46417-a8ae-4282-bd95-c334315b7aed None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:31.729181 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae46417-a8ae-4282-bd95-c334315b7aed None admin] PATH_INFO: `/v3/users/placement` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:31.738378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae46417-a8ae-4282-bd95-c334315b7aed None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:31.740305 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae46417-a8ae-4282-bd95-c334315b7aed None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:31.757284 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-cae46417-a8ae-4282-bd95-c334315b7aed None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 12:42:31.758467 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 632/1253] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:31.766003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c9dc8-dfb5-4f3b-b275-114ecbba410e None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:31.877407 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c9dc8-dfb5-4f3b-b275-114ecbba410e None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:31.914754 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51674464-8e47-4976-aea6-4f5026fe8130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:31.915443 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51674464-8e47-4976-aea6-4f5026fe8130 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:31.915700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51674464-8e47-4976-aea6-4f5026fe8130 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:31.915976 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51674464-8e47-4976-aea6-4f5026fe8130 None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:31.916995 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51674464-8e47-4976-aea6-4f5026fe8130 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:31.917431 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51674464-8e47-4976-aea6-4f5026fe8130 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:31.918716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51674464-8e47-4976-aea6-4f5026fe8130 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:31.938082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 622/1254] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Nov 2 12:42:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:31.945357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae46417-a8ae-4282-bd95-c334315b7aed None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:32.062162 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae46417-a8ae-4282-bd95-c334315b7aed None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:32.098393 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb12ea0-1fae-4f9b-ace9-887ea9b6d2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:32.099049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb12ea0-1fae-4f9b-ace9-887ea9b6d2fd None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:32.099328 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb12ea0-1fae-4f9b-ace9-887ea9b6d2fd None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:32.099636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb12ea0-1fae-4f9b-ace9-887ea9b6d2fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:32.177321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb12ea0-1fae-4f9b-ace9-887ea9b6d2fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:32.178794 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb12ea0-1fae-4f9b-ace9-887ea9b6d2fd None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:32.285516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 633/1255] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:42:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:42:32.291499 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51674464-8e47-4976-aea6-4f5026fe8130 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:32.401094 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51674464-8e47-4976-aea6-4f5026fe8130 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:32.436365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce65d5-3962-4191-9fba-152225df4eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:32.437098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce65d5-3962-4191-9fba-152225df4eaf None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:32.437377 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce65d5-3962-4191-9fba-152225df4eaf None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:32.437646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce65d5-3962-4191-9fba-152225df4eaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:32.449552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce65d5-3962-4191-9fba-152225df4eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:32.451353 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce65d5-3962-4191-9fba-152225df4eaf None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:32.475829 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-a3ce65d5-3962-4191-9fba-152225df4eaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:42:32.477935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 623/1256] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:32.486990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb12ea0-1fae-4f9b-ace9-887ea9b6d2fd None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:32.596001 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb12ea0-1fae-4f9b-ace9-887ea9b6d2fd None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:32.630463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c5163-52e8-4ab5-bb76-96fecbf00237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:32.631129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c5163-52e8-4ab5-bb76-96fecbf00237 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:32.631368 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c5163-52e8-4ab5-bb76-96fecbf00237 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:32.631640 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c5163-52e8-4ab5-bb76-96fecbf00237 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:32.632384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c5163-52e8-4ab5-bb76-96fecbf00237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:32.632722 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c5163-52e8-4ab5-bb76-96fecbf00237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:32.634081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c5163-52e8-4ab5-bb76-96fecbf00237 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:32.645718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 634/1257] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:32.651880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce65d5-3962-4191-9fba-152225df4eaf None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:32.753637 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce65d5-3962-4191-9fba-152225df4eaf None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:32.786175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a283df-791a-4363-b2ab-fedcffc41187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:32.786960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a283df-791a-4363-b2ab-fedcffc41187 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:32.787240 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a283df-791a-4363-b2ab-fedcffc41187 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:32.787511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a283df-791a-4363-b2ab-fedcffc41187 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:32.794157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a283df-791a-4363-b2ab-fedcffc41187 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:32.795660 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a283df-791a-4363-b2ab-fedcffc41187 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:32.808887 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-00a283df-791a-4363-b2ab-fedcffc41187 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:42:32.810054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 624/1258] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:42:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:32.816938 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c5163-52e8-4ab5-bb76-96fecbf00237 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:32.916805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c5163-52e8-4ab5-bb76-96fecbf00237 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:32.952146 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cb2f7-da5f-4236-b4ce-ec72bffff139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:32.952819 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cb2f7-da5f-4236-b4ce-ec72bffff139 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:32.953099 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cb2f7-da5f-4236-b4ce-ec72bffff139 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:32.953373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cb2f7-da5f-4236-b4ce-ec72bffff139 None admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:32.954162 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cb2f7-da5f-4236-b4ce-ec72bffff139 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:32.954470 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cb2f7-da5f-4236-b4ce-ec72bffff139 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:32.955895 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cb2f7-da5f-4236-b4ce-ec72bffff139 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:32.967855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 635/1259] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:42:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:32.974255 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a283df-791a-4363-b2ab-fedcffc41187 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:33.094438 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a283df-791a-4363-b2ab-fedcffc41187 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:33.128883 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd848d-277f-4e65-bdaa-24263a1f910a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:33.129517 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd848d-277f-4e65-bdaa-24263a1f910a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:33.129788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd848d-277f-4e65-bdaa-24263a1f910a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:33.130057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd848d-277f-4e65-bdaa-24263a1f910a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:33.130868 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd848d-277f-4e65-bdaa-24263a1f910a None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=65e89359a42b4b0592db48f5a5a6e465) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:33.131177 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd848d-277f-4e65-bdaa-24263a1f910a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:33.132636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd848d-277f-4e65-bdaa-24263a1f910a None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:33.138071 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 625/1260] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:42:32 2022] GET /identity/v3/role_assignments?user.id=65e89359a42b4b0592db48f5a5a6e465&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=85136c55809b4d9db97c263a72392ad1 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:35.427125 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c35dca-75df-46bd-a46e-4e643e082dcd None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:35.428019 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c35dca-75df-46bd-a46e-4e643e082dcd None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:35.428019 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c35dca-75df-46bd-a46e-4e643e082dcd None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:35.430962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 636/1261] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:42:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:42:35.439348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf7e9-45f7-4a0b-8b66-e33d379a1375 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:35.439994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf7e9-45f7-4a0b-8b66-e33d379a1375 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:35.440110 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf7e9-45f7-4a0b-8b66-e33d379a1375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:35.465583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-40acf7e9-45f7-4a0b-8b66-e33d379a1375 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:35.466940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-40acf7e9-45f7-4a0b-8b66-e33d379a1375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:35.537121 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 626/1262] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:42:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:42:35.559615 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c35dca-75df-46bd-a46e-4e643e082dcd None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:35.677696 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c35dca-75df-46bd-a46e-4e643e082dcd None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:35.718676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819467e-88dd-49d1-bbed-d15968e5b308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:35.719473 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819467e-88dd-49d1-bbed-d15968e5b308 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:35.719749 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819467e-88dd-49d1-bbed-d15968e5b308 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:35.720023 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819467e-88dd-49d1-bbed-d15968e5b308 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:35.730245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819467e-88dd-49d1-bbed-d15968e5b308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:42:35.737104 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-d819467e-88dd-49d1-bbed-d15968e5b308 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:42:35.738312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 637/1263] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:42:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:35.744973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acf7e9-45f7-4a0b-8b66-e33d379a1375 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:35.842069 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acf7e9-45f7-4a0b-8b66-e33d379a1375 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:35.874215 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4cdc8-ec13-40ae-9542-e4abcf329473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:35.874858 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4cdc8-ec13-40ae-9542-e4abcf329473 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:35.875134 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4cdc8-ec13-40ae-9542-e4abcf329473 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:35.875404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4cdc8-ec13-40ae-9542-e4abcf329473 None admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:35.876144 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4cdc8-ec13-40ae-9542-e4abcf329473 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:35.876476 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4cdc8-ec13-40ae-9542-e4abcf329473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:35.877839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4cdc8-ec13-40ae-9542-e4abcf329473 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:35.885694 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 627/1264] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:42:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:35.891720 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819467e-88dd-49d1-bbed-d15968e5b308 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:36.006610 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819467e-88dd-49d1-bbed-d15968e5b308 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:36.050551 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd46ff-74a1-4d78-892b-7c1153465d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:36.051337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd46ff-74a1-4d78-892b-7c1153465d4e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:36.051617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd46ff-74a1-4d78-892b-7c1153465d4e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:36.051888 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd46ff-74a1-4d78-892b-7c1153465d4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:36.062634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd46ff-74a1-4d78-892b-7c1153465d4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:36.064088 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd46ff-74a1-4d78-892b-7c1153465d4e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:36.079844 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-67fd46ff-74a1-4d78-892b-7c1153465d4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:42:36.081022 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 638/1265] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:36.087330 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4cdc8-ec13-40ae-9542-e4abcf329473 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:36.192135 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4cdc8-ec13-40ae-9542-e4abcf329473 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:36.224762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e572199-1cbd-4ec9-bb6a-bc2b738830d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:36.225374 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572199-1cbd-4ec9-bb6a-bc2b738830d8 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:36.225648 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572199-1cbd-4ec9-bb6a-bc2b738830d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:36.225911 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572199-1cbd-4ec9-bb6a-bc2b738830d8 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:36.226621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e572199-1cbd-4ec9-bb6a-bc2b738830d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:36.226920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e572199-1cbd-4ec9-bb6a-bc2b738830d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:36.228305 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e572199-1cbd-4ec9-bb6a-bc2b738830d8 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:36.240985 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 628/1266] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:36.248437 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd46ff-74a1-4d78-892b-7c1153465d4e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:36.353512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd46ff-74a1-4d78-892b-7c1153465d4e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:36.387999 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e01c2-954c-4bd7-9757-ad59d844ed5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:36.389112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e01c2-954c-4bd7-9757-ad59d844ed5a None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:36.389458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e01c2-954c-4bd7-9757-ad59d844ed5a None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:36.389842 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e01c2-954c-4bd7-9757-ad59d844ed5a None admin] PATH_INFO: `/v3/users/placement` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:36.397516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e01c2-954c-4bd7-9757-ad59d844ed5a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:36.399327 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e01c2-954c-4bd7-9757-ad59d844ed5a None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:36.412851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-9a3e01c2-954c-4bd7-9757-ad59d844ed5a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 12:42:36.413987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 639/1267] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:36.420979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e572199-1cbd-4ec9-bb6a-bc2b738830d8 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:36.550552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e572199-1cbd-4ec9-bb6a-bc2b738830d8 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:36.585602 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b0c2b-dac8-45b8-baec-66beb14cb3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:36.586263 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b0c2b-dac8-45b8-baec-66beb14cb3de None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:36.586540 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b0c2b-dac8-45b8-baec-66beb14cb3de None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:36.586816 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b0c2b-dac8-45b8-baec-66beb14cb3de None admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:36.587637 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b0c2b-dac8-45b8-baec-66beb14cb3de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:36.587940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b0c2b-dac8-45b8-baec-66beb14cb3de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:36.589419 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b0c2b-dac8-45b8-baec-66beb14cb3de None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:36.607844 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 629/1268] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Nov 2 12:42:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:36.614714 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e01c2-954c-4bd7-9757-ad59d844ed5a None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:36.730512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e01c2-954c-4bd7-9757-ad59d844ed5a None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:36.764722 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4787289-45a8-4eb9-adc5-d42e75c005cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:36.765508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4787289-45a8-4eb9-adc5-d42e75c005cd None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:36.765783 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4787289-45a8-4eb9-adc5-d42e75c005cd None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:36.766137 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4787289-45a8-4eb9-adc5-d42e75c005cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:36.777273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4787289-45a8-4eb9-adc5-d42e75c005cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:36.778705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4787289-45a8-4eb9-adc5-d42e75c005cd None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:36.795166 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-a4787289-45a8-4eb9-adc5-d42e75c005cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:42:36.796331 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 640/1269] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:36.805569 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b0c2b-dac8-45b8-baec-66beb14cb3de None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:36.916805 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b0c2b-dac8-45b8-baec-66beb14cb3de None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:36.959409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bc944-e52d-46bc-bdc4-26cbf0cf726b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:36.960457 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bc944-e52d-46bc-bdc4-26cbf0cf726b None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:36.960907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bc944-e52d-46bc-bdc4-26cbf0cf726b None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:36.961348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bc944-e52d-46bc-bdc4-26cbf0cf726b None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:36.962512 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bc944-e52d-46bc-bdc4-26cbf0cf726b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:36.963016 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bc944-e52d-46bc-bdc4-26cbf0cf726b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:36.965229 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bc944-e52d-46bc-bdc4-26cbf0cf726b None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:36.977517 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 630/1270] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:36.983487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4787289-45a8-4eb9-adc5-d42e75c005cd None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:37.105761 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4787289-45a8-4eb9-adc5-d42e75c005cd None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:37.141990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6f3d9-51da-4e1d-a244-583872e2175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:37.142786 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6f3d9-51da-4e1d-a244-583872e2175d None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:37.143075 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6f3d9-51da-4e1d-a244-583872e2175d None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:37.143347 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6f3d9-51da-4e1d-a244-583872e2175d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:37.150365 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6f3d9-51da-4e1d-a244-583872e2175d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:37.151811 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6f3d9-51da-4e1d-a244-583872e2175d None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:37.164988 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-c2b6f3d9-51da-4e1d-a244-583872e2175d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:42:37.166173 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 641/1271] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:37.173480 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bc944-e52d-46bc-bdc4-26cbf0cf726b None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:37.283339 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bc944-e52d-46bc-bdc4-26cbf0cf726b None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:37.317762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bf95d-d8d1-47a0-a7da-4070c32c5fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:37.318407 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bf95d-d8d1-47a0-a7da-4070c32c5fc0 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:37.318682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bf95d-d8d1-47a0-a7da-4070c32c5fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:37.318951 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bf95d-d8d1-47a0-a7da-4070c32c5fc0 None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:37.319719 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bf95d-d8d1-47a0-a7da-4070c32c5fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:37.320027 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bf95d-d8d1-47a0-a7da-4070c32c5fc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:37.321472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bf95d-d8d1-47a0-a7da-4070c32c5fc0 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:37.335463 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 631/1272] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:42:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:37.341684 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6f3d9-51da-4e1d-a244-583872e2175d None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:37.444788 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6f3d9-51da-4e1d-a244-583872e2175d None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:37.486363 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573238a-886c-4d1c-aca6-e5998cce4606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:37.487340 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573238a-886c-4d1c-aca6-e5998cce4606 None admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:37.487623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573238a-886c-4d1c-aca6-e5998cce4606 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:37.487894 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573238a-886c-4d1c-aca6-e5998cce4606 None admin] PATH_INFO: `/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/65e89359a42b4b0592db48f5a5a6e465/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:37.489956 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573238a-886c-4d1c-aca6-e5998cce4606 None admin] RBAC: Authorizing `identity:create_grant(project_id=a08ee6d287714297a10248ad8e4522bc, user_id=65e89359a42b4b0592db48f5a5a6e465, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:37.491403 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573238a-886c-4d1c-aca6-e5998cce4606 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:37.507880 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 642/1273] 10.222.0.90 () {58 vars in 1439 bytes} [Wed Nov 2 12:42:37 2022] PUT /identity/v3/projects/a08ee6d287714297a10248ad8e4522bc/users/65e89359a42b4b0592db48f5a5a6e465/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:42:39.828051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0113c5-5d9e-4009-98ea-431ac1eb44f1 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:39.828623 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0113c5-5d9e-4009-98ea-431ac1eb44f1 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:39.828623 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0113c5-5d9e-4009-98ea-431ac1eb44f1 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:39.830383 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 632/1274] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:42:39.836870 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88a92d-4465-4281-afb4-1274d92272c3 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:39.837595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88a92d-4465-4281-afb4-1274d92272c3 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:39.837745 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88a92d-4465-4281-afb4-1274d92272c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:39.857641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-af88a92d-4465-4281-afb4-1274d92272c3 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:39.858866 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-af88a92d-4465-4281-afb4-1274d92272c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:39.926525 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 643/1275] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:42:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:42:39.965877 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0113c5-5d9e-4009-98ea-431ac1eb44f1 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:40.072780 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0113c5-5d9e-4009-98ea-431ac1eb44f1 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:40.107112 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f5429-260d-4e02-981e-4fbf07d051c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:40.107942 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f5429-260d-4e02-981e-4fbf07d051c7 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:40.108230 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f5429-260d-4e02-981e-4fbf07d051c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:40.108506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f5429-260d-4e02-981e-4fbf07d051c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:40.119146 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f5429-260d-4e02-981e-4fbf07d051c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:42:40.125900 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-ea4f5429-260d-4e02-981e-4fbf07d051c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:42:40.127079 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 633/1276] 10.222.0.90 () {56 vars in 1096 bytes} [Wed Nov 2 12:42:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:40.133511 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88a92d-4465-4281-afb4-1274d92272c3 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:40.232243 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88a92d-4465-4281-afb4-1274d92272c3 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:40.273072 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025473b5-1422-459c-8ba7-c7dc0e7cb9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:40.274454 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025473b5-1422-459c-8ba7-c7dc0e7cb9e3 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:40.274851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025473b5-1422-459c-8ba7-c7dc0e7cb9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:40.275222 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025473b5-1422-459c-8ba7-c7dc0e7cb9e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:40.276463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025473b5-1422-459c-8ba7-c7dc0e7cb9e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:40.276884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025473b5-1422-459c-8ba7-c7dc0e7cb9e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:40.279053 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025473b5-1422-459c-8ba7-c7dc0e7cb9e3 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:40.294861 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 644/1277] 10.222.0.90 () {56 vars in 1099 bytes} [Wed Nov 2 12:42:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:40.301161 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f5429-260d-4e02-981e-4fbf07d051c7 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:40.413350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f5429-260d-4e02-981e-4fbf07d051c7 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:40.446830 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658c951-7b56-4f55-aa1e-1329f3c45f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:40.447613 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658c951-7b56-4f55-aa1e-1329f3c45f3a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:40.447893 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658c951-7b56-4f55-aa1e-1329f3c45f3a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:40.448159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658c951-7b56-4f55-aa1e-1329f3c45f3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:40.458590 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658c951-7b56-4f55-aa1e-1329f3c45f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:40.460085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658c951-7b56-4f55-aa1e-1329f3c45f3a None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:40.478789 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-e658c951-7b56-4f55-aa1e-1329f3c45f3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:42:40.480346 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 634/1278] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:40.487113 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025473b5-1422-459c-8ba7-c7dc0e7cb9e3 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:40.611442 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025473b5-1422-459c-8ba7-c7dc0e7cb9e3 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:40.649503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53c8a3-ea4e-4450-a93a-dd40c169e676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:40.650527 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53c8a3-ea4e-4450-a93a-dd40c169e676 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:40.650979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53c8a3-ea4e-4450-a93a-dd40c169e676 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:40.651360 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53c8a3-ea4e-4450-a93a-dd40c169e676 None admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:40.652349 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53c8a3-ea4e-4450-a93a-dd40c169e676 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:40.652725 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53c8a3-ea4e-4450-a93a-dd40c169e676 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:40.654881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53c8a3-ea4e-4450-a93a-dd40c169e676 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:40.666823 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 645/1279] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:40.676163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658c951-7b56-4f55-aa1e-1329f3c45f3a None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:40.805081 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658c951-7b56-4f55-aa1e-1329f3c45f3a None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:40.843741 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdf164-f1e8-41db-86a1-eb380e809a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:40.844570 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdf164-f1e8-41db-86a1-eb380e809a85 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:40.844827 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdf164-f1e8-41db-86a1-eb380e809a85 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:40.845131 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdf164-f1e8-41db-86a1-eb380e809a85 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:40.854794 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdf164-f1e8-41db-86a1-eb380e809a85 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:40.857078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdf164-f1e8-41db-86a1-eb380e809a85 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:40.871757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-bbbdf164-f1e8-41db-86a1-eb380e809a85 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 12:42:40.872969 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 635/1280] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:40.879687 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53c8a3-ea4e-4450-a93a-dd40c169e676 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:40.982457 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53c8a3-ea4e-4450-a93a-dd40c169e676 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:41.015496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85918c97-7dbf-4a5b-948f-b7ce583c56ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:41.016257 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85918c97-7dbf-4a5b-948f-b7ce583c56ea None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:41.016535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85918c97-7dbf-4a5b-948f-b7ce583c56ea None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:41.016835 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85918c97-7dbf-4a5b-948f-b7ce583c56ea None admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:41.017691 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85918c97-7dbf-4a5b-948f-b7ce583c56ea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:41.017996 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85918c97-7dbf-4a5b-948f-b7ce583c56ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:41.019408 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85918c97-7dbf-4a5b-948f-b7ce583c56ea None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:41.036519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 646/1281] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Nov 2 12:42:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:41.042661 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdf164-f1e8-41db-86a1-eb380e809a85 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:41.146171 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdf164-f1e8-41db-86a1-eb380e809a85 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:41.180261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92b75f-4a4c-4e0d-9cd1-0c3816e04d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:41.181162 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92b75f-4a4c-4e0d-9cd1-0c3816e04d3d None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:41.181573 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92b75f-4a4c-4e0d-9cd1-0c3816e04d3d None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:41.181977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92b75f-4a4c-4e0d-9cd1-0c3816e04d3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:41.267000 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92b75f-4a4c-4e0d-9cd1-0c3816e04d3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:41.268466 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92b75f-4a4c-4e0d-9cd1-0c3816e04d3d None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:41.374062 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 636/1282] 10.222.0.90 () {58 vars in 1282 bytes} [Wed Nov 2 12:42:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:42:41.380663 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85918c97-7dbf-4a5b-948f-b7ce583c56ea None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:41.495748 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85918c97-7dbf-4a5b-948f-b7ce583c56ea None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:41.529602 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500727e-dc88-40c0-9807-c311543da890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:41.530320 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500727e-dc88-40c0-9807-c311543da890 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:41.530598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500727e-dc88-40c0-9807-c311543da890 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:41.530865 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500727e-dc88-40c0-9807-c311543da890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:41.546256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500727e-dc88-40c0-9807-c311543da890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:41.547701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500727e-dc88-40c0-9807-c311543da890 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:41.565270 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-1500727e-dc88-40c0-9807-c311543da890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:42:41.566435 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 647/1283] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:41.572436 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92b75f-4a4c-4e0d-9cd1-0c3816e04d3d None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:41.682512 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92b75f-4a4c-4e0d-9cd1-0c3816e04d3d None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:41.720369 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8adca-faa1-40ef-b150-b3dc454ded66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:41.721123 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8adca-faa1-40ef-b150-b3dc454ded66 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:41.721462 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8adca-faa1-40ef-b150-b3dc454ded66 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:41.721737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8adca-faa1-40ef-b150-b3dc454ded66 None admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:41.722490 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8adca-faa1-40ef-b150-b3dc454ded66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:41.722792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8adca-faa1-40ef-b150-b3dc454ded66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:41.724258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8adca-faa1-40ef-b150-b3dc454ded66 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:41.736928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 637/1284] 10.222.0.90 () {56 vars in 1109 bytes} [Wed Nov 2 12:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:41.747250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500727e-dc88-40c0-9807-c311543da890 None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:41.857191 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500727e-dc88-40c0-9807-c311543da890 None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:41.893652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e4c75-1561-46d5-a89f-9b67801dfa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:41.894435 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e4c75-1561-46d5-a89f-9b67801dfa0f None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:41.894710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e4c75-1561-46d5-a89f-9b67801dfa0f None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:41.894979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e4c75-1561-46d5-a89f-9b67801dfa0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:41.902542 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e4c75-1561-46d5-a89f-9b67801dfa0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:41.903974 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e4c75-1561-46d5-a89f-9b67801dfa0f None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:41.917512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING keystone.server.flask.application [None req-021e4c75-1561-46d5-a89f-9b67801dfa0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:42:41.918827 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 648/1285] 10.222.0.90 () {56 vars in 1111 bytes} [Wed Nov 2 12:42:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:41.928140 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8adca-faa1-40ef-b150-b3dc454ded66 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:42.029439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8adca-faa1-40ef-b150-b3dc454ded66 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:42.066984 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694658d-cec4-4e99-ba59-cf3d7d48043a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:42.067628 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694658d-cec4-4e99-ba59-cf3d7d48043a None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:42.067906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694658d-cec4-4e99-ba59-cf3d7d48043a None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:42.068177 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694658d-cec4-4e99-ba59-cf3d7d48043a None admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:42.068977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694658d-cec4-4e99-ba59-cf3d7d48043a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:42.069283 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694658d-cec4-4e99-ba59-cf3d7d48043a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:42.070715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694658d-cec4-4e99-ba59-cf3d7d48043a None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:42.082639 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 638/1286] 10.222.0.90 () {56 vars in 1148 bytes} [Wed Nov 2 12:42:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:42.089765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e4c75-1561-46d5-a89f-9b67801dfa0f None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:42.203532 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e4c75-1561-46d5-a89f-9b67801dfa0f None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:42.238394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7176a-0c32-4d7c-a38b-786709fb7b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:42.239147 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7176a-0c32-4d7c-a38b-786709fb7b7c None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:42.239421 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7176a-0c32-4d7c-a38b-786709fb7b7c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:42.239692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7176a-0c32-4d7c-a38b-786709fb7b7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:42.240543 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7176a-0c32-4d7c-a38b-786709fb7b7c None admin] RBAC: Adding query filter params (role.id=85136c55809b4d9db97c263a72392ad1, scope.project.id=a08ee6d287714297a10248ad8e4522bc, user.id=65e89359a42b4b0592db48f5a5a6e465) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:42.240852 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7176a-0c32-4d7c-a38b-786709fb7b7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:42.242319 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7176a-0c32-4d7c-a38b-786709fb7b7c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:42.248912 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 649/1287] 10.222.0.90 () {56 vars in 1374 bytes} [Wed Nov 2 12:42:42 2022] GET /identity/v3/role_assignments?user.id=65e89359a42b4b0592db48f5a5a6e465&scope.project.id=a08ee6d287714297a10248ad8e4522bc&role.id=85136c55809b4d9db97c263a72392ad1 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:42:44.600905 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8e372-b990-4fa4-b82b-6dea0d472e86 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:44.601732 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8e372-b990-4fa4-b82b-6dea0d472e86 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:44.601732 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8e372-b990-4fa4-b82b-6dea0d472e86 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:44.605574 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 639/1288] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:42:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:42:44.611512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e0e7-fff6-4d1c-858c-056cd0432785 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:44.611924 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e0e7-fff6-4d1c-858c-056cd0432785 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:44.612030 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e0e7-fff6-4d1c-858c-056cd0432785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:44.630816 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-9a25e0e7-fff6-4d1c-858c-056cd0432785 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:44.632012 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-9a25e0e7-fff6-4d1c-858c-056cd0432785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:44.706628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 650/1289] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:42:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:42:44.730382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8e372-b990-4fa4-b82b-6dea0d472e86 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:44.845717 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8e372-b990-4fa4-b82b-6dea0d472e86 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:44.879276 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba30f39-2b38-4de8-9732-6e450fd96ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:44.880075 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba30f39-2b38-4de8-9732-6e450fd96ef9 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:44.880382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba30f39-2b38-4de8-9732-6e450fd96ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:44.880654 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba30f39-2b38-4de8-9732-6e450fd96ef9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:44.881320 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba30f39-2b38-4de8-9732-6e450fd96ef9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:44.882690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba30f39-2b38-4de8-9732-6e450fd96ef9 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:44.895690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-1ba30f39-2b38-4de8-9732-6e450fd96ef9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 12:42:44.896895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 640/1290] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Nov 2 12:42:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:44.903964 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25e0e7-fff6-4d1c-858c-056cd0432785 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:45.003801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25e0e7-fff6-4d1c-858c-056cd0432785 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:45.042194 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b07b3c-a86f-4d54-ac54-eca14baf9fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:45.042908 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b07b3c-a86f-4d54-ac54-eca14baf9fd5 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:45.043186 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b07b3c-a86f-4d54-ac54-eca14baf9fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:45.043455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b07b3c-a86f-4d54-ac54-eca14baf9fd5 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:45.044163 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b07b3c-a86f-4d54-ac54-eca14baf9fd5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:45.044503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b07b3c-a86f-4d54-ac54-eca14baf9fd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:45.045927 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b07b3c-a86f-4d54-ac54-eca14baf9fd5 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:45.051042 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 651/1291] 10.222.0.90 () {56 vars in 1116 bytes} [Wed Nov 2 12:42:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:45.057919 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba30f39-2b38-4de8-9732-6e450fd96ef9 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:45.164512 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba30f39-2b38-4de8-9732-6e450fd96ef9 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:45.196533 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c25c2-7a6a-487b-84ad-ad85c8bedc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:45.197213 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c25c2-7a6a-487b-84ad-ad85c8bedc43 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:45.197512 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c25c2-7a6a-487b-84ad-ad85c8bedc43 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:45.197814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c25c2-7a6a-487b-84ad-ad85c8bedc43 None admin] PATH_INFO: `/v3/services` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:45.198651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c25c2-7a6a-487b-84ad-ad85c8bedc43 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:45.198975 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c25c2-7a6a-487b-84ad-ad85c8bedc43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:45.200393 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c25c2-7a6a-487b-84ad-ad85c8bedc43 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:45.204840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 641/1292] 10.222.0.90 () {56 vars in 1116 bytes} [Wed Nov 2 12:42:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:47.514243 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4e7d1-4c65-4082-9aba-79f32960e4f3 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:47.514801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4e7d1-4c65-4082-9aba-79f32960e4f3 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:47.514894 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4e7d1-4c65-4082-9aba-79f32960e4f3 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:47.517319 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 652/1293] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:42:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:42:47.524881 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed984eb-8035-4d6d-b495-8d3fae705e2e None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:47.525284 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed984eb-8035-4d6d-b495-8d3fae705e2e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:47.525534 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed984eb-8035-4d6d-b495-8d3fae705e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:47.545668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-aed984eb-8035-4d6d-b495-8d3fae705e2e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:47.546853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-aed984eb-8035-4d6d-b495-8d3fae705e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:47.620622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 642/1294] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:42:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:42:47.644669 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4e7d1-4c65-4082-9aba-79f32960e4f3 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:47.747527 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4e7d1-4c65-4082-9aba-79f32960e4f3 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:47.787411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80343739-14e6-44ce-a2cc-173d586c3036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:47.788066 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80343739-14e6-44ce-a2cc-173d586c3036 None admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:47.788391 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80343739-14e6-44ce-a2cc-173d586c3036 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:47.788652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80343739-14e6-44ce-a2cc-173d586c3036 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:47.789382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80343739-14e6-44ce-a2cc-173d586c3036 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:47.790772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80343739-14e6-44ce-a2cc-173d586c3036 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:47.812500 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 653/1295] 10.222.0.90 () {60 vars in 1141 bytes} [Wed Nov 2 12:42:47 2022] POST /identity/v3/services => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:42:50.152142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53291-2d89-4ab4-92fc-03da16e1ebcb None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:50.153113 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53291-2d89-4ab4-92fc-03da16e1ebcb None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:50.153113 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53291-2d89-4ab4-92fc-03da16e1ebcb None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:50.155550 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 643/1296] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:42:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:42:50.161801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495a3de-3dfa-4cfb-b33c-5bdb7202ebd0 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:50.162506 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495a3de-3dfa-4cfb-b33c-5bdb7202ebd0 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:50.162672 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495a3de-3dfa-4cfb-b33c-5bdb7202ebd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:50.189566 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-f495a3de-3dfa-4cfb-b33c-5bdb7202ebd0 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:50.190730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f495a3de-3dfa-4cfb-b33c-5bdb7202ebd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:50.262990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 654/1297] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:42:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:42:50.292770 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe53291-2d89-4ab4-92fc-03da16e1ebcb None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:50.408303 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe53291-2d89-4ab4-92fc-03da16e1ebcb None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:50.446232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8b301-2e7c-4bad-91c0-8dbd699573ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:50.447023 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8b301-2e7c-4bad-91c0-8dbd699573ae None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:50.447296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8b301-2e7c-4bad-91c0-8dbd699573ae None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:50.447563 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8b301-2e7c-4bad-91c0-8dbd699573ae None admin] PATH_INFO: `/v3/services/placement` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:50.448305 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8b301-2e7c-4bad-91c0-8dbd699573ae None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:50.449603 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8b301-2e7c-4bad-91c0-8dbd699573ae None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:50.462945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-b5e8b301-2e7c-4bad-91c0-8dbd699573ae None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 12:42:50.464174 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 644/1298] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Nov 2 12:42:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:50.471766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495a3de-3dfa-4cfb-b33c-5bdb7202ebd0 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:50.574232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495a3de-3dfa-4cfb-b33c-5bdb7202ebd0 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:50.609881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0e02c-8ac6-4f3f-a1c9-c0999b89509e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:50.610531 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0e02c-8ac6-4f3f-a1c9-c0999b89509e None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:50.610802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0e02c-8ac6-4f3f-a1c9-c0999b89509e None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:50.611067 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0e02c-8ac6-4f3f-a1c9-c0999b89509e None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:50.611755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0e02c-8ac6-4f3f-a1c9-c0999b89509e None admin] RBAC: Adding query filter params (name=placement) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:50.612053 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0e02c-8ac6-4f3f-a1c9-c0999b89509e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:50.613445 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0e02c-8ac6-4f3f-a1c9-c0999b89509e None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:50.618719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 655/1299] 10.222.0.90 () {56 vars in 1116 bytes} [Wed Nov 2 12:42:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:50.628086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8b301-2e7c-4bad-91c0-8dbd699573ae None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:50.753748 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8b301-2e7c-4bad-91c0-8dbd699573ae None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:50.788035 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41de47-7e4b-4ee5-9534-5bce6224a1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:50.788723 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41de47-7e4b-4ee5-9534-5bce6224a1ff None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:50.789002 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41de47-7e4b-4ee5-9534-5bce6224a1ff None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:50.789274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41de47-7e4b-4ee5-9534-5bce6224a1ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:50.790041 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41de47-7e4b-4ee5-9534-5bce6224a1ff None admin] RBAC: Adding query filter params (interface=public, service_id=a6fe2d64554b438a933794f74c03e56b, region_id=RegionOne) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:50.790349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41de47-7e4b-4ee5-9534-5bce6224a1ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:50.791729 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41de47-7e4b-4ee5-9534-5bce6224a1ff None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:50.797485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 645/1300] 10.222.0.90 () {56 vars in 1251 bytes} [Wed Nov 2 12:42:50 2022] GET /identity/v3/endpoints?service_id=a6fe2d64554b438a933794f74c03e56b&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:50.803756 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0e02c-8ac6-4f3f-a1c9-c0999b89509e None admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:50.926445 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0e02c-8ac6-4f3f-a1c9-c0999b89509e None admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:50.965520 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c7523-2910-46fc-8318-8357090f5629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:50.966666 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c7523-2910-46fc-8318-8357090f5629 None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:50.966942 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c7523-2910-46fc-8318-8357090f5629 None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:50.967232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c7523-2910-46fc-8318-8357090f5629 None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:50.967926 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c7523-2910-46fc-8318-8357090f5629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:50.969317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c7523-2910-46fc-8318-8357090f5629 None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:50.976551 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 656/1301] 10.222.0.90 () {56 vars in 1087 bytes} [Wed Nov 2 12:42:50 2022] GET /identity/v3/services => generated 2191 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:42:53.276096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b742dc8-f373-49c3-9e23-e2b3ad473b23 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:53.276688 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b742dc8-f373-49c3-9e23-e2b3ad473b23 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:53.276871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b742dc8-f373-49c3-9e23-e2b3ad473b23 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:53.279575 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 646/1302] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:42:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:42:53.286342 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34de1f-bbd1-49d9-97a6-5d9aca20bf34 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:53.286757 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34de1f-bbd1-49d9-97a6-5d9aca20bf34 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:53.286929 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34de1f-bbd1-49d9-97a6-5d9aca20bf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:53.313553 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-4b34de1f-bbd1-49d9-97a6-5d9aca20bf34 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:53.314738 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4b34de1f-bbd1-49d9-97a6-5d9aca20bf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:53.381727 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 657/1303] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:42:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:42:53.405745 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b742dc8-f373-49c3-9e23-e2b3ad473b23 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:53.516488 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b742dc8-f373-49c3-9e23-e2b3ad473b23 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:53.552122 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5018e75-2338-4be2-be0a-9d80f06a8445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:53.552904 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5018e75-2338-4be2-be0a-9d80f06a8445 None admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:53.553180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5018e75-2338-4be2-be0a-9d80f06a8445 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:53.553447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5018e75-2338-4be2-be0a-9d80f06a8445 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:53.554090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5018e75-2338-4be2-be0a-9d80f06a8445 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:53.555445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5018e75-2338-4be2-be0a-9d80f06a8445 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:53.566836 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING keystone.server.flask.application [None req-f5018e75-2338-4be2-be0a-9d80f06a8445 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 12:42:53.567963 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 647/1304] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Nov 2 12:42:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:42:53.578019 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34de1f-bbd1-49d9-97a6-5d9aca20bf34 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:53.703249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34de1f-bbd1-49d9-97a6-5d9aca20bf34 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:53.741982 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d19843-a025-4077-bc34-cd108adf8a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:53.742627 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d19843-a025-4077-bc34-cd108adf8a1c None admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:53.742902 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d19843-a025-4077-bc34-cd108adf8a1c None admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:53.743170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d19843-a025-4077-bc34-cd108adf8a1c None admin] PATH_INFO: `/v3/services` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:53.743908 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d19843-a025-4077-bc34-cd108adf8a1c None admin] RBAC: Adding query filter params (name=placement) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:53.744247 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d19843-a025-4077-bc34-cd108adf8a1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:53.745768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d19843-a025-4077-bc34-cd108adf8a1c None admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:53.754854 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 658/1305] 10.222.0.90 () {56 vars in 1116 bytes} [Wed Nov 2 12:42:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:53.763912 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5018e75-2338-4be2-be0a-9d80f06a8445 None admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:53.874291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5018e75-2338-4be2-be0a-9d80f06a8445 None admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:53.910135 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f305d3-6fb6-4caa-b0f6-cf68f9bef499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:53.910806 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f305d3-6fb6-4caa-b0f6-cf68f9bef499 None admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:53.911106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f305d3-6fb6-4caa-b0f6-cf68f9bef499 None admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:53.911403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f305d3-6fb6-4caa-b0f6-cf68f9bef499 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:53.912139 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f305d3-6fb6-4caa-b0f6-cf68f9bef499 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:53.913572 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f305d3-6fb6-4caa-b0f6-cf68f9bef499 None admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:53.937430 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 648/1306] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:42:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:58.994017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dba0f-9543-4b3c-9482-10d315e6a474 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:58.995075 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dba0f-9543-4b3c-9482-10d315e6a474 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:58.995559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dba0f-9543-4b3c-9482-10d315e6a474 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:59.003245 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34dc39-c39b-4c79-9741-cfa212ed7eb5 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:59.004106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34dc39-c39b-4c79-9741-cfa212ed7eb5 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:59.004614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34dc39-c39b-4c79-9741-cfa212ed7eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:59.008693 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 659/1307] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:43:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:43:59.090721 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-0e34dc39-c39b-4c79-9741-cfa212ed7eb5 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:59.093220 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0e34dc39-c39b-4c79-9741-cfa212ed7eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:59.320232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 649/1308] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:43:59.328247 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dba0f-9543-4b3c-9482-10d315e6a474 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:59.330461 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-8d0dba0f-9543-4b3c-9482-10d315e6a474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:59.494199 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dba0f-9543-4b3c-9482-10d315e6a474 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:59.601035 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0daee3-afb0-462b-9970-e635305c3225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:59.602341 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0daee3-afb0-462b-9970-e635305c3225 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:59.602838 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0daee3-afb0-462b-9970-e635305c3225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:59.603449 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0daee3-afb0-462b-9970-e635305c3225 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:59.604493 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0daee3-afb0-462b-9970-e635305c3225 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:59.606602 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING py.warnings [None req-2f0daee3-afb0-462b-9970-e635305c3225 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:59.606602 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: warnings.warn(msg) Nov 02 12:43:59.606602 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: Nov 02 12:43:59.608171 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0daee3-afb0-462b-9970-e635305c3225 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:59.630878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 660/1309] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:43:59 2022] GET /identity/v3/projects => generated 2553 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:02.068601 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f749b-57f5-45e8-ac55-0b6deb94f1ee None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:02.069119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f749b-57f5-45e8-ac55-0b6deb94f1ee None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:02.069119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f749b-57f5-45e8-ac55-0b6deb94f1ee None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:02.070814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 650/1310] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:02.076519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b75d93-0dd6-41be-81f4-9df430bddf54 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:02.076948 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b75d93-0dd6-41be-81f4-9df430bddf54 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:02.077056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b75d93-0dd6-41be-81f4-9df430bddf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:02.158430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-61b75d93-0dd6-41be-81f4-9df430bddf54 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:02.159609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-61b75d93-0dd6-41be-81f4-9df430bddf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:02.268235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 661/1311] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:02.317911 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bedbde-b32d-49c6-a2e0-dfbc8a2444de None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:02.318200 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bedbde-b32d-49c6-a2e0-dfbc8a2444de None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:02.318479 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bedbde-b32d-49c6-a2e0-dfbc8a2444de None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:02.321378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 651/1312] 10.222.0.90 () {54 vars in 963 bytes} [Wed Nov 2 12:44:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:02.326648 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443517f7-93cd-42f4-b658-999a75968e89 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:02.326939 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443517f7-93cd-42f4-b658-999a75968e89 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:02.327204 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443517f7-93cd-42f4-b658-999a75968e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:02.408574 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-443517f7-93cd-42f4-b658-999a75968e89 None None] MFA Rules not processed for user `89a11da83d84467ca9ae04b9693beede`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:02.409871 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-443517f7-93cd-42f4-b658-999a75968e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:02.491596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 662/1313] 10.222.0.90 () {58 vars in 1060 bytes} [Wed Nov 2 12:44:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:02.501300 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bedbde-b32d-49c6-a2e0-dfbc8a2444de None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:02.504435 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-14bedbde-b32d-49c6-a2e0-dfbc8a2444de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:02.610970 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bedbde-b32d-49c6-a2e0-dfbc8a2444de None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:02.684994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb44ed-9819-404f-88c9-2768977dacd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:02.685783 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb44ed-9819-404f-88c9-2768977dacd1 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:02.686068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb44ed-9819-404f-88c9-2768977dacd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:02.686338 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb44ed-9819-404f-88c9-2768977dacd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:02.688096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-3dcb44ed-9819-404f-88c9-2768977dacd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:02.795336 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb44ed-9819-404f-88c9-2768977dacd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:02.796848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb44ed-9819-404f-88c9-2768977dacd1 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:02.815917 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 652/1314] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:05.388322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf699b4-b9cb-4707-9c20-d1ea0475e9e1 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:05.388840 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf699b4-b9cb-4707-9c20-d1ea0475e9e1 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:05.388840 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf699b4-b9cb-4707-9c20-d1ea0475e9e1 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:05.390545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 663/1315] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:05.396991 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888fc04-677a-48eb-82c1-f6413315852a None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:05.397698 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888fc04-677a-48eb-82c1-f6413315852a None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:05.397838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888fc04-677a-48eb-82c1-f6413315852a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:05.483764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-f888fc04-677a-48eb-82c1-f6413315852a None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:05.485019 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f888fc04-677a-48eb-82c1-f6413315852a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:05.589784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 653/1316] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:05.645454 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bf3de-43f7-497b-a959-34f949936397 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:05.645662 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bf3de-43f7-497b-a959-34f949936397 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:05.645908 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bf3de-43f7-497b-a959-34f949936397 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:05.647670 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 664/1317] 10.222.0.90 () {54 vars in 963 bytes} [Wed Nov 2 12:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:05.654851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de698dda-134b-478d-8607-eabbe020f9d4 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:05.655301 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de698dda-134b-478d-8607-eabbe020f9d4 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:05.655762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de698dda-134b-478d-8607-eabbe020f9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:05.731473 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-de698dda-134b-478d-8607-eabbe020f9d4 None None] MFA Rules not processed for user `89a11da83d84467ca9ae04b9693beede`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:05.732695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-de698dda-134b-478d-8607-eabbe020f9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:05.820601 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 654/1318] 10.222.0.90 () {58 vars in 1060 bytes} [Wed Nov 2 12:44:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:44:05.830032 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bf3de-43f7-497b-a959-34f949936397 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:05.831533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-d90bf3de-43f7-497b-a959-34f949936397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:05.957174 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bf3de-43f7-497b-a959-34f949936397 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:06.029896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c6377-d828-4f26-9746-e3e5a13859b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:06.030516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c6377-d828-4f26-9746-e3e5a13859b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:06.030826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c6377-d828-4f26-9746-e3e5a13859b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:06.031096 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c6377-d828-4f26-9746-e3e5a13859b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:06.032784 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-502c6377-d828-4f26-9746-e3e5a13859b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:06.140938 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c6377-d828-4f26-9746-e3e5a13859b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:06.142462 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c6377-d828-4f26-9746-e3e5a13859b1 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:06.160958 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 665/1319] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:09.012731 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cbc2e-31f2-4f0c-8aca-72643364c468 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:09.013283 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cbc2e-31f2-4f0c-8aca-72643364c468 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:09.013283 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cbc2e-31f2-4f0c-8aca-72643364c468 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:09.015045 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 655/1320] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:09.021764 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394a97b-df89-4a62-be47-bb3834acbc68 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:09.022513 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394a97b-df89-4a62-be47-bb3834acbc68 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:09.022654 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394a97b-df89-4a62-be47-bb3834acbc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:09.097634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-d394a97b-df89-4a62-be47-bb3834acbc68 None None] MFA Rules not processed for user `a26927c413cd49c198cd0c5719fb07c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:09.098828 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-d394a97b-df89-4a62-be47-bb3834acbc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:09.211684 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 666/1321] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:44:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:09.259945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cbc2e-31f2-4f0c-8aca-72643364c468 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:09.262391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-886cbc2e-31f2-4f0c-8aca-72643364c468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:09.387263 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cbc2e-31f2-4f0c-8aca-72643364c468 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:09.458853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530c937-8134-4f2f-810d-683c11ca4432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:09.459616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530c937-8134-4f2f-810d-683c11ca4432 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:09.459854 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530c937-8134-4f2f-810d-683c11ca4432 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:09.459999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530c937-8134-4f2f-810d-683c11ca4432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:09.461850 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0530c937-8134-4f2f-810d-683c11ca4432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:09.586127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530c937-8134-4f2f-810d-683c11ca4432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:09.587628 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530c937-8134-4f2f-810d-683c11ca4432 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:09.605161 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 656/1322] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:12.669301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b223d-94d9-45df-bbe6-6a78ebfe96b4 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:12.669878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b223d-94d9-45df-bbe6-6a78ebfe96b4 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:12.669878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b223d-94d9-45df-bbe6-6a78ebfe96b4 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:12.671627 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 667/1323] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:12.678218 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ff4c1-9f23-4e25-857f-6dbe2e8b611f None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:12.678914 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ff4c1-9f23-4e25-857f-6dbe2e8b611f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:12.679156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ff4c1-9f23-4e25-857f-6dbe2e8b611f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:12.759671 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-300ff4c1-9f23-4e25-857f-6dbe2e8b611f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:12.760811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-300ff4c1-9f23-4e25-857f-6dbe2e8b611f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:12.876244 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 657/1324] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:44:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:12.924561 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b223d-94d9-45df-bbe6-6a78ebfe96b4 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:12.926091 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-cc9b223d-94d9-45df-bbe6-6a78ebfe96b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:13.028646 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b223d-94d9-45df-bbe6-6a78ebfe96b4 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:13.111470 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca00d01-ba1b-4f63-855d-12249d61238d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:13.112124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca00d01-ba1b-4f63-855d-12249d61238d service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:13.112867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca00d01-ba1b-4f63-855d-12249d61238d service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:13.113135 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca00d01-ba1b-4f63-855d-12249d61238d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:13.114757 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0ca00d01-ba1b-4f63-855d-12249d61238d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:13.225708 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca00d01-ba1b-4f63-855d-12249d61238d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:13.227178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca00d01-ba1b-4f63-855d-12249d61238d service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:13.245280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 668/1325] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:16.282785 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49678058-4321-49b1-9ad6-aa8fc9e8e765 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:16.283376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49678058-4321-49b1-9ad6-aa8fc9e8e765 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:16.283376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49678058-4321-49b1-9ad6-aa8fc9e8e765 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:16.285127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 658/1326] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:16.290636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b3472-7589-4b7f-849f-3033e4d4d76d None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:16.291048 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b3472-7589-4b7f-849f-3033e4d4d76d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:16.291156 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b3472-7589-4b7f-849f-3033e4d4d76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:16.357579 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-ec8b3472-7589-4b7f-849f-3033e4d4d76d None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:16.358791 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ec8b3472-7589-4b7f-849f-3033e4d4d76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:16.456680 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 669/1327] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:16.493446 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49678058-4321-49b1-9ad6-aa8fc9e8e765 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:16.495032 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-49678058-4321-49b1-9ad6-aa8fc9e8e765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:16.600257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49678058-4321-49b1-9ad6-aa8fc9e8e765 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:16.675539 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f315a-b93e-41a1-9fe7-6f97f410e56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:16.676157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f315a-b93e-41a1-9fe7-6f97f410e56e service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:16.676467 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f315a-b93e-41a1-9fe7-6f97f410e56e service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:16.676758 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f315a-b93e-41a1-9fe7-6f97f410e56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:16.678382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-130f315a-b93e-41a1-9fe7-6f97f410e56e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:16.785884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f315a-b93e-41a1-9fe7-6f97f410e56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:16.787331 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f315a-b93e-41a1-9fe7-6f97f410e56e service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:16.806778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 659/1328] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:19.199398 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a3749-7168-4a4c-9304-cfc6fa96e9db None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:19.199933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a3749-7168-4a4c-9304-cfc6fa96e9db None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:19.199933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a3749-7168-4a4c-9304-cfc6fa96e9db None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:19.201729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 670/1329] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:19.207155 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d533ba-4408-446a-b34b-7ffc13e146e7 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:19.207595 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d533ba-4408-446a-b34b-7ffc13e146e7 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:19.207694 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d533ba-4408-446a-b34b-7ffc13e146e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:19.276286 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-b7d533ba-4408-446a-b34b-7ffc13e146e7 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:19.277528 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b7d533ba-4408-446a-b34b-7ffc13e146e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:19.374316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 660/1330] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:19.411358 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a3749-7168-4a4c-9304-cfc6fa96e9db None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:19.412994 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-119a3749-7168-4a4c-9304-cfc6fa96e9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:19.520585 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a3749-7168-4a4c-9304-cfc6fa96e9db None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:19.591986 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34e749-e587-4870-b004-c5da2a24127b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:19.592654 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34e749-e587-4870-b004-c5da2a24127b service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:19.592929 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34e749-e587-4870-b004-c5da2a24127b service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:19.593197 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34e749-e587-4870-b004-c5da2a24127b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:19.594772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1d34e749-e587-4870-b004-c5da2a24127b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:19.707495 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34e749-e587-4870-b004-c5da2a24127b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:19.709007 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34e749-e587-4870-b004-c5da2a24127b service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:19.727846 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 671/1331] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:22.092619 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f8f49-952d-4bb7-a337-71d0900c0463 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:22.093257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f8f49-952d-4bb7-a337-71d0900c0463 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:22.093257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f8f49-952d-4bb7-a337-71d0900c0463 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:22.094943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 661/1332] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:22.100495 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7fe7-d995-40ca-a324-d907154ea692 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:22.100946 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7fe7-d995-40ca-a324-d907154ea692 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:22.101047 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7fe7-d995-40ca-a324-d907154ea692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:22.170128 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-6cdb7fe7-d995-40ca-a324-d907154ea692 None None] MFA Rules not processed for user `a26927c413cd49c198cd0c5719fb07c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:22.171325 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-6cdb7fe7-d995-40ca-a324-d907154ea692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:22.266837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 672/1333] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:44:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:22.305529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f8f49-952d-4bb7-a337-71d0900c0463 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:22.307282 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6a3f8f49-952d-4bb7-a337-71d0900c0463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:22.413803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f8f49-952d-4bb7-a337-71d0900c0463 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:22.486508 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42d824-7b87-4dca-9e75-b55e703777db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:22.487158 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42d824-7b87-4dca-9e75-b55e703777db service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:22.487434 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42d824-7b87-4dca-9e75-b55e703777db service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:22.487673 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42d824-7b87-4dca-9e75-b55e703777db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:22.489345 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0d42d824-7b87-4dca-9e75-b55e703777db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:22.598161 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42d824-7b87-4dca-9e75-b55e703777db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:22.599729 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42d824-7b87-4dca-9e75-b55e703777db service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:22.619399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 662/1334] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:22 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:25.217548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef4484-29f0-4834-a950-61b8367ce3a2 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:25.218193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef4484-29f0-4834-a950-61b8367ce3a2 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:25.218193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef4484-29f0-4834-a950-61b8367ce3a2 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:25.220123 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 673/1335] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:25.225955 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa0460-1348-4102-a2f4-86c1c303cd98 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:25.226376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa0460-1348-4102-a2f4-86c1c303cd98 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:25.226565 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa0460-1348-4102-a2f4-86c1c303cd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:25.293383 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-d0aa0460-1348-4102-a2f4-86c1c303cd98 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:25.294594 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-d0aa0460-1348-4102-a2f4-86c1c303cd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:25.393805 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 663/1336] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:25.431162 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef4484-29f0-4834-a950-61b8367ce3a2 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:25.432820 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-d5ef4484-29f0-4834-a950-61b8367ce3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:25.544524 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef4484-29f0-4834-a950-61b8367ce3a2 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:25.619625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7029a5-e5c9-406b-932e-9b9d9fa25b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:25.620114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7029a5-e5c9-406b-932e-9b9d9fa25b1f service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:25.620490 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7029a5-e5c9-406b-932e-9b9d9fa25b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:25.620740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7029a5-e5c9-406b-932e-9b9d9fa25b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:25.622392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-bb7029a5-e5c9-406b-932e-9b9d9fa25b1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:25.735532 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7029a5-e5c9-406b-932e-9b9d9fa25b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:25.737004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7029a5-e5c9-406b-932e-9b9d9fa25b1f service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:25.756625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 674/1337] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:28.121637 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d9a3a-e8f6-4d42-8e9c-ac0436301fe6 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:28.122223 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d9a3a-e8f6-4d42-8e9c-ac0436301fe6 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:28.122223 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d9a3a-e8f6-4d42-8e9c-ac0436301fe6 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:28.125098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 664/1338] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:44:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:28.134409 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deec9d7-75a2-49d8-af65-ade564805615 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:28.135096 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deec9d7-75a2-49d8-af65-ade564805615 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:28.135188 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deec9d7-75a2-49d8-af65-ade564805615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:28.215197 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-1deec9d7-75a2-49d8-af65-ade564805615 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:28.216535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1deec9d7-75a2-49d8-af65-ade564805615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:28.324155 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 675/1339] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:28.376322 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d9a3a-e8f6-4d42-8e9c-ac0436301fe6 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:28.378632 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-142d9a3a-e8f6-4d42-8e9c-ac0436301fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:28.495397 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d9a3a-e8f6-4d42-8e9c-ac0436301fe6 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:28.580236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059d1dd-33dc-44b8-ba31-53c9115094ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:28.580918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059d1dd-33dc-44b8-ba31-53c9115094ee service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:28.581312 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059d1dd-33dc-44b8-ba31-53c9115094ee service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:28.581591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059d1dd-33dc-44b8-ba31-53c9115094ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:28.583266 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6059d1dd-33dc-44b8-ba31-53c9115094ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:28.711541 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059d1dd-33dc-44b8-ba31-53c9115094ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:28.713824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059d1dd-33dc-44b8-ba31-53c9115094ee service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:28.734914 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 665/1340] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:31.482618 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262b752-3c1c-4f86-a5c0-084ede84d8d1 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:31.483146 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262b752-3c1c-4f86-a5c0-084ede84d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:31.483146 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262b752-3c1c-4f86-a5c0-084ede84d8d1 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:31.485010 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 676/1341] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:31.490405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c60f8-a2f9-43e9-b419-306ab221c763 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:31.490832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c60f8-a2f9-43e9-b419-306ab221c763 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:31.490948 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c60f8-a2f9-43e9-b419-306ab221c763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:31.564622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-e21c60f8-a2f9-43e9-b419-306ab221c763 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:31.565828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e21c60f8-a2f9-43e9-b419-306ab221c763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:31.679800 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 666/1342] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:44:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:31.720127 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262b752-3c1c-4f86-a5c0-084ede84d8d1 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:31.723026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0262b752-3c1c-4f86-a5c0-084ede84d8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:31.832239 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262b752-3c1c-4f86-a5c0-084ede84d8d1 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:31.836790 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b5a28-77b8-4206-9cfc-6ec8f83eb900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:31.837411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b5a28-77b8-4206-9cfc-6ec8f83eb900 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:31.837684 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b5a28-77b8-4206-9cfc-6ec8f83eb900 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:31.837980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b5a28-77b8-4206-9cfc-6ec8f83eb900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:31.848854 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b5a28-77b8-4206-9cfc-6ec8f83eb900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:31.850303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b5a28-77b8-4206-9cfc-6ec8f83eb900 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:31.860674 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 677/1343] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:36.142383 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ee5ed-e1cf-4824-8c15-c8cc66132594 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:36.142982 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ee5ed-e1cf-4824-8c15-c8cc66132594 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:36.142982 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ee5ed-e1cf-4824-8c15-c8cc66132594 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:36.144636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 667/1344] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:36.149993 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd31569-0597-4296-adf1-83cd36579033 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:36.150466 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd31569-0597-4296-adf1-83cd36579033 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:36.150566 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd31569-0597-4296-adf1-83cd36579033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:36.181263 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-9dd31569-0597-4296-adf1-83cd36579033 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:36.182455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-9dd31569-0597-4296-adf1-83cd36579033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:36.263748 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 678/1345] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:36.304347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ee5ed-e1cf-4824-8c15-c8cc66132594 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:36.317783 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ee5ed-e1cf-4824-8c15-c8cc66132594 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:36.321544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951947c6-f33a-4324-a2dc-cf8aaf534e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:36.322194 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951947c6-f33a-4324-a2dc-cf8aaf534e11 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:36.322470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951947c6-f33a-4324-a2dc-cf8aaf534e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:36.322803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951947c6-f33a-4324-a2dc-cf8aaf534e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:36.332593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951947c6-f33a-4324-a2dc-cf8aaf534e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:36.334190 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951947c6-f33a-4324-a2dc-cf8aaf534e11 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:36.343909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 668/1346] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:39.260496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb47cf9-ea09-4169-b055-d033a2f7ae64 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:39.261096 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb47cf9-ea09-4169-b055-d033a2f7ae64 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:39.261096 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb47cf9-ea09-4169-b055-d033a2f7ae64 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:39.262943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 679/1347] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:39.268936 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6643e-b5d5-4e10-9e32-de5f46b53d92 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:39.269357 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6643e-b5d5-4e10-9e32-de5f46b53d92 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:39.269506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6643e-b5d5-4e10-9e32-de5f46b53d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:39.290154 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-c1e6643e-b5d5-4e10-9e32-de5f46b53d92 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:39.291329 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-c1e6643e-b5d5-4e10-9e32-de5f46b53d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:39.300645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 669/1348] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:44:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:39.338589 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb47cf9-ea09-4169-b055-d033a2f7ae64 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:39.350562 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb47cf9-ea09-4169-b055-d033a2f7ae64 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:39.354518 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413028a7-9f94-472f-bbf6-5f93cd80d34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:39.355231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413028a7-9f94-472f-bbf6-5f93cd80d34f service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:39.355570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413028a7-9f94-472f-bbf6-5f93cd80d34f service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:39.355845 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413028a7-9f94-472f-bbf6-5f93cd80d34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:39.365138 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413028a7-9f94-472f-bbf6-5f93cd80d34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:39.366569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413028a7-9f94-472f-bbf6-5f93cd80d34f service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:39.375956 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 680/1349] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:43.721145 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e32a4-9a4c-4cfa-97d5-099f8f925e47 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:43.721694 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e32a4-9a4c-4cfa-97d5-099f8f925e47 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:43.721694 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e32a4-9a4c-4cfa-97d5-099f8f925e47 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:43.723789 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 670/1350] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:43.728879 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a0e2a-b60b-42aa-8fc3-754e76dcf0c5 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:43.729301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a0e2a-b60b-42aa-8fc3-754e76dcf0c5 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:43.729412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a0e2a-b60b-42aa-8fc3-754e76dcf0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:43.747555 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-764a0e2a-b60b-42aa-8fc3-754e76dcf0c5 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:43.748736 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-764a0e2a-b60b-42aa-8fc3-754e76dcf0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:43.757207 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 681/1351] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:43.795461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e32a4-9a4c-4cfa-97d5-099f8f925e47 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:43.807148 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e32a4-9a4c-4cfa-97d5-099f8f925e47 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:43.811175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe1e87-2fd5-4f82-b181-66e0f223f340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:43.811813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe1e87-2fd5-4f82-b181-66e0f223f340 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:43.812091 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe1e87-2fd5-4f82-b181-66e0f223f340 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:43.812386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe1e87-2fd5-4f82-b181-66e0f223f340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:43.821350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe1e87-2fd5-4f82-b181-66e0f223f340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:43.822784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe1e87-2fd5-4f82-b181-66e0f223f340 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:43.832136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 671/1352] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:49.233641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c2bfb-d33d-48d5-9fb4-2225ab2d005d None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:49.234451 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c2bfb-d33d-48d5-9fb4-2225ab2d005d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:49.234883 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c2bfb-d33d-48d5-9fb4-2225ab2d005d None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:49.237360 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 682/1353] 10.222.0.90 () {54 vars in 921 bytes} [Wed Nov 2 12:44:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:49.242654 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f5eef-f9ee-489a-9c25-a596ec2de4b3 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:49.243087 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f5eef-f9ee-489a-9c25-a596ec2de4b3 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:49.243421 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f5eef-f9ee-489a-9c25-a596ec2de4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:49.355909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-b80f5eef-f9ee-489a-9c25-a596ec2de4b3 None None] MFA Rules not processed for user `65e89359a42b4b0592db48f5a5a6e465`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:49.357818 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b80f5eef-f9ee-489a-9c25-a596ec2de4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:49.478498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 672/1354] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Nov 2 12:44:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:53.741451 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda62087-25d9-4be4-a257-fa173174a2c9 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:53.742049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda62087-25d9-4be4-a257-fa173174a2c9 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:53.742049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda62087-25d9-4be4-a257-fa173174a2c9 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:53.743844 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 683/1355] 10.222.0.90 () {54 vars in 921 bytes} [Wed Nov 2 12:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:53.748976 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58304da5-e150-4324-b678-78f4f18db328 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:53.749419 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58304da5-e150-4324-b678-78f4f18db328 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:53.749516 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58304da5-e150-4324-b678-78f4f18db328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:53.768557 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-58304da5-e150-4324-b678-78f4f18db328 None None] MFA Rules not processed for user `65e89359a42b4b0592db48f5a5a6e465`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:53.769755 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-58304da5-e150-4324-b678-78f4f18db328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:53.779608 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 673/1356] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Nov 2 12:44:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:55.404624 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d08ae-3a1b-4545-b71b-7b168311d7e9 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:55.405179 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d08ae-3a1b-4545-b71b-7b168311d7e9 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:55.405179 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d08ae-3a1b-4545-b71b-7b168311d7e9 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:55.407003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 684/1357] 10.222.0.90 () {54 vars in 921 bytes} [Wed Nov 2 12:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:55.413331 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafd8d1-be0f-44ac-912e-023a8eb7a5cb None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:55.413876 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafd8d1-be0f-44ac-912e-023a8eb7a5cb None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:55.413876 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafd8d1-be0f-44ac-912e-023a8eb7a5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:55.435573 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-9bafd8d1-be0f-44ac-912e-023a8eb7a5cb None None] MFA Rules not processed for user `65e89359a42b4b0592db48f5a5a6e465`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:55.436893 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-9bafd8d1-be0f-44ac-912e-023a8eb7a5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:55.447095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 674/1358] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Nov 2 12:44:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:59.410621 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672b7e3-2f8c-4f43-91a9-c8d13796e9ba None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:59.411429 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672b7e3-2f8c-4f43-91a9-c8d13796e9ba None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:59.411429 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672b7e3-2f8c-4f43-91a9-c8d13796e9ba None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:59.413651 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 685/1359] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:44:59.419155 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec643c-6bda-4b54-97be-9cb35adac2df None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:59.419999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec643c-6bda-4b54-97be-9cb35adac2df None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:59.420293 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec643c-6bda-4b54-97be-9cb35adac2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:59.440184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-62ec643c-6bda-4b54-97be-9cb35adac2df None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:59.441655 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-62ec643c-6bda-4b54-97be-9cb35adac2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:59.450910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 675/1360] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:59.501354 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed12d3a-762b-43f1-a730-a710aa9fe20c None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:59.502009 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed12d3a-762b-43f1-a730-a710aa9fe20c None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:59.502517 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed12d3a-762b-43f1-a730-a710aa9fe20c None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:59.504786 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 686/1361] 10.222.0.90 () {54 vars in 959 bytes} [Wed Nov 2 12:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:44:59.510681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928f86-99d8-4be6-8229-056d01e5b1e3 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:59.511210 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928f86-99d8-4be6-8229-056d01e5b1e3 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:59.511684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928f86-99d8-4be6-8229-056d01e5b1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:59.562175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-bf928f86-99d8-4be6-8229-056d01e5b1e3 None None] MFA Rules not processed for user `fbcda58f298444eebf4f08ce01deffc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:59.563639 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-bf928f86-99d8-4be6-8229-056d01e5b1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:59.647824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 676/1362] 10.222.0.90 () {58 vars in 1056 bytes} [Wed Nov 2 12:44:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:59.656896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed12d3a-762b-43f1-a730-a710aa9fe20c None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:59.672461 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed12d3a-762b-43f1-a730-a710aa9fe20c None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:59.678588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b6422-60e4-4521-95fb-226b1f546791 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:59.679441 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b6422-60e4-4521-95fb-226b1f546791 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:59.679921 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b6422-60e4-4521-95fb-226b1f546791 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:59.680514 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b6422-60e4-4521-95fb-226b1f546791 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:59.690064 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b6422-60e4-4521-95fb-226b1f546791 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:59.692028 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b6422-60e4-4521-95fb-226b1f546791 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:59.703059 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 687/1363] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:02.245728 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234bc5e-de18-4b94-b1f2-a17247939ff7 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:02.246259 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234bc5e-de18-4b94-b1f2-a17247939ff7 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:02.246259 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234bc5e-de18-4b94-b1f2-a17247939ff7 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:02.247983 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 677/1364] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:02.253565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69aeaa7-b009-4ba7-9107-a361f29a04d4 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:02.254001 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69aeaa7-b009-4ba7-9107-a361f29a04d4 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:02.254105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69aeaa7-b009-4ba7-9107-a361f29a04d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:02.273099 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-b69aeaa7-b009-4ba7-9107-a361f29a04d4 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:02.274302 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-b69aeaa7-b009-4ba7-9107-a361f29a04d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:02.282883 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 688/1365] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:02.328860 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234bc5e-de18-4b94-b1f2-a17247939ff7 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:02.344284 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234bc5e-de18-4b94-b1f2-a17247939ff7 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:02.350618 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8656584-1c4c-4317-add2-a363ff484ceb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:02.351568 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8656584-1c4c-4317-add2-a363ff484ceb service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:02.352066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8656584-1c4c-4317-add2-a363ff484ceb service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:02.352577 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8656584-1c4c-4317-add2-a363ff484ceb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:02.362596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8656584-1c4c-4317-add2-a363ff484ceb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:02.365510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8656584-1c4c-4317-add2-a363ff484ceb service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:02.379939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 678/1366] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:05.012595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65be7d-6874-4c36-a68f-246462167e81 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:05.013324 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65be7d-6874-4c36-a68f-246462167e81 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:05.013324 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65be7d-6874-4c36-a68f-246462167e81 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:05.015032 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 689/1367] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:05.020778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464611f-20b5-46a0-83d3-4993aef981cc None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:05.021244 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464611f-20b5-46a0-83d3-4993aef981cc None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:05.021371 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464611f-20b5-46a0-83d3-4993aef981cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:05.040662 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-9464611f-20b5-46a0-83d3-4993aef981cc None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:05.041848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-9464611f-20b5-46a0-83d3-4993aef981cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:05.050706 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 679/1368] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:05.097442 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b14d26-09e4-4285-a224-30ab0fabf195 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:05.097723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b14d26-09e4-4285-a224-30ab0fabf195 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:05.097999 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b14d26-09e4-4285-a224-30ab0fabf195 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:05.099889 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 690/1369] 10.222.0.90 () {54 vars in 959 bytes} [Wed Nov 2 12:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:05.106130 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa20fbc-61d7-4459-9cf5-be233a11176d None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:05.106540 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa20fbc-61d7-4459-9cf5-be233a11176d None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:05.106963 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa20fbc-61d7-4459-9cf5-be233a11176d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:05.125596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-2aa20fbc-61d7-4459-9cf5-be233a11176d None None] MFA Rules not processed for user `fbcda58f298444eebf4f08ce01deffc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:05.126932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2aa20fbc-61d7-4459-9cf5-be233a11176d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:05.136762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 680/1370] 10.222.0.90 () {58 vars in 1056 bytes} [Wed Nov 2 12:45:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:05.144953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b14d26-09e4-4285-a224-30ab0fabf195 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:05.159382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b14d26-09e4-4285-a224-30ab0fabf195 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:05.164734 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9c274-3ac1-47ed-ae66-98073a7aa3bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:05.165364 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9c274-3ac1-47ed-ae66-98073a7aa3bc service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:05.165641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9c274-3ac1-47ed-ae66-98073a7aa3bc service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:05.165910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9c274-3ac1-47ed-ae66-98073a7aa3bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:05.174162 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9c274-3ac1-47ed-ae66-98073a7aa3bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:05.175786 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9c274-3ac1-47ed-ae66-98073a7aa3bc service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:05.185178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 691/1371] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:07.575859 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee597645-64a0-4ea9-8292-544b632ae3c4 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:07.576504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee597645-64a0-4ea9-8292-544b632ae3c4 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:07.576504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee597645-64a0-4ea9-8292-544b632ae3c4 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:07.578631 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 681/1372] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:07.584610 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bcc7b-d9ae-4450-9232-830d605bdc39 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:07.585170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bcc7b-d9ae-4450-9232-830d605bdc39 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:07.585170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bcc7b-d9ae-4450-9232-830d605bdc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:07.604571 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e67bcc7b-d9ae-4450-9232-830d605bdc39 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:07.605779 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e67bcc7b-d9ae-4450-9232-830d605bdc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:07.614495 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 692/1373] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:07.659119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee597645-64a0-4ea9-8292-544b632ae3c4 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:07.675191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee597645-64a0-4ea9-8292-544b632ae3c4 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:07.681307 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4c258-288f-4f28-b72d-7b8733ca7d73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:07.682226 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4c258-288f-4f28-b72d-7b8733ca7d73 service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:07.682722 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4c258-288f-4f28-b72d-7b8733ca7d73 service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:07.683294 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4c258-288f-4f28-b72d-7b8733ca7d73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:07.692551 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4c258-288f-4f28-b72d-7b8733ca7d73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:07.694417 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4c258-288f-4f28-b72d-7b8733ca7d73 service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:07.716444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 682/1374] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:07.724657 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6e7f9-7f6e-4d07-8a86-3da3819c3ea2 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:07.725016 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6e7f9-7f6e-4d07-8a86-3da3819c3ea2 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:07.725292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6e7f9-7f6e-4d07-8a86-3da3819c3ea2 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:07.727260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 693/1375] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:07.732673 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb055f1-27c2-4ac6-bf95-7ba458df8978 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:07.733009 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb055f1-27c2-4ac6-bf95-7ba458df8978 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:07.733302 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb055f1-27c2-4ac6-bf95-7ba458df8978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:07.751676 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-5cb055f1-27c2-4ac6-bf95-7ba458df8978 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:07.752977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5cb055f1-27c2-4ac6-bf95-7ba458df8978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:07.761467 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 683/1376] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:08.060746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e1ba1-0cf6-465f-bbee-3b0e981f7c21 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:08.061127 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e1ba1-0cf6-465f-bbee-3b0e981f7c21 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:08.061503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e1ba1-0cf6-465f-bbee-3b0e981f7c21 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:08.063559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 694/1377] 10.222.0.90 () {54 vars in 962 bytes} [Wed Nov 2 12:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:08.069199 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5956fd-d4a8-40de-88d4-d9f4c30bf1c4 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:08.069607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5956fd-d4a8-40de-88d4-d9f4c30bf1c4 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:08.069982 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5956fd-d4a8-40de-88d4-d9f4c30bf1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:08.121831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-2e5956fd-d4a8-40de-88d4-d9f4c30bf1c4 None None] MFA Rules not processed for user `2a6d1ff8ac3b408f87c4a9b8d7363e86`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:08.123178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2e5956fd-d4a8-40de-88d4-d9f4c30bf1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:08.184807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 684/1378] 10.222.0.90 () {58 vars in 1059 bytes} [Wed Nov 2 12:45:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:08.193485 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e1ba1-0cf6-465f-bbee-3b0e981f7c21 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:08.205928 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e1ba1-0cf6-465f-bbee-3b0e981f7c21 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:08.210218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476feff-97ec-44f3-993f-76a5a5ac5476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:08.210997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476feff-97ec-44f3-993f-76a5a5ac5476 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:08.211373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476feff-97ec-44f3-993f-76a5a5ac5476 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:08.211747 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476feff-97ec-44f3-993f-76a5a5ac5476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:08.221627 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476feff-97ec-44f3-993f-76a5a5ac5476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:08.223920 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476feff-97ec-44f3-993f-76a5a5ac5476 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:08.237517 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 695/1379] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:10.086734 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee031cf-4659-428d-8726-d339fef21dc7 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:10.087289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee031cf-4659-428d-8726-d339fef21dc7 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:10.087289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee031cf-4659-428d-8726-d339fef21dc7 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:10.089326 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 685/1380] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:10.095647 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43264f6-97b4-43e8-9b3b-f42e40bd09cb None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:10.096187 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43264f6-97b4-43e8-9b3b-f42e40bd09cb None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:10.096187 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43264f6-97b4-43e8-9b3b-f42e40bd09cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:10.116144 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e43264f6-97b4-43e8-9b3b-f42e40bd09cb None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:10.117391 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e43264f6-97b4-43e8-9b3b-f42e40bd09cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:10.126746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 696/1381] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:10.173642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee031cf-4659-428d-8726-d339fef21dc7 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:10.188584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee031cf-4659-428d-8726-d339fef21dc7 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:10.194255 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1da261-55be-4865-a4c1-70895fd06543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:10.194899 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1da261-55be-4865-a4c1-70895fd06543 service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:10.195177 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1da261-55be-4865-a4c1-70895fd06543 service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:10.195448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1da261-55be-4865-a4c1-70895fd06543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:10.204084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1da261-55be-4865-a4c1-70895fd06543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:10.205861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1da261-55be-4865-a4c1-70895fd06543 service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:10.215987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 686/1382] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:12.609277 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30055992-c5fe-4343-9aa4-762121ac7e05 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:12.609869 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30055992-c5fe-4343-9aa4-762121ac7e05 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:12.609869 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30055992-c5fe-4343-9aa4-762121ac7e05 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:12.611676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 697/1383] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:12.617627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408892f-16e5-4ece-9438-d3f4409b7f06 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:12.618116 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408892f-16e5-4ece-9438-d3f4409b7f06 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:12.618230 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408892f-16e5-4ece-9438-d3f4409b7f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:12.636739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-f408892f-16e5-4ece-9438-d3f4409b7f06 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:12.638163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f408892f-16e5-4ece-9438-d3f4409b7f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:12.646199 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 687/1384] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:12.693036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30055992-c5fe-4343-9aa4-762121ac7e05 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:12.708317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30055992-c5fe-4343-9aa4-762121ac7e05 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:12.714519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef005b3-04d7-412a-975a-7e663e95e17c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:12.715169 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef005b3-04d7-412a-975a-7e663e95e17c service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:12.715493 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef005b3-04d7-412a-975a-7e663e95e17c service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:12.715742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef005b3-04d7-412a-975a-7e663e95e17c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:12.724640 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef005b3-04d7-412a-975a-7e663e95e17c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:12.726249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef005b3-04d7-412a-975a-7e663e95e17c service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:12.745805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 698/1385] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:15.124623 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b0178-0829-462d-a8e5-0eb2670c3080 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:15.125150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b0178-0829-462d-a8e5-0eb2670c3080 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:15.125150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b0178-0829-462d-a8e5-0eb2670c3080 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:15.126964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 688/1386] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:45:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:15.132625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a60403-8a9a-44f1-8edf-330de57cc172 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:15.133069 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a60403-8a9a-44f1-8edf-330de57cc172 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:15.133186 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a60403-8a9a-44f1-8edf-330de57cc172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:15.151967 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-49a60403-8a9a-44f1-8edf-330de57cc172 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:15.153154 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-49a60403-8a9a-44f1-8edf-330de57cc172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:15.161355 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 699/1387] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:15.203997 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b0178-0829-462d-a8e5-0eb2670c3080 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:15.219857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b0178-0829-462d-a8e5-0eb2670c3080 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:15.225677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6903b-a2c0-4829-920d-98a1e046d1ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:15.226328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6903b-a2c0-4829-920d-98a1e046d1ef service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:15.226595 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6903b-a2c0-4829-920d-98a1e046d1ef service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:15.227030 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6903b-a2c0-4829-920d-98a1e046d1ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:15.236330 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6903b-a2c0-4829-920d-98a1e046d1ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:15.238135 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6903b-a2c0-4829-920d-98a1e046d1ef service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:15.248408 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 689/1388] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:17.584644 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696aabb6-c4ed-46c8-8366-a78167713cd9 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:17.585425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696aabb6-c4ed-46c8-8366-a78167713cd9 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:17.585425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696aabb6-c4ed-46c8-8366-a78167713cd9 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:17.587457 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 700/1389] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:17.593197 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cabbc1-b39f-41db-a7cd-e7da7fe39e1b None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:17.594003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cabbc1-b39f-41db-a7cd-e7da7fe39e1b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:17.594287 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cabbc1-b39f-41db-a7cd-e7da7fe39e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:17.612943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-68cabbc1-b39f-41db-a7cd-e7da7fe39e1b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:17.614184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-68cabbc1-b39f-41db-a7cd-e7da7fe39e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:17.622979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 690/1390] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:17.673718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696aabb6-c4ed-46c8-8366-a78167713cd9 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:17.688640 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696aabb6-c4ed-46c8-8366-a78167713cd9 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:17.694538 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf20b6-287c-4020-a99a-30d37eeba7d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:17.695248 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf20b6-287c-4020-a99a-30d37eeba7d1 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:17.695528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf20b6-287c-4020-a99a-30d37eeba7d1 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:17.695815 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf20b6-287c-4020-a99a-30d37eeba7d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:17.704795 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf20b6-287c-4020-a99a-30d37eeba7d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:17.706423 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf20b6-287c-4020-a99a-30d37eeba7d1 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:17.719437 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 701/1391] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:45:20.522715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb192dfc-a7d2-41eb-80e8-53d798a4da48 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:20.523513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb192dfc-a7d2-41eb-80e8-53d798a4da48 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:20.523513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb192dfc-a7d2-41eb-80e8-53d798a4da48 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:20.525231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 691/1392] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:20.532357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5273653-83b6-46a8-8462-9a0f5e0569ea None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:20.532972 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5273653-83b6-46a8-8462-9a0f5e0569ea None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:20.532972 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5273653-83b6-46a8-8462-9a0f5e0569ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:20.552186 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-f5273653-83b6-46a8-8462-9a0f5e0569ea None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:20.553414 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f5273653-83b6-46a8-8462-9a0f5e0569ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:20.562308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 702/1393] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:20.607912 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb192dfc-a7d2-41eb-80e8-53d798a4da48 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:20.622162 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb192dfc-a7d2-41eb-80e8-53d798a4da48 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:20.627642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a3619-e5b3-4194-aae2-b808055adf06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:20.628306 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a3619-e5b3-4194-aae2-b808055adf06 service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:20.628614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a3619-e5b3-4194-aae2-b808055adf06 service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:20.628809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a3619-e5b3-4194-aae2-b808055adf06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:20.636862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a3619-e5b3-4194-aae2-b808055adf06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:20.638682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a3619-e5b3-4194-aae2-b808055adf06 service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:20.648485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 692/1394] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:23.088565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bdaa2-f5cf-4f7f-b15a-2d4b303bb960 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:23.089170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bdaa2-f5cf-4f7f-b15a-2d4b303bb960 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:23.089170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bdaa2-f5cf-4f7f-b15a-2d4b303bb960 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:23.091721 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 703/1395] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:23.096905 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89693049-cabf-4eef-864e-99c704e3629a None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:23.097372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89693049-cabf-4eef-864e-99c704e3629a None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:23.097460 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89693049-cabf-4eef-864e-99c704e3629a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:23.116803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-89693049-cabf-4eef-864e-99c704e3629a None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:23.118249 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-89693049-cabf-4eef-864e-99c704e3629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:23.127151 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 693/1396] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:23.171842 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bdaa2-f5cf-4f7f-b15a-2d4b303bb960 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:23.186698 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bdaa2-f5cf-4f7f-b15a-2d4b303bb960 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:23.192140 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233b29e-ca37-410a-879c-f000f9cbf028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:23.192810 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233b29e-ca37-410a-879c-f000f9cbf028 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:23.193090 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233b29e-ca37-410a-879c-f000f9cbf028 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:23.193366 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233b29e-ca37-410a-879c-f000f9cbf028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:23.201341 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233b29e-ca37-410a-879c-f000f9cbf028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:23.202915 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233b29e-ca37-410a-879c-f000f9cbf028 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:23.212315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 704/1397] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:24.221115 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365effb-0874-47ca-be8c-f5133b7eb893 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:24.221713 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365effb-0874-47ca-be8c-f5133b7eb893 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:24.221713 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365effb-0874-47ca-be8c-f5133b7eb893 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:24.223422 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 694/1398] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:24.228810 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251625a-9143-4866-8467-ea2dc73f03e3 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:24.229275 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251625a-9143-4866-8467-ea2dc73f03e3 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:24.229389 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251625a-9143-4866-8467-ea2dc73f03e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:24.248880 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-5251625a-9143-4866-8467-ea2dc73f03e3 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:24.250077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5251625a-9143-4866-8467-ea2dc73f03e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:24.258867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 705/1399] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:24.318129 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c7d04-5b2e-4e1b-9434-ddb57e436a7b None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:24.318606 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c7d04-5b2e-4e1b-9434-ddb57e436a7b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:24.318952 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c7d04-5b2e-4e1b-9434-ddb57e436a7b None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:24.321031 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 695/1400] 10.222.0.90 () {54 vars in 961 bytes} [Wed Nov 2 12:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:24.325970 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6456c-1438-4e7e-99c8-641af8e58647 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:24.326270 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6456c-1438-4e7e-99c8-641af8e58647 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:24.326547 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6456c-1438-4e7e-99c8-641af8e58647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:24.379052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-f7b6456c-1438-4e7e-99c8-641af8e58647 None None] MFA Rules not processed for user `0303312c6cec4067a4a92d38edb59086`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:24.380304 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f7b6456c-1438-4e7e-99c8-641af8e58647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:24.443038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 706/1401] 10.222.0.90 () {58 vars in 1058 bytes} [Wed Nov 2 12:45:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:24.450949 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c7d04-5b2e-4e1b-9434-ddb57e436a7b None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:24.462660 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c7d04-5b2e-4e1b-9434-ddb57e436a7b None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:24.468153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5348e9d-e226-425c-b92a-cf96ffb83cef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0303312c6cec4067a4a92d38edb59086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:24.468945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5348e9d-e226-425c-b92a-cf96ffb83cef service glance] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:24.469226 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5348e9d-e226-425c-b92a-cf96ffb83cef service glance] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:24.469495 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5348e9d-e226-425c-b92a-cf96ffb83cef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:24.479605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5348e9d-e226-425c-b92a-cf96ffb83cef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:24.481022 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5348e9d-e226-425c-b92a-cf96ffb83cef service glance] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:24.490337 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 696/1402] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:24.911689 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee40896-c311-4ece-a296-874fb8f4a79f None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:24.912049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee40896-c311-4ece-a296-874fb8f4a79f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:24.912458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee40896-c311-4ece-a296-874fb8f4a79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:24.960660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-4ee40896-c311-4ece-a296-874fb8f4a79f None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:24.961925 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4ee40896-c311-4ece-a296-874fb8f4a79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:25.025850 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 707/1403] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Nov 2 12:45:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:25.068768 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad4377-f952-46d3-a67e-479f5172af01 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:25.069133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad4377-f952-46d3-a67e-479f5172af01 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:25.069475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad4377-f952-46d3-a67e-479f5172af01 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:25.071470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 697/1404] 10.222.0.90 () {54 vars in 942 bytes} [Wed Nov 2 12:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:25.078578 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ee4e8-72d7-4139-8819-667f26891216 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:25.078913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ee4e8-72d7-4139-8819-667f26891216 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:25.079189 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ee4e8-72d7-4139-8819-667f26891216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:25.128169 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-d13ee4e8-72d7-4139-8819-667f26891216 None None] MFA Rules not processed for user `baece5d60fe6407989b460fc6b747f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:25.129383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-d13ee4e8-72d7-4139-8819-667f26891216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:25.203566 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 708/1405] 10.222.0.90 () {58 vars in 1039 bytes} [Wed Nov 2 12:45:25 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:45:25.213519 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad4377-f952-46d3-a67e-479f5172af01 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:25.228676 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad4377-f952-46d3-a67e-479f5172af01 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:25.234093 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b3dcf-be3a-47cb-9b62-8c91d6372b5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:25.234777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b3dcf-be3a-47cb-9b62-8c91d6372b5c service swift] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:25.235055 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b3dcf-be3a-47cb-9b62-8c91d6372b5c service swift] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:25.235327 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b3dcf-be3a-47cb-9b62-8c91d6372b5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:25.244014 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b3dcf-be3a-47cb-9b62-8c91d6372b5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:25.245673 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b3dcf-be3a-47cb-9b62-8c91d6372b5c service swift] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:25.253934 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 698/1406] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 12:45:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:45:25.571580 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158352fb-d668-4f78-b81c-120f6ee13d38 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:25.572114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158352fb-d668-4f78-b81c-120f6ee13d38 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:25.572114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158352fb-d668-4f78-b81c-120f6ee13d38 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:25.574199 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 709/1407] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:25.580187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabb5c6-ee01-47f9-916d-137a4f5499cb None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:25.580524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabb5c6-ee01-47f9-916d-137a4f5499cb None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:25.580803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabb5c6-ee01-47f9-916d-137a4f5499cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:25.599504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-9aabb5c6-ee01-47f9-916d-137a4f5499cb None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:25.600736 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-9aabb5c6-ee01-47f9-916d-137a4f5499cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:25.608941 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 699/1408] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:25.655913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158352fb-d668-4f78-b81c-120f6ee13d38 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:25.671920 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158352fb-d668-4f78-b81c-120f6ee13d38 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:25.677892 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfaf19a-2d14-4177-babc-0a6b97807001 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:25.678597 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfaf19a-2d14-4177-babc-0a6b97807001 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:25.678947 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfaf19a-2d14-4177-babc-0a6b97807001 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:25.679220 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfaf19a-2d14-4177-babc-0a6b97807001 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:25.688406 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfaf19a-2d14-4177-babc-0a6b97807001 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:25.690029 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfaf19a-2d14-4177-babc-0a6b97807001 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:25.699951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 710/1409] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:28.155179 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb1216-0898-4b24-a485-bd0ee0ea7dce None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:28.155718 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb1216-0898-4b24-a485-bd0ee0ea7dce None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:28.155718 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb1216-0898-4b24-a485-bd0ee0ea7dce None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:28.157830 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 700/1410] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:28.163330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c1dff-afee-40c4-9d7a-5bbf57670632 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:28.163772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c1dff-afee-40c4-9d7a-5bbf57670632 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:28.164026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c1dff-afee-40c4-9d7a-5bbf57670632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:28.182776 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-2e0c1dff-afee-40c4-9d7a-5bbf57670632 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:28.183993 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-2e0c1dff-afee-40c4-9d7a-5bbf57670632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:28.192850 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 711/1411] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:28.237155 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb1216-0898-4b24-a485-bd0ee0ea7dce None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:28.255676 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb1216-0898-4b24-a485-bd0ee0ea7dce None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:28.262122 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b678c3-96fb-4f53-a895-4a8478ecd3cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:28.262948 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b678c3-96fb-4f53-a895-4a8478ecd3cc service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:28.263252 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b678c3-96fb-4f53-a895-4a8478ecd3cc service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:28.263589 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b678c3-96fb-4f53-a895-4a8478ecd3cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:28.277576 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b678c3-96fb-4f53-a895-4a8478ecd3cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:28.279274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b678c3-96fb-4f53-a895-4a8478ecd3cc service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:28.292030 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 701/1412] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:48.758941 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950fea9-6f23-4d28-9551-e7735941cfaa None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:48.759595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950fea9-6f23-4d28-9551-e7735941cfaa None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:48.759595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950fea9-6f23-4d28-9551-e7735941cfaa None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:48.761220 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 712/1413] 10.222.0.90 () {54 vars in 918 bytes} [Wed Nov 2 12:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:48.767659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aff772-3bd8-4357-94b4-40d10237a05b None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:48.768745 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aff772-3bd8-4357-94b4-40d10237a05b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:48.768745 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aff772-3bd8-4357-94b4-40d10237a05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:48.793998 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-67aff772-3bd8-4357-94b4-40d10237a05b None None] MFA Rules not processed for user `65e89359a42b4b0592db48f5a5a6e465`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:48.795252 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-67aff772-3bd8-4357-94b4-40d10237a05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:48.805061 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 702/1414] 10.222.0.90 () {58 vars in 1015 bytes} [Wed Nov 2 12:45:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:48.819440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b09799-76be-48ad-8ac5-2ffb5c1a99fd None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:48.819797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b09799-76be-48ad-8ac5-2ffb5c1a99fd None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:48.820077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b09799-76be-48ad-8ac5-2ffb5c1a99fd None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:48.821886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 713/1415] 10.222.0.90 () {54 vars in 918 bytes} [Wed Nov 2 12:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:48.826446 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d501908-7681-4c81-ad31-caff9c0e2952 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:48.826733 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d501908-7681-4c81-ad31-caff9c0e2952 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:48.827019 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d501908-7681-4c81-ad31-caff9c0e2952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:48.845007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-9d501908-7681-4c81-ad31-caff9c0e2952 None None] MFA Rules not processed for user `fbcda58f298444eebf4f08ce01deffc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:48.846295 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-9d501908-7681-4c81-ad31-caff9c0e2952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:48.856379 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 703/1416] 10.222.0.90 () {58 vars in 1015 bytes} [Wed Nov 2 12:45:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:51.674885 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e19fb1-b35a-4757-a394-0b5023025c9c None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:51.675771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e19fb1-b35a-4757-a394-0b5023025c9c None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:51.675771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e19fb1-b35a-4757-a394-0b5023025c9c None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:51.678636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 2 12:45:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:51.684994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe034bdd-fe30-4d1f-8221-9b5eb9577b45 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:51.685477 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe034bdd-fe30-4d1f-8221-9b5eb9577b45 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:51.685573 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe034bdd-fe30-4d1f-8221-9b5eb9577b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:51.711071 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-fe034bdd-fe30-4d1f-8221-9b5eb9577b45 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:51.712292 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-fe034bdd-fe30-4d1f-8221-9b5eb9577b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:51.720623 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 2 12:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:51.763274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e19fb1-b35a-4757-a394-0b5023025c9c None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:51.780563 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e19fb1-b35a-4757-a394-0b5023025c9c None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:51.786723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cf8e9-e097-4d1e-ad8e-8a67c1c1e848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:51.787418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cf8e9-e097-4d1e-ad8e-8a67c1c1e848 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:51.787671 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cf8e9-e097-4d1e-ad8e-8a67c1c1e848 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:51.787975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cf8e9-e097-4d1e-ad8e-8a67c1c1e848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:51.797987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cf8e9-e097-4d1e-ad8e-8a67c1c1e848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:51.799877 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cf8e9-e097-4d1e-ad8e-8a67c1c1e848 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:51.810982 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 715/1419] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:53.217089 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb0d19-403b-44dc-a29a-9186693d476c None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:53.217980 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb0d19-403b-44dc-a29a-9186693d476c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:53.217980 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb0d19-403b-44dc-a29a-9186693d476c None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:53.220905 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:45:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:53.227303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecc32b-594d-41eb-a851-ab9e3bfa1ec8 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:53.228009 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecc32b-594d-41eb-a851-ab9e3bfa1ec8 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:53.228171 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecc32b-594d-41eb-a851-ab9e3bfa1ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:53.251062 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-12ecc32b-594d-41eb-a851-ab9e3bfa1ec8 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:53.252234 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-12ecc32b-594d-41eb-a851-ab9e3bfa1ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:53.261106 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:53.427310 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb0d19-403b-44dc-a29a-9186693d476c None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:53.444175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb0d19-403b-44dc-a29a-9186693d476c None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:53.451644 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dc755-1e17-4a6f-9b7d-9962a5e09805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:53.452326 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dc755-1e17-4a6f-9b7d-9962a5e09805 service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:53.452613 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dc755-1e17-4a6f-9b7d-9962a5e09805 service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:53.452887 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dc755-1e17-4a6f-9b7d-9962a5e09805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:53.461245 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dc755-1e17-4a6f-9b7d-9962a5e09805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:53.462885 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dc755-1e17-4a6f-9b7d-9962a5e09805 service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:53.473289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 706/1422] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:54.823815 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f2199-df19-4c54-bbd0-01af7366e5ca None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:54.824733 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f2199-df19-4c54-bbd0-01af7366e5ca None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:54.824733 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f2199-df19-4c54-bbd0-01af7366e5ca None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:54.827522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:45:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:54.833762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930a4e8-cc6f-48a5-a5dd-3858614ee9f2 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:54.834485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930a4e8-cc6f-48a5-a5dd-3858614ee9f2 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:54.834648 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930a4e8-cc6f-48a5-a5dd-3858614ee9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:54.859093 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-2930a4e8-cc6f-48a5-a5dd-3858614ee9f2 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:54.860338 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2930a4e8-cc6f-48a5-a5dd-3858614ee9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:54.868880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:55.022934 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f2199-df19-4c54-bbd0-01af7366e5ca None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:55.046595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f2199-df19-4c54-bbd0-01af7366e5ca None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:55.054068 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393abcb-e7f6-482d-b539-bd3cbb9004d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:55.054704 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393abcb-e7f6-482d-b539-bd3cbb9004d9 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:55.054983 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393abcb-e7f6-482d-b539-bd3cbb9004d9 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:55.055250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393abcb-e7f6-482d-b539-bd3cbb9004d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:55.064900 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393abcb-e7f6-482d-b539-bd3cbb9004d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:55.066489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393abcb-e7f6-482d-b539-bd3cbb9004d9 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:55.076952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 718/1425] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:56.416535 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720d983-2551-4479-80d6-98991485ceff None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:56.417067 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720d983-2551-4479-80d6-98991485ceff None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:56.417067 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720d983-2551-4479-80d6-98991485ceff None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:56.419768 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:45:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:56.427107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca65cf-c67c-4f77-96d5-a878bb67fb7c None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:56.427577 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca65cf-c67c-4f77-96d5-a878bb67fb7c None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:56.427692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca65cf-c67c-4f77-96d5-a878bb67fb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:56.446673 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-66ca65cf-c67c-4f77-96d5-a878bb67fb7c None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:56.447853 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-66ca65cf-c67c-4f77-96d5-a878bb67fb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:56.457172 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:45:56.613671 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720d983-2551-4479-80d6-98991485ceff None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:56.637085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720d983-2551-4479-80d6-98991485ceff None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:56.645508 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7f0ea-4974-48d5-95ef-742591c9b6eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:56.646127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7f0ea-4974-48d5-95ef-742591c9b6eb service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:56.646402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7f0ea-4974-48d5-95ef-742591c9b6eb service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:56.646669 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7f0ea-4974-48d5-95ef-742591c9b6eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:56.659451 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7f0ea-4974-48d5-95ef-742591c9b6eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:56.661927 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7f0ea-4974-48d5-95ef-742591c9b6eb service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:56.675942 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 709/1428] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:58.023879 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faf9cd-2e96-4af6-99be-2a17cd26ee15 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:58.024822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faf9cd-2e96-4af6-99be-2a17cd26ee15 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:58.024822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faf9cd-2e96-4af6-99be-2a17cd26ee15 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:58.028079 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:45:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:58.034392 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e4e4f-9d7b-4d9a-baff-c95de1a9f52a None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:58.035032 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e4e4f-9d7b-4d9a-baff-c95de1a9f52a None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:58.035205 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e4e4f-9d7b-4d9a-baff-c95de1a9f52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:58.057703 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-410e4e4f-9d7b-4d9a-baff-c95de1a9f52a None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:58.058897 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-410e4e4f-9d7b-4d9a-baff-c95de1a9f52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:58.067972 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:58.224729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faf9cd-2e96-4af6-99be-2a17cd26ee15 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:58.241115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faf9cd-2e96-4af6-99be-2a17cd26ee15 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:58.247987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd37be-ca90-41a9-b555-346065dc73ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:58.248662 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd37be-ca90-41a9-b555-346065dc73ca service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:58.248944 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd37be-ca90-41a9-b555-346065dc73ca service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:58.249196 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd37be-ca90-41a9-b555-346065dc73ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:58.257987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd37be-ca90-41a9-b555-346065dc73ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:58.260451 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd37be-ca90-41a9-b555-346065dc73ca service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:58.273296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 721/1431] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:59.603181 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c1aee-a4b8-40fd-856c-56274b2bef89 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:59.604051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c1aee-a4b8-40fd-856c-56274b2bef89 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:59.604051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c1aee-a4b8-40fd-856c-56274b2bef89 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:59.607020 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:45:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:59.614594 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0928a-ac66-48a3-a77e-f7c88c23a6ac None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:59.615016 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0928a-ac66-48a3-a77e-f7c88c23a6ac None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:59.615357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0928a-ac66-48a3-a77e-f7c88c23a6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:59.633912 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-f2c0928a-ac66-48a3-a77e-f7c88c23a6ac None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:59.635148 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f2c0928a-ac66-48a3-a77e-f7c88c23a6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:59.643776 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:59.809126 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c1aee-a4b8-40fd-856c-56274b2bef89 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:59.831026 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c1aee-a4b8-40fd-856c-56274b2bef89 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:59.836780 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88aba1-6303-4846-8fed-2de02e493984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:59.837410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88aba1-6303-4846-8fed-2de02e493984 service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:59.837702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88aba1-6303-4846-8fed-2de02e493984 service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:59.837956 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88aba1-6303-4846-8fed-2de02e493984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:59.846475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88aba1-6303-4846-8fed-2de02e493984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:59.848422 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88aba1-6303-4846-8fed-2de02e493984 service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:59.857837 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 712/1434] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:01.154586 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89478149-2080-43e5-8092-e15ce1591c68 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:01.155629 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89478149-2080-43e5-8092-e15ce1591c68 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:01.155629 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89478149-2080-43e5-8092-e15ce1591c68 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:01.157351 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:01.164775 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0a6f3-65ad-4f55-9fd4-ec1c1cc473f4 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:01.165259 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0a6f3-65ad-4f55-9fd4-ec1c1cc473f4 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:01.165352 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0a6f3-65ad-4f55-9fd4-ec1c1cc473f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:01.183937 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-72c0a6f3-65ad-4f55-9fd4-ec1c1cc473f4 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:01.185255 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-72c0a6f3-65ad-4f55-9fd4-ec1c1cc473f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:01.193356 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:46:01.345093 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89478149-2080-43e5-8092-e15ce1591c68 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:01.366924 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89478149-2080-43e5-8092-e15ce1591c68 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:01.373749 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a950df-52e9-43f9-8c99-992383f132b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:01.374382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a950df-52e9-43f9-8c99-992383f132b4 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:01.374656 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a950df-52e9-43f9-8c99-992383f132b4 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:01.374896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a950df-52e9-43f9-8c99-992383f132b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:01.383827 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a950df-52e9-43f9-8c99-992383f132b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:01.385412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a950df-52e9-43f9-8c99-992383f132b4 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:01.395919 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 724/1437] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:02.679817 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603e214-e632-415f-84fd-70031ea3ee01 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:02.680427 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603e214-e632-415f-84fd-70031ea3ee01 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:02.680427 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603e214-e632-415f-84fd-70031ea3ee01 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:02.682169 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:02.688453 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b8353-9361-421e-b5a8-51f111737c33 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:02.689156 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b8353-9361-421e-b5a8-51f111737c33 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:02.689339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b8353-9361-421e-b5a8-51f111737c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:02.715094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-d22b8353-9361-421e-b5a8-51f111737c33 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:02.716486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-d22b8353-9361-421e-b5a8-51f111737c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:02.726753 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:02.899249 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603e214-e632-415f-84fd-70031ea3ee01 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:02.918765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603e214-e632-415f-84fd-70031ea3ee01 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:02.925264 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7061b8-9c0f-43cd-a677-a9706d19001b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:02.925899 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7061b8-9c0f-43cd-a677-a9706d19001b service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:02.926181 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7061b8-9c0f-43cd-a677-a9706d19001b service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:02.926455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7061b8-9c0f-43cd-a677-a9706d19001b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:02.934723 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7061b8-9c0f-43cd-a677-a9706d19001b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:02.936160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7061b8-9c0f-43cd-a677-a9706d19001b service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:02.945513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 715/1440] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:04.238252 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd205f8-a9d0-4e9f-b74d-8e3cd826622d None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:04.238822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd205f8-a9d0-4e9f-b74d-8e3cd826622d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:04.238822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd205f8-a9d0-4e9f-b74d-8e3cd826622d None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:04.240616 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:46:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:04.246702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a253b4-3ad7-4e12-ac54-40c387c496ec None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:04.247542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a253b4-3ad7-4e12-ac54-40c387c496ec None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:04.247715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a253b4-3ad7-4e12-ac54-40c387c496ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:04.275085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-17a253b4-3ad7-4e12-ac54-40c387c496ec None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:04.276638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-17a253b4-3ad7-4e12-ac54-40c387c496ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:04.288729 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:04.443947 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd205f8-a9d0-4e9f-b74d-8e3cd826622d None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:04.467425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd205f8-a9d0-4e9f-b74d-8e3cd826622d None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:04.476831 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6983017-f52c-4928-a9e7-7096c512e96a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:04.477489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6983017-f52c-4928-a9e7-7096c512e96a service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:04.477771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6983017-f52c-4928-a9e7-7096c512e96a service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:04.478048 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6983017-f52c-4928-a9e7-7096c512e96a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:04.486750 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6983017-f52c-4928-a9e7-7096c512e96a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:04.488488 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6983017-f52c-4928-a9e7-7096c512e96a service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:04.497940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 727/1443] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:06.710034 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bd94f-0259-4101-a93a-99615e7cb1d7 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:06.710889 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bd94f-0259-4101-a93a-99615e7cb1d7 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:06.710889 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bd94f-0259-4101-a93a-99615e7cb1d7 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:06.713962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 2 12:46:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:06.720907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485670f-f0ff-495d-853b-4b79718b9889 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:06.721356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485670f-f0ff-495d-853b-4b79718b9889 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:06.721568 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485670f-f0ff-495d-853b-4b79718b9889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:06.740768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-a485670f-f0ff-495d-853b-4b79718b9889 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:06.742098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a485670f-f0ff-495d-853b-4b79718b9889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:06.750685 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 2 12:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:06.794843 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bd94f-0259-4101-a93a-99615e7cb1d7 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:06.813626 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bd94f-0259-4101-a93a-99615e7cb1d7 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:06.818106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ddcd50-d726-44bb-b7ea-c5c1fe8f58ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:06.818742 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddcd50-d726-44bb-b7ea-c5c1fe8f58ec service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:06.819022 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddcd50-d726-44bb-b7ea-c5c1fe8f58ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:06.819294 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddcd50-d726-44bb-b7ea-c5c1fe8f58ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:06.829889 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddcd50-d726-44bb-b7ea-c5c1fe8f58ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:06.831329 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddcd50-d726-44bb-b7ea-c5c1fe8f58ec service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:06.843993 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 718/1446] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:09.310427 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd404857-782e-498b-b5ea-0fc1ecdadb3d None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:09.311070 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd404857-782e-498b-b5ea-0fc1ecdadb3d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:09.311070 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd404857-782e-498b-b5ea-0fc1ecdadb3d None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:09.312756 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 2 12:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:09.320635 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8452ac1-6f9b-471e-b24f-04dd7e06da86 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:09.321082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8452ac1-6f9b-471e-b24f-04dd7e06da86 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:09.321198 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8452ac1-6f9b-471e-b24f-04dd7e06da86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:09.341345 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-f8452ac1-6f9b-471e-b24f-04dd7e06da86 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:09.342529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f8452ac1-6f9b-471e-b24f-04dd7e06da86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:09.350901 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 2 12:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:09.389459 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd404857-782e-498b-b5ea-0fc1ecdadb3d None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:09.402537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd404857-782e-498b-b5ea-0fc1ecdadb3d None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:09.406331 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc88441-3a52-4801-915a-4736db0ab6da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:09.406999 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc88441-3a52-4801-915a-4736db0ab6da service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:09.407274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc88441-3a52-4801-915a-4736db0ab6da service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:09.407543 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc88441-3a52-4801-915a-4736db0ab6da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:09.416631 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc88441-3a52-4801-915a-4736db0ab6da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:09.418099 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc88441-3a52-4801-915a-4736db0ab6da service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:09.427907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 730/1449] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:12.038451 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac5000-1f3f-4316-9e5c-7ddf64e06acd None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:12.039313 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac5000-1f3f-4316-9e5c-7ddf64e06acd None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:12.039313 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac5000-1f3f-4316-9e5c-7ddf64e06acd None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:12.042132 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 2 12:46:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:12.051270 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522470e-02e1-4d4a-804a-aca7ba416bab None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:12.052018 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522470e-02e1-4d4a-804a-aca7ba416bab None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:12.052246 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522470e-02e1-4d4a-804a-aca7ba416bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:12.076056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-1522470e-02e1-4d4a-804a-aca7ba416bab None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:12.077270 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1522470e-02e1-4d4a-804a-aca7ba416bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:12.086103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 2 12:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:12.126369 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac5000-1f3f-4316-9e5c-7ddf64e06acd None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:12.128235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1dac5000-1f3f-4316-9e5c-7ddf64e06acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:12.141394 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac5000-1f3f-4316-9e5c-7ddf64e06acd None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:12.144960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ca494-daaf-41a6-853b-5dff3f144f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:12.145583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ca494-daaf-41a6-853b-5dff3f144f17 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:12.145856 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ca494-daaf-41a6-853b-5dff3f144f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:12.146122 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ca494-daaf-41a6-853b-5dff3f144f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:12.155518 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ca494-daaf-41a6-853b-5dff3f144f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:12.157153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ca494-daaf-41a6-853b-5dff3f144f17 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:12.166329 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 721/1452] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:14.617178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb49ad-4727-4c37-b066-e498f8dadcea None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:14.617775 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb49ad-4727-4c37-b066-e498f8dadcea None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:14.617775 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb49ad-4727-4c37-b066-e498f8dadcea None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:14.619505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 2 12:46:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:14.626151 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8b46b-d329-4fba-a6c9-ad6501483bae None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:14.626960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8b46b-d329-4fba-a6c9-ad6501483bae None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:14.627065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8b46b-d329-4fba-a6c9-ad6501483bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:14.651598 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-0cf8b46b-d329-4fba-a6c9-ad6501483bae None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:14.652812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0cf8b46b-d329-4fba-a6c9-ad6501483bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:14.665370 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 2 12:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:14.709812 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb49ad-4727-4c37-b066-e498f8dadcea None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:14.724254 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb49ad-4727-4c37-b066-e498f8dadcea None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:14.729155 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e62f5f-99ad-4af0-a3a3-41e93dcfecd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:14.729788 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e62f5f-99ad-4af0-a3a3-41e93dcfecd8 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:14.730059 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e62f5f-99ad-4af0-a3a3-41e93dcfecd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:14.730327 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e62f5f-99ad-4af0-a3a3-41e93dcfecd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:14.741829 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e62f5f-99ad-4af0-a3a3-41e93dcfecd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:14.743257 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e62f5f-99ad-4af0-a3a3-41e93dcfecd8 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:14.753308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 733/1455] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:17.135516 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192487c-9ee3-4bd6-bdbb-be61eeadd1f6 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:17.135953 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192487c-9ee3-4bd6-bdbb-be61eeadd1f6 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:17.136046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192487c-9ee3-4bd6-bdbb-be61eeadd1f6 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:17.137841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 2 12:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:17.145519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104de161-b6ec-4930-a076-fb1dd4d8303a None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:17.145929 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104de161-b6ec-4930-a076-fb1dd4d8303a None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:17.146062 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104de161-b6ec-4930-a076-fb1dd4d8303a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:17.166054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-104de161-b6ec-4930-a076-fb1dd4d8303a None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:17.167241 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-104de161-b6ec-4930-a076-fb1dd4d8303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:17.175719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 2 12:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:17.215011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192487c-9ee3-4bd6-bdbb-be61eeadd1f6 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:17.229299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192487c-9ee3-4bd6-bdbb-be61eeadd1f6 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:17.233629 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca777f0-206b-4176-b75a-6816096d5380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:17.234264 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca777f0-206b-4176-b75a-6816096d5380 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:17.234541 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca777f0-206b-4176-b75a-6816096d5380 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:17.234813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca777f0-206b-4176-b75a-6816096d5380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:17.243888 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca777f0-206b-4176-b75a-6816096d5380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:17.245368 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca777f0-206b-4176-b75a-6816096d5380 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:17.254715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 724/1458] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:19.650059 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f8f35-79c9-4e17-8da2-70ce2cf12ebd None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:19.650897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f8f35-79c9-4e17-8da2-70ce2cf12ebd None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:19.650897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f8f35-79c9-4e17-8da2-70ce2cf12ebd None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:19.653760 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 2 12:46:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:19.661981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68761566-ea5c-4090-a7dc-17ad9bcc185f None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:19.662412 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68761566-ea5c-4090-a7dc-17ad9bcc185f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:19.662616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68761566-ea5c-4090-a7dc-17ad9bcc185f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:19.689881 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-68761566-ea5c-4090-a7dc-17ad9bcc185f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:19.691159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-68761566-ea5c-4090-a7dc-17ad9bcc185f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:19.704041 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 2 12:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:19.746758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f8f35-79c9-4e17-8da2-70ce2cf12ebd None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:19.759521 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f8f35-79c9-4e17-8da2-70ce2cf12ebd None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:19.764369 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce8341-a8e5-4d9e-bca1-72e2afd45d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:19.765036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce8341-a8e5-4d9e-bca1-72e2afd45d64 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:19.765311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce8341-a8e5-4d9e-bca1-72e2afd45d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:19.765583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce8341-a8e5-4d9e-bca1-72e2afd45d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:19.775261 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce8341-a8e5-4d9e-bca1-72e2afd45d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:19.777090 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce8341-a8e5-4d9e-bca1-72e2afd45d64 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:19.787447 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 736/1461] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:22.177832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df64908-18bd-42fb-984f-cf2a51dcd094 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:22.178398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df64908-18bd-42fb-984f-cf2a51dcd094 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:22.178398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df64908-18bd-42fb-984f-cf2a51dcd094 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:22.180175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 2 12:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:22.186731 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ffbde-ebd2-4b43-8898-f969f9b53a88 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:22.187182 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ffbde-ebd2-4b43-8898-f969f9b53a88 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:22.187291 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ffbde-ebd2-4b43-8898-f969f9b53a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:22.211813 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-4b5ffbde-ebd2-4b43-8898-f969f9b53a88 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:22.213028 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4b5ffbde-ebd2-4b43-8898-f969f9b53a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:22.221908 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 2 12:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:22.261241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df64908-18bd-42fb-984f-cf2a51dcd094 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:22.273854 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df64908-18bd-42fb-984f-cf2a51dcd094 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:22.278238 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a474b0c-ff7d-4515-b186-6fa46bff8c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:22.278879 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a474b0c-ff7d-4515-b186-6fa46bff8c00 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:22.279159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a474b0c-ff7d-4515-b186-6fa46bff8c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:22.279456 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a474b0c-ff7d-4515-b186-6fa46bff8c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:22.289730 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a474b0c-ff7d-4515-b186-6fa46bff8c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:22.291168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a474b0c-ff7d-4515-b186-6fa46bff8c00 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:22.301044 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 727/1464] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:24.666163 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103fb2c-d981-4c75-9c91-98439923dad0 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:24.666715 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103fb2c-d981-4c75-9c91-98439923dad0 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:24.666715 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103fb2c-d981-4c75-9c91-98439923dad0 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:24.668536 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 2 12:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:24.675167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1644e4-6aa1-49a8-abb3-14d874336f36 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:24.675632 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1644e4-6aa1-49a8-abb3-14d874336f36 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:24.675727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1644e4-6aa1-49a8-abb3-14d874336f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:24.699055 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-ee1644e4-6aa1-49a8-abb3-14d874336f36 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:24.700256 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ee1644e4-6aa1-49a8-abb3-14d874336f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:24.708779 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 2 12:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:24.748909 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103fb2c-d981-4c75-9c91-98439923dad0 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:24.761054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103fb2c-d981-4c75-9c91-98439923dad0 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:24.765581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f031710-fa9c-41ba-99d4-9ce242b3a861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:24.766234 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f031710-fa9c-41ba-99d4-9ce242b3a861 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:24.766510 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f031710-fa9c-41ba-99d4-9ce242b3a861 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:24.766778 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f031710-fa9c-41ba-99d4-9ce242b3a861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:24.775743 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f031710-fa9c-41ba-99d4-9ce242b3a861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:24.777513 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f031710-fa9c-41ba-99d4-9ce242b3a861 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:24.786616 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 739/1467] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:27.115884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d063b-6aaf-450e-b2f0-7d4ce9dd5d40 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:27.116866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d063b-6aaf-450e-b2f0-7d4ce9dd5d40 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:27.116866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d063b-6aaf-450e-b2f0-7d4ce9dd5d40 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:27.119919 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 2 12:46:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:27.126139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ab9a2-28a7-49ff-b84e-fbb4fe954843 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:27.126584 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ab9a2-28a7-49ff-b84e-fbb4fe954843 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:27.126703 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ab9a2-28a7-49ff-b84e-fbb4fe954843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:27.154539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-1f5ab9a2-28a7-49ff-b84e-fbb4fe954843 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:27.156191 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1f5ab9a2-28a7-49ff-b84e-fbb4fe954843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:27.166636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 2 12:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:27.207379 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d063b-6aaf-450e-b2f0-7d4ce9dd5d40 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:27.224247 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d063b-6aaf-450e-b2f0-7d4ce9dd5d40 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:27.228608 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9dcf8-4cb2-459a-a13a-e099b8966727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:27.229242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9dcf8-4cb2-459a-a13a-e099b8966727 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:27.229522 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9dcf8-4cb2-459a-a13a-e099b8966727 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:27.229793 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9dcf8-4cb2-459a-a13a-e099b8966727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:27.239383 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9dcf8-4cb2-459a-a13a-e099b8966727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:27.240863 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9dcf8-4cb2-459a-a13a-e099b8966727 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:27.250413 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 730/1470] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:29.597646 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4972882-d405-4587-922a-b6a51f4f3e63 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:29.598458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4972882-d405-4587-922a-b6a51f4f3e63 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:29.598691 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4972882-d405-4587-922a-b6a51f4f3e63 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:29.601492 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 741/1471] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 2 12:46:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:29.608121 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220a996-5ac9-4cea-98fb-ba0d81d4163d None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:29.608644 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220a996-5ac9-4cea-98fb-ba0d81d4163d None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:29.608738 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220a996-5ac9-4cea-98fb-ba0d81d4163d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:29.627924 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-d220a996-5ac9-4cea-98fb-ba0d81d4163d None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:29.629136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-d220a996-5ac9-4cea-98fb-ba0d81d4163d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:29.636997 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 731/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 2 12:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:29.679024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4972882-d405-4587-922a-b6a51f4f3e63 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:29.691688 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4972882-d405-4587-922a-b6a51f4f3e63 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:29.696148 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6850961-de0f-4150-8cf0-bb16a2d7684f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:29.696820 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6850961-de0f-4150-8cf0-bb16a2d7684f service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:29.697220 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6850961-de0f-4150-8cf0-bb16a2d7684f service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:29.697486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6850961-de0f-4150-8cf0-bb16a2d7684f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:29.706946 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6850961-de0f-4150-8cf0-bb16a2d7684f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:29.708425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6850961-de0f-4150-8cf0-bb16a2d7684f service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:29.717825 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 742/1473] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:47.676142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abeadc-0cb5-4f15-9d68-db2b6e123b15 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:47.677106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abeadc-0cb5-4f15-9d68-db2b6e123b15 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:47.677106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abeadc-0cb5-4f15-9d68-db2b6e123b15 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:47.680091 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 732/1474] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:46:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:47.685492 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e05c4-8896-44cd-9583-5eab428a647b None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:47.685943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e05c4-8896-44cd-9583-5eab428a647b None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:47.686044 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e05c4-8896-44cd-9583-5eab428a647b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:47.712237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-f60e05c4-8896-44cd-9583-5eab428a647b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:47.713478 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f60e05c4-8896-44cd-9583-5eab428a647b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:47.722803 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 743/1475] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:46:47.779502 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5b5f0-df9d-4006-ab83-39344c6ef725 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:47.779835 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5b5f0-df9d-4006-ab83-39344c6ef725 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:47.780176 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5b5f0-df9d-4006-ab83-39344c6ef725 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:47.782968 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 733/1476] 10.222.0.90 () {54 vars in 961 bytes} [Wed Nov 2 12:46:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:47.789406 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1513451-8053-442e-957e-cde8c4219102 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:47.789690 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1513451-8053-442e-957e-cde8c4219102 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:47.789957 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1513451-8053-442e-957e-cde8c4219102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:47.810554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-a1513451-8053-442e-957e-cde8c4219102 None None] MFA Rules not processed for user `0303312c6cec4067a4a92d38edb59086`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:47.811805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a1513451-8053-442e-957e-cde8c4219102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:47.820056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 744/1477] 10.222.0.90 () {58 vars in 1058 bytes} [Wed Nov 2 12:46:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:47.827596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5b5f0-df9d-4006-ab83-39344c6ef725 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:47.840247 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5b5f0-df9d-4006-ab83-39344c6ef725 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:47.844705 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f4769-b9a6-4d5f-a23e-5a9843ea42cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0303312c6cec4067a4a92d38edb59086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:47.845347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f4769-b9a6-4d5f-a23e-5a9843ea42cd service glance] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:47.845633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f4769-b9a6-4d5f-a23e-5a9843ea42cd service glance] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:47.845903 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f4769-b9a6-4d5f-a23e-5a9843ea42cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:47.855693 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f4769-b9a6-4d5f-a23e-5a9843ea42cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:47.857714 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f4769-b9a6-4d5f-a23e-5a9843ea42cd service glance] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:47.869493 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 734/1478] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:50.282131 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab4445-244c-4bd4-b38b-29551e52cf0f None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:50.283017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab4445-244c-4bd4-b38b-29551e52cf0f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:50.283017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab4445-244c-4bd4-b38b-29551e52cf0f None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:50.286056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 745/1479] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:46:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:50.294937 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87bd7e-5cdf-4ea5-84be-0558fc4a21ba None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:50.295390 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87bd7e-5cdf-4ea5-84be-0558fc4a21ba None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:50.295492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87bd7e-5cdf-4ea5-84be-0558fc4a21ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:50.321548 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-fd87bd7e-5cdf-4ea5-84be-0558fc4a21ba None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:50.322735 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-fd87bd7e-5cdf-4ea5-84be-0558fc4a21ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:50.334353 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 735/1480] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:50.357834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab4445-244c-4bd4-b38b-29551e52cf0f None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:50.371517 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab4445-244c-4bd4-b38b-29551e52cf0f None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:50.376913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163839e-1774-4363-ab4c-37afe97bb0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:50.377649 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163839e-1774-4363-ab4c-37afe97bb0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:50.377927 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163839e-1774-4363-ab4c-37afe97bb0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:50.378226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163839e-1774-4363-ab4c-37afe97bb0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:50.378951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163839e-1774-4363-ab4c-37afe97bb0c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:50.380844 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163839e-1774-4363-ab4c-37afe97bb0c0 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:50.398407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 746/1481] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Nov 2 12:46:50 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:52.734826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff3c8-2427-4f91-bfa2-ce615843b15d None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:52.735359 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff3c8-2427-4f91-bfa2-ce615843b15d None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:52.735359 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff3c8-2427-4f91-bfa2-ce615843b15d None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:52.738150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 736/1482] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:46:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:52.745968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfec5b3-d2f5-4dfb-986a-68f97d8e7b6b None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:52.746429 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfec5b3-d2f5-4dfb-986a-68f97d8e7b6b None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:52.746530 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfec5b3-d2f5-4dfb-986a-68f97d8e7b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:52.771700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-cbfec5b3-d2f5-4dfb-986a-68f97d8e7b6b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:52.772934 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-cbfec5b3-d2f5-4dfb-986a-68f97d8e7b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:52.782660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 747/1483] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:46:52.829336 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ff3c8-2427-4f91-bfa2-ce615843b15d None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:52.845248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ff3c8-2427-4f91-bfa2-ce615843b15d None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:52.851517 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174a409-ff89-4123-a163-e63f49d130d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:52.852156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174a409-ff89-4123-a163-e63f49d130d3 service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:52.852468 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174a409-ff89-4123-a163-e63f49d130d3 service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:52.852742 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174a409-ff89-4123-a163-e63f49d130d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:52.861363 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174a409-ff89-4123-a163-e63f49d130d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:52.863188 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174a409-ff89-4123-a163-e63f49d130d3 service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:52.872802 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 737/1484] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:55.382535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d3df7-1bf8-4644-80e7-2743630a91c2 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:55.383089 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d3df7-1bf8-4644-80e7-2743630a91c2 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:55.383089 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d3df7-1bf8-4644-80e7-2743630a91c2 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:55.384891 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 748/1485] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:55.391331 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9bfaa-ae53-4cac-b223-e804fb715fb4 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:55.392058 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9bfaa-ae53-4cac-b223-e804fb715fb4 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:55.392231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9bfaa-ae53-4cac-b223-e804fb715fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:55.413797 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-42b9bfaa-ae53-4cac-b223-e804fb715fb4 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:55.414898 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-42b9bfaa-ae53-4cac-b223-e804fb715fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:55.425040 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 738/1486] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:55.466167 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d3df7-1bf8-4644-80e7-2743630a91c2 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:55.480399 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d3df7-1bf8-4644-80e7-2743630a91c2 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:55.483964 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffb6ec-b420-4615-b594-09708ffdb052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:55.484644 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffb6ec-b420-4615-b594-09708ffdb052 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:55.484921 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffb6ec-b420-4615-b594-09708ffdb052 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:55.485191 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffb6ec-b420-4615-b594-09708ffdb052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:55.494539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffb6ec-b420-4615-b594-09708ffdb052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:55.496043 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffb6ec-b420-4615-b594-09708ffdb052 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:55.505406 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 749/1487] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:57.882394 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9e89b-af84-4ebe-992e-3cb667c51956 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:57.882942 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9e89b-af84-4ebe-992e-3cb667c51956 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:57.882942 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9e89b-af84-4ebe-992e-3cb667c51956 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:57.884681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 739/1488] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:46:57.891073 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd1c6-4421-457a-a04f-501cdfa55549 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:57.891794 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd1c6-4421-457a-a04f-501cdfa55549 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:57.891924 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd1c6-4421-457a-a04f-501cdfa55549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:57.917017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-b4abd1c6-4421-457a-a04f-501cdfa55549 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:57.918188 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-b4abd1c6-4421-457a-a04f-501cdfa55549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:57.927329 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 750/1489] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:57.965520 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9e89b-af84-4ebe-992e-3cb667c51956 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:57.977487 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9e89b-af84-4ebe-992e-3cb667c51956 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:57.981644 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3b704-97eb-42e8-9e93-848bf9f5127c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:57.982313 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3b704-97eb-42e8-9e93-848bf9f5127c service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:57.982583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3b704-97eb-42e8-9e93-848bf9f5127c service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:57.982845 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3b704-97eb-42e8-9e93-848bf9f5127c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:57.993133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3b704-97eb-42e8-9e93-848bf9f5127c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:57.994647 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3b704-97eb-42e8-9e93-848bf9f5127c service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:58.003949 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 740/1490] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:00.413455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115d086-d75a-4411-bb9f-d72bf1b3b9fd None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:00.414091 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115d086-d75a-4411-bb9f-d72bf1b3b9fd None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:00.414091 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115d086-d75a-4411-bb9f-d72bf1b3b9fd None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:00.415774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 751/1491] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:47:00.422446 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbd12e-70b6-4081-a9c0-12bb3a75a984 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:00.422885 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbd12e-70b6-4081-a9c0-12bb3a75a984 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:00.423075 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbd12e-70b6-4081-a9c0-12bb3a75a984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:00.443100 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-6bfbd12e-70b6-4081-a9c0-12bb3a75a984 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:00.444320 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6bfbd12e-70b6-4081-a9c0-12bb3a75a984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:00.453143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 741/1492] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:00.496866 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115d086-d75a-4411-bb9f-d72bf1b3b9fd None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:00.509308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115d086-d75a-4411-bb9f-d72bf1b3b9fd None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:00.513539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a49f5-88c7-4928-85ce-357ad9737564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:00.514178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a49f5-88c7-4928-85ce-357ad9737564 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:00.514441 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a49f5-88c7-4928-85ce-357ad9737564 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:00.514718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a49f5-88c7-4928-85ce-357ad9737564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:00.524052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a49f5-88c7-4928-85ce-357ad9737564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:00.525553 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a49f5-88c7-4928-85ce-357ad9737564 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:00.535804 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 752/1493] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:47:03.085877 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48447af1-edcc-42e2-a40d-4b2e9e36ae29 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:03.086433 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48447af1-edcc-42e2-a40d-4b2e9e36ae29 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:03.086433 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48447af1-edcc-42e2-a40d-4b2e9e36ae29 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:03.089260 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 742/1494] 10.222.0.90 () {54 vars in 926 bytes} [Wed Nov 2 12:47:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:47:03.097360 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2b4bc-59d7-4e06-b5cd-f21f4456a0d4 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:03.097840 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2b4bc-59d7-4e06-b5cd-f21f4456a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:03.097933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2b4bc-59d7-4e06-b5cd-f21f4456a0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:03.117670 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-c7a2b4bc-59d7-4e06-b5cd-f21f4456a0d4 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:03.118864 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c7a2b4bc-59d7-4e06-b5cd-f21f4456a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:03.127146 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 753/1495] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Nov 2 12:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:47:03.167141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48447af1-edcc-42e2-a40d-4b2e9e36ae29 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:03.179555 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48447af1-edcc-42e2-a40d-4b2e9e36ae29 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:03.183810 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9246a-6876-4abb-bf7e-13691a7db185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:03.184524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9246a-6876-4abb-bf7e-13691a7db185 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:03.184890 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9246a-6876-4abb-bf7e-13691a7db185 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:03.185162 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9246a-6876-4abb-bf7e-13691a7db185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:03.194873 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9246a-6876-4abb-bf7e-13691a7db185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:03.196359 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9246a-6876-4abb-bf7e-13691a7db185 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:03.205784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 743/1496] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:26.111153 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca77d80-da16-4234-94c2-2901892a1654 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.112057 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca77d80-da16-4234-94c2-2901892a1654 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.112057 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca77d80-da16-4234-94c2-2901892a1654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.133021 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-3ca77d80-da16-4234-94c2-2901892a1654 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:26.134232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-3ca77d80-da16-4234-94c2-2901892a1654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:26.143857 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 754/1497] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:26.153445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96721ab0-0e09-4b43-b96f-b59d3f2f12de None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.154007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96721ab0-0e09-4b43-b96f-b59d3f2f12de None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.154007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96721ab0-0e09-4b43-b96f-b59d3f2f12de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.173382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-96721ab0-0e09-4b43-b96f-b59d3f2f12de None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:26.174613 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-96721ab0-0e09-4b43-b96f-b59d3f2f12de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:26.182827 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 744/1498] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:26.187878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca77d80-da16-4234-94c2-2901892a1654 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:26.197744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca77d80-da16-4234-94c2-2901892a1654 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:26.202312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e5947-fdbe-4e20-a314-2382eec5681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:26.202962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e5947-fdbe-4e20-a314-2382eec5681a admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.203240 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e5947-fdbe-4e20-a314-2382eec5681a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.203510 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e5947-fdbe-4e20-a314-2382eec5681a admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.204259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e5947-fdbe-4e20-a314-2382eec5681a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:48:26.204564 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e5947-fdbe-4e20-a314-2382eec5681a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:26.205588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING py.warnings [None req-f86e5947-fdbe-4e20-a314-2382eec5681a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:48:26.205588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: warnings.warn(msg) Nov 02 12:48:26.205588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: Nov 02 12:48:26.206479 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e5947-fdbe-4e20-a314-2382eec5681a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:26.218034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 755/1499] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:26.227257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96721ab0-0e09-4b43-b96f-b59d3f2f12de None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:26.242693 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96721ab0-0e09-4b43-b96f-b59d3f2f12de None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:26.251520 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03b56e-e067-437e-b526-4f80419c592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:26.252171 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03b56e-e067-437e-b526-4f80419c592d admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.252522 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03b56e-e067-437e-b526-4f80419c592d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.252906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03b56e-e067-437e-b526-4f80419c592d admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.253715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03b56e-e067-437e-b526-4f80419c592d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:26.255455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING py.warnings [None req-3c03b56e-e067-437e-b526-4f80419c592d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:48:26.255455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: warnings.warn(msg) Nov 02 12:48:26.255455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: Nov 02 12:48:26.256718 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03b56e-e067-437e-b526-4f80419c592d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:26.298500 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 745/1500] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:26 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:26.302904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e5947-fdbe-4e20-a314-2382eec5681a admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:26.313438 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e5947-fdbe-4e20-a314-2382eec5681a admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:26.370534 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592bd37-f393-43df-93a2-de2514543ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:26.371132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592bd37-f393-43df-93a2-de2514543ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.371407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592bd37-f393-43df-93a2-de2514543ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.371678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592bd37-f393-43df-93a2-de2514543ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.372407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592bd37-f393-43df-93a2-de2514543ab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:26.373490 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING py.warnings [None req-4592bd37-f393-43df-93a2-de2514543ab3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:48:26.373490 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: warnings.warn(msg) Nov 02 12:48:26.373490 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: Nov 02 12:48:26.374689 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592bd37-f393-43df-93a2-de2514543ab3 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:26.397733 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 756/1501] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:26 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:26.403766 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03b56e-e067-437e-b526-4f80419c592d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:26.414661 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03b56e-e067-437e-b526-4f80419c592d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:26.419910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efffef1-2adb-4c54-849f-1c28093883dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:26.420677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efffef1-2adb-4c54-849f-1c28093883dd admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.420959 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efffef1-2adb-4c54-849f-1c28093883dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.421237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efffef1-2adb-4c54-849f-1c28093883dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.421970 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efffef1-2adb-4c54-849f-1c28093883dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:26.422995 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING py.warnings [None req-3efffef1-2adb-4c54-849f-1c28093883dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:48:26.422995 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: warnings.warn(msg) Nov 02 12:48:26.422995 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: Nov 02 12:48:26.423887 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efffef1-2adb-4c54-849f-1c28093883dd admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:26.438130 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 746/1502] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:26.444168 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592bd37-f393-43df-93a2-de2514543ab3 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:26.455457 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592bd37-f393-43df-93a2-de2514543ab3 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:26.461876 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8e80-a94c-4dfd-b3e5-af51844223ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:26.462705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8e80-a94c-4dfd-b3e5-af51844223ec admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.462967 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8e80-a94c-4dfd-b3e5-af51844223ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.463252 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8e80-a94c-4dfd-b3e5-af51844223ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.463965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b8e80-a94c-4dfd-b3e5-af51844223ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:26.465425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING py.warnings [None req-aa7b8e80-a94c-4dfd-b3e5-af51844223ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:48:26.465425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: warnings.warn(msg) Nov 02 12:48:26.465425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: Nov 02 12:48:26.466414 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b8e80-a94c-4dfd-b3e5-af51844223ec admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:26.482929 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 757/1503] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:26.487704 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efffef1-2adb-4c54-849f-1c28093883dd admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:26.500267 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efffef1-2adb-4c54-849f-1c28093883dd admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:26.506396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58762469-ca82-4a72-affd-a345634d68a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:26.507312 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58762469-ca82-4a72-affd-a345634d68a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.507597 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58762469-ca82-4a72-affd-a345634d68a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.507854 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58762469-ca82-4a72-affd-a345634d68a4 admin admin] PATH_INFO: `/v3/projects/7d1604c4dee74d7b8a2ffe9848c69db8/users/e0c35be335434201b5ba14b4807b4cf2/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.526066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58762469-ca82-4a72-affd-a345634d68a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1604c4dee74d7b8a2ffe9848c69db8, user_id=e0c35be335434201b5ba14b4807b4cf2, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:26.527134 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING py.warnings [None req-58762469-ca82-4a72-affd-a345634d68a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:48:26.527134 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: warnings.warn(msg) Nov 02 12:48:26.527134 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: Nov 02 12:48:26.529130 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58762469-ca82-4a72-affd-a345634d68a4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:26.544432 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 747/1504] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:26 2022] PUT /identity/v3/projects/7d1604c4dee74d7b8a2ffe9848c69db8/users/e0c35be335434201b5ba14b4807b4cf2/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:26.557643 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cac52a-b2fd-4069-87a7-8e2706408034 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.557957 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cac52a-b2fd-4069-87a7-8e2706408034 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.558229 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cac52a-b2fd-4069-87a7-8e2706408034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.586262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-07cac52a-b2fd-4069-87a7-8e2706408034 None None] MFA Rules not processed for user `e0c35be335434201b5ba14b4807b4cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:26.587503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-07cac52a-b2fd-4069-87a7-8e2706408034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:26.655150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 758/1505] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:26.669330 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4bd0a-a3aa-4d21-96d2-9f64a2c7a08e None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.669622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4bd0a-a3aa-4d21-96d2-9f64a2c7a08e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.669901 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4bd0a-a3aa-4d21-96d2-9f64a2c7a08e None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.671742 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 748/1506] 10.222.0.90 () {54 vars in 962 bytes} [Wed Nov 2 12:48:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:48:26.677118 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8a601-87ca-42b4-8ade-05162ec5d4c6 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.677406 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8a601-87ca-42b4-8ade-05162ec5d4c6 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.677677 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8a601-87ca-42b4-8ade-05162ec5d4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.696516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-d7d8a601-87ca-42b4-8ade-05162ec5d4c6 None None] MFA Rules not processed for user `2a6d1ff8ac3b408f87c4a9b8d7363e86`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:26.697731 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-d7d8a601-87ca-42b4-8ade-05162ec5d4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:26.754624 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 759/1507] 10.222.0.90 () {58 vars in 1059 bytes} [Wed Nov 2 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:26.765109 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4bd0a-a3aa-4d21-96d2-9f64a2c7a08e None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:26.779005 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4bd0a-a3aa-4d21-96d2-9f64a2c7a08e None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:26.782807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f30df-e57c-49d5-a409-234874133bb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:26.783438 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f30df-e57c-49d5-a409-234874133bb5 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.783715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f30df-e57c-49d5-a409-234874133bb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.783987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f30df-e57c-49d5-a409-234874133bb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.792517 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f30df-e57c-49d5-a409-234874133bb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:26.793963 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f30df-e57c-49d5-a409-234874133bb5 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:26.803184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 749/1508] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:26.857606 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a38394-1462-4462-a2c7-85900274a948 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.857892 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a38394-1462-4462-a2c7-85900274a948 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.858182 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a38394-1462-4462-a2c7-85900274a948 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.859949 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 760/1509] 10.222.0.90 () {52 vars in 830 bytes} [Wed Nov 2 12:48:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:48:26.863867 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f30df-e57c-49d5-a409-234874133bb5 service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:26.928352 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f30df-e57c-49d5-a409-234874133bb5 service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:26.933414 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a0d76-7b67-4c0f-97cc-c60cfd73eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:26.934388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a0d76-7b67-4c0f-97cc-c60cfd73eaf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.934676 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a0d76-7b67-4c0f-97cc-c60cfd73eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.934947 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a0d76-7b67-4c0f-97cc-c60cfd73eaf3 admin admin] PATH_INFO: `/v3/users/e0c35be335434201b5ba14b4807b4cf2` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.936139 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a0d76-7b67-4c0f-97cc-c60cfd73eaf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c35be335434201b5ba14b4807b4cf2)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:26.937178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING py.warnings [None req-236a0d76-7b67-4c0f-97cc-c60cfd73eaf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:48:26.937178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: warnings.warn(msg) Nov 02 12:48:26.937178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: Nov 02 12:48:26.938369 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a0d76-7b67-4c0f-97cc-c60cfd73eaf3 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:27.011453 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-236a0d76-7b67-4c0f-97cc-c60cfd73eaf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c35be335434201b5ba14b4807b4cf2'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:27.012228 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-236a0d76-7b67-4c0f-97cc-c60cfd73eaf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c35be335434201b5ba14b4807b4cf2'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:27.030549 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-236a0d76-7b67-4c0f-97cc-c60cfd73eaf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c35be335434201b5ba14b4807b4cf2'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:27.031206 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-236a0d76-7b67-4c0f-97cc-c60cfd73eaf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c35be335434201b5ba14b4807b4cf2'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:27.043469 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-236a0d76-7b67-4c0f-97cc-c60cfd73eaf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c35be335434201b5ba14b4807b4cf2'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:27.070591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 750/1510] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:26 2022] DELETE /identity/v3/users/e0c35be335434201b5ba14b4807b4cf2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:27.076825 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250a0a2-3f20-4f30-826b-c7ea40facc2f None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:27.077132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250a0a2-3f20-4f30-826b-c7ea40facc2f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:27.077403 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250a0a2-3f20-4f30-826b-c7ea40facc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:27.096713 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-a250a0a2-3f20-4f30-826b-c7ea40facc2f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:27.098014 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a250a0a2-3f20-4f30-826b-c7ea40facc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:27.160831 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 761/1511] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:27.171087 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a0d76-7b67-4c0f-97cc-c60cfd73eaf3 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:27.172809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-236a0d76-7b67-4c0f-97cc-c60cfd73eaf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:27.236131 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a0d76-7b67-4c0f-97cc-c60cfd73eaf3 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:27.241141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70298e-ac86-439e-a1a8-bf76f4bb4484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:27.241792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70298e-ac86-439e-a1a8-bf76f4bb4484 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:27.242063 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70298e-ac86-439e-a1a8-bf76f4bb4484 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:27.242335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70298e-ac86-439e-a1a8-bf76f4bb4484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:27.252622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70298e-ac86-439e-a1a8-bf76f4bb4484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:27.254166 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70298e-ac86-439e-a1a8-bf76f4bb4484 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:27.263960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 751/1512] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:27.611408 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250a0a2-3f20-4f30-826b-c7ea40facc2f None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:27.613423 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a250a0a2-3f20-4f30-826b-c7ea40facc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:27.626214 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250a0a2-3f20-4f30-826b-c7ea40facc2f None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:27.632621 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15d47a-230a-4e1f-a5f0-231fc7a573de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:27.633519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15d47a-230a-4e1f-a5f0-231fc7a573de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:27.633806 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15d47a-230a-4e1f-a5f0-231fc7a573de admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:27.634223 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15d47a-230a-4e1f-a5f0-231fc7a573de admin admin] PATH_INFO: `/v3/projects/7d1604c4dee74d7b8a2ffe9848c69db8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:27.635517 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15d47a-230a-4e1f-a5f0-231fc7a573de admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1604c4dee74d7b8a2ffe9848c69db8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:27.637480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING py.warnings [None req-4d15d47a-230a-4e1f-a5f0-231fc7a573de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:48:27.637480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: warnings.warn(msg) Nov 02 12:48:27.637480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: Nov 02 12:48:27.638726 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15d47a-230a-4e1f-a5f0-231fc7a573de admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:27.699746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-4d15d47a-230a-4e1f-a5f0-231fc7a573de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1604c4dee74d7b8a2ffe9848c69db8', 'request_id': 'req-4d15d47a-230a-4e1f-a5f0-231fc7a573de'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:27.710008 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-4d15d47a-230a-4e1f-a5f0-231fc7a573de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1604c4dee74d7b8a2ffe9848c69db8', 'request_id': 'req-4d15d47a-230a-4e1f-a5f0-231fc7a573de'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:27.716357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-4d15d47a-230a-4e1f-a5f0-231fc7a573de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1604c4dee74d7b8a2ffe9848c69db8', 'request_id': 'req-4d15d47a-230a-4e1f-a5f0-231fc7a573de'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:27.735390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-4d15d47a-230a-4e1f-a5f0-231fc7a573de admin admin] The token cache is being invalidate because project 7d1604c4dee74d7b8a2ffe9848c69db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:27.735678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-4d15d47a-230a-4e1f-a5f0-231fc7a573de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:27.736472 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-4d15d47a-230a-4e1f-a5f0-231fc7a573de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:27.738281 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 762/1513] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:27 2022] DELETE /identity/v3/projects/7d1604c4dee74d7b8a2ffe9848c69db8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:08.935807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd1200-76c3-479a-a460-92dfa6247bdf None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:08.936444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd1200-76c3-479a-a460-92dfa6247bdf None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:08.936444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd1200-76c3-479a-a460-92dfa6247bdf None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:08.938234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:50:08.944189 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b943-07a0-44c8-9891-f4faa21afc6d None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:08.944676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b943-07a0-44c8-9891-f4faa21afc6d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:08.944782 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b943-07a0-44c8-9891-f4faa21afc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:08.971609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-f804b943-07a0-44c8-9891-f4faa21afc6d None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:08.972817 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f804b943-07a0-44c8-9891-f4faa21afc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:09.033263 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:09.194344 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd1200-76c3-479a-a460-92dfa6247bdf None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:09.196335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-56cd1200-76c3-479a-a460-92dfa6247bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:09.273568 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd1200-76c3-479a-a460-92dfa6247bdf None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:09.280525 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e814e9-9f80-471e-82bc-095cd9fb6006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:09.281177 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e814e9-9f80-471e-82bc-095cd9fb6006 service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:09.281450 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e814e9-9f80-471e-82bc-095cd9fb6006 service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:09.281714 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e814e9-9f80-471e-82bc-095cd9fb6006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:09.290455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e814e9-9f80-471e-82bc-095cd9fb6006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:09.292058 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e814e9-9f80-471e-82bc-095cd9fb6006 service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:09.301476 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 753/1516] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:50:09.893339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7fe6c-8928-40f2-a7c2-4e93db1ece09 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:09.893544 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7fe6c-8928-40f2-a7c2-4e93db1ece09 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:09.893807 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7fe6c-8928-40f2-a7c2-4e93db1ece09 None None] PATH_INFO: `/v3` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:09.895079 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 764/1517] 10.222.0.105 () {54 vars in 926 bytes} [Wed Nov 2 12:50:09 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:09.903398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91172e5b-6d59-4d4b-b2ec-c1158a7991ab None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:09.903680 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91172e5b-6d59-4d4b-b2ec-c1158a7991ab None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:09.903951 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91172e5b-6d59-4d4b-b2ec-c1158a7991ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:09.923100 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-91172e5b-6d59-4d4b-b2ec-c1158a7991ab None None] MFA Rules not processed for user `65e89359a42b4b0592db48f5a5a6e465`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:09.924277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-91172e5b-6d59-4d4b-b2ec-c1158a7991ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:09.986400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 754/1518] 10.222.0.105 () {58 vars in 1016 bytes} [Wed Nov 2 12:50:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:10.625881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ee1e3-6ad4-4ed9-85d2-2bf9cc655504 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:10.626765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ee1e3-6ad4-4ed9-85d2-2bf9cc655504 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:10.626765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ee1e3-6ad4-4ed9-85d2-2bf9cc655504 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:10.629666 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 765/1519] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:50:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:50:10.635621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58833535-890f-44e4-8a23-16110a4377b2 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:10.636305 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58833535-890f-44e4-8a23-16110a4377b2 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:10.636547 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58833535-890f-44e4-8a23-16110a4377b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:10.656771 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-58833535-890f-44e4-8a23-16110a4377b2 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:10.657983 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-58833535-890f-44e4-8a23-16110a4377b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:10.666294 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 755/1520] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:10.818571 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ee1e3-6ad4-4ed9-85d2-2bf9cc655504 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:10.833104 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ee1e3-6ad4-4ed9-85d2-2bf9cc655504 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:10.838914 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28171d46-3a1e-4be7-abfb-0720e9bb5047 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:10.839547 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28171d46-3a1e-4be7-abfb-0720e9bb5047 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:10.839818 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28171d46-3a1e-4be7-abfb-0720e9bb5047 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:10.840089 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28171d46-3a1e-4be7-abfb-0720e9bb5047 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:10.848713 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28171d46-3a1e-4be7-abfb-0720e9bb5047 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:10.850286 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28171d46-3a1e-4be7-abfb-0720e9bb5047 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:10.859752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 766/1521] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:22.327976 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93305c84-2d91-4e6f-9832-c64b24e3cf2d None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:22.328642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93305c84-2d91-4e6f-9832-c64b24e3cf2d None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:22.328642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93305c84-2d91-4e6f-9832-c64b24e3cf2d None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:22.330371 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 756/1522] 10.222.0.90 () {54 vars in 960 bytes} [Wed Nov 2 12:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:50:22.335685 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48ac3b-a647-4643-926c-bae619737a27 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:22.336123 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48ac3b-a647-4643-926c-bae619737a27 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:22.336401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48ac3b-a647-4643-926c-bae619737a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:22.354938 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-2f48ac3b-a647-4643-926c-bae619737a27 None None] MFA Rules not processed for user `65e89359a42b4b0592db48f5a5a6e465`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:22.356238 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-2f48ac3b-a647-4643-926c-bae619737a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:22.365404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 767/1523] 10.222.0.90 () {58 vars in 1057 bytes} [Wed Nov 2 12:50:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:50:22.373272 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93305c84-2d91-4e6f-9832-c64b24e3cf2d None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:22.387943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93305c84-2d91-4e6f-9832-c64b24e3cf2d None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:22.393816 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631ebc6-487b-4057-9139-da0bd73d9ace service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:22.394534 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631ebc6-487b-4057-9139-da0bd73d9ace service placement] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:22.394820 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631ebc6-487b-4057-9139-da0bd73d9ace service placement] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:22.395240 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631ebc6-487b-4057-9139-da0bd73d9ace service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:22.404679 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631ebc6-487b-4057-9139-da0bd73d9ace service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:22.406291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631ebc6-487b-4057-9139-da0bd73d9ace service placement] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:22.416225 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 757/1524] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:22.606358 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7b5ed-a6e7-4d10-9ae1-b800851929e8 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:22.606686 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7b5ed-a6e7-4d10-9ae1-b800851929e8 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:22.607032 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7b5ed-a6e7-4d10-9ae1-b800851929e8 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:22.608904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:50:22.614248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a045d-a296-40f0-bd45-e676247c1803 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:22.614735 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a045d-a296-40f0-bd45-e676247c1803 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:22.615065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a045d-a296-40f0-bd45-e676247c1803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:22.633414 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-903a045d-a296-40f0-bd45-e676247c1803 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:22.634583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-903a045d-a296-40f0-bd45-e676247c1803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:22.642747 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:50:22.797089 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7b5ed-a6e7-4d10-9ae1-b800851929e8 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:22.812953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7b5ed-a6e7-4d10-9ae1-b800851929e8 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:22.818930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f83671-225d-413a-ac15-65ef77bf7d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:22.819564 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f83671-225d-413a-ac15-65ef77bf7d64 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:22.819841 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f83671-225d-413a-ac15-65ef77bf7d64 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:22.820112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f83671-225d-413a-ac15-65ef77bf7d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:22.828536 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f83671-225d-413a-ac15-65ef77bf7d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:22.830216 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f83671-225d-413a-ac15-65ef77bf7d64 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:22.839697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 769/1527] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:24.148721 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca8b9-0ce2-4d26-ad1c-bd84eab6090b None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:24.149676 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca8b9-0ce2-4d26-ad1c-bd84eab6090b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:24.149676 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca8b9-0ce2-4d26-ad1c-bd84eab6090b None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:24.151379 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:50:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:50:24.158017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f84cd-4463-4a25-8a6f-3a7521b26adf None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:24.158557 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f84cd-4463-4a25-8a6f-3a7521b26adf None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:24.158658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f84cd-4463-4a25-8a6f-3a7521b26adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:24.181379 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-9c0f84cd-4463-4a25-8a6f-3a7521b26adf None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:24.182621 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-9c0f84cd-4463-4a25-8a6f-3a7521b26adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:24.192160 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:24.348825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca8b9-0ce2-4d26-ad1c-bd84eab6090b None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:24.364243 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca8b9-0ce2-4d26-ad1c-bd84eab6090b None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:24.369717 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892f4e8-1333-426e-b08f-2305f35f5df4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:24.370358 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892f4e8-1333-426e-b08f-2305f35f5df4 service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:24.370634 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892f4e8-1333-426e-b08f-2305f35f5df4 service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:24.370884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892f4e8-1333-426e-b08f-2305f35f5df4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:24.379602 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892f4e8-1333-426e-b08f-2305f35f5df4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:24.381515 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892f4e8-1333-426e-b08f-2305f35f5df4 service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:24.390878 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 760/1530] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:28.552421 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aaff1-db47-4b55-8a31-6463ebd12f30 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:28.552948 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aaff1-db47-4b55-8a31-6463ebd12f30 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:28.552948 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aaff1-db47-4b55-8a31-6463ebd12f30 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:28.554718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 2 12:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:50:28.560389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd32d0-622e-48c1-a5e3-b6d9cc364f11 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:28.560860 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd32d0-622e-48c1-a5e3-b6d9cc364f11 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:28.560957 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd32d0-622e-48c1-a5e3-b6d9cc364f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:28.581383 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-fdfd32d0-622e-48c1-a5e3-b6d9cc364f11 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:28.582562 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-fdfd32d0-622e-48c1-a5e3-b6d9cc364f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:28.590830 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 2 12:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:50:28.628424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aaff1-db47-4b55-8a31-6463ebd12f30 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:28.630193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-dc5aaff1-db47-4b55-8a31-6463ebd12f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:28.701277 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aaff1-db47-4b55-8a31-6463ebd12f30 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:28.706631 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485d9ee-9598-4895-93c8-357550c89e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:28.707609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485d9ee-9598-4895-93c8-357550c89e67 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:28.708176 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485d9ee-9598-4895-93c8-357550c89e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:28.708681 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485d9ee-9598-4895-93c8-357550c89e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:28.722932 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485d9ee-9598-4895-93c8-357550c89e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:28.724413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485d9ee-9598-4895-93c8-357550c89e67 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:28.733873 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 772/1533] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:50:31.082981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9889a-b5dd-4b2e-bde0-bb7a22523603 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:31.083524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9889a-b5dd-4b2e-bde0-bb7a22523603 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:31.083524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9889a-b5dd-4b2e-bde0-bb7a22523603 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:31.085284 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 2 12:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:50:31.091634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474ec5-5f2d-402e-a196-f40ce7a45d54 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:31.092420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474ec5-5f2d-402e-a196-f40ce7a45d54 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:31.092634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474ec5-5f2d-402e-a196-f40ce7a45d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:31.120552 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-b8474ec5-5f2d-402e-a196-f40ce7a45d54 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:31.121744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-b8474ec5-5f2d-402e-a196-f40ce7a45d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:31.130379 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 2 12:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:31.168506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9889a-b5dd-4b2e-bde0-bb7a22523603 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:31.182097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9889a-b5dd-4b2e-bde0-bb7a22523603 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:31.186479 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7150c-da14-42fd-bf7d-a57a5630ab11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:31.187114 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7150c-da14-42fd-bf7d-a57a5630ab11 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:31.187392 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7150c-da14-42fd-bf7d-a57a5630ab11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:31.187640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7150c-da14-42fd-bf7d-a57a5630ab11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:31.199061 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7150c-da14-42fd-bf7d-a57a5630ab11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:31.201291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7150c-da14-42fd-bf7d-a57a5630ab11 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:31.212289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 763/1536] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:35.286100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b0050-b7ab-4d42-bfc7-4005518c7f1e None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:35.286860 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b0050-b7ab-4d42-bfc7-4005518c7f1e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:35.287030 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b0050-b7ab-4d42-bfc7-4005518c7f1e None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:35.289157 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 2 12:50:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:50:35.296448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289373ff-6485-4d61-b313-ce61ac4d6fba None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:35.296906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289373ff-6485-4d61-b313-ce61ac4d6fba None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:35.297024 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289373ff-6485-4d61-b313-ce61ac4d6fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:35.316970 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-289373ff-6485-4d61-b313-ce61ac4d6fba None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:35.318166 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-289373ff-6485-4d61-b313-ce61ac4d6fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:35.326633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 2 12:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:35.583548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b0050-b7ab-4d42-bfc7-4005518c7f1e None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:35.586947 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0b3b0050-b7ab-4d42-bfc7-4005518c7f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:35.658480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b0050-b7ab-4d42-bfc7-4005518c7f1e None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:35.664052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92276a01-dcd4-44d8-8c48-02f96fbea12b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:35.664931 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276a01-dcd4-44d8-8c48-02f96fbea12b service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:35.665249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276a01-dcd4-44d8-8c48-02f96fbea12b service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:35.665589 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276a01-dcd4-44d8-8c48-02f96fbea12b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:35.678768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92276a01-dcd4-44d8-8c48-02f96fbea12b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:35.680230 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92276a01-dcd4-44d8-8c48-02f96fbea12b service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:35.689902 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 775/1539] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:38.062952 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012386a-9c26-4e38-b9fe-846f7eae8777 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:38.063841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012386a-9c26-4e38-b9fe-846f7eae8777 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:38.063841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012386a-9c26-4e38-b9fe-846f7eae8777 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:38.066888 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 765/1540] 127.0.0.1 () {54 vars in 916 bytes} [Wed Nov 2 12:50:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:50:38.075915 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f188d2a-06cd-44f9-bc8d-52ce6a46eb85 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:38.076363 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f188d2a-06cd-44f9-bc8d-52ce6a46eb85 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:38.076519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f188d2a-06cd-44f9-bc8d-52ce6a46eb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:38.098076 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-8f188d2a-06cd-44f9-bc8d-52ce6a46eb85 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:38.099275 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-8f188d2a-06cd-44f9-bc8d-52ce6a46eb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:38.108985 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 776/1541] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Nov 2 12:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:38.367273 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012386a-9c26-4e38-b9fe-846f7eae8777 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:38.369405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5012386a-9c26-4e38-b9fe-846f7eae8777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:38.382770 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012386a-9c26-4e38-b9fe-846f7eae8777 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:38.386352 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461efd50-1767-4e15-8a46-33a94ce02c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:38.386979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461efd50-1767-4e15-8a46-33a94ce02c37 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:38.387255 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461efd50-1767-4e15-8a46-33a94ce02c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:38.387525 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461efd50-1767-4e15-8a46-33a94ce02c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:38.396827 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461efd50-1767-4e15-8a46-33a94ce02c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:38.398321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461efd50-1767-4e15-8a46-33a94ce02c37 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:38.408564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 766/1542] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:23.421107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242619d-5de3-4748-a462-d4d2e2d094f5 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.422192 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242619d-5de3-4748-a462-d4d2e2d094f5 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.422683 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242619d-5de3-4748-a462-d4d2e2d094f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.454538 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-a242619d-5de3-4748-a462-d4d2e2d094f5 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:23.456320 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a242619d-5de3-4748-a462-d4d2e2d094f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:23.474174 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 777/1543] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:23.483754 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb855b-2eb1-460d-87cc-2ca3318671c4 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.484828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb855b-2eb1-460d-87cc-2ca3318671c4 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.485300 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb855b-2eb1-460d-87cc-2ca3318671c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.509821 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-4ccb855b-2eb1-460d-87cc-2ca3318671c4 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:23.511374 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4ccb855b-2eb1-460d-87cc-2ca3318671c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:23.522533 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 767/1544] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:23.528004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242619d-5de3-4748-a462-d4d2e2d094f5 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:23.538371 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242619d-5de3-4748-a462-d4d2e2d094f5 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:23.548773 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b4643-ad0b-48d2-a5cc-452f510923cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:23.549864 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4643-ad0b-48d2-a5cc-452f510923cf admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.550350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4643-ad0b-48d2-a5cc-452f510923cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.550856 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4643-ad0b-48d2-a5cc-452f510923cf admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.551830 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b4643-ad0b-48d2-a5cc-452f510923cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:23.552364 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b4643-ad0b-48d2-a5cc-452f510923cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:23.554197 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b4643-ad0b-48d2-a5cc-452f510923cf admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:23.568361 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ffd50-c3c8-4486-a730-001ef17042cc None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.569033 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ffd50-c3c8-4486-a730-001ef17042cc None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.569572 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ffd50-c3c8-4486-a730-001ef17042cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.579747 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 778/1545] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:23.581505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08459a60-bcc8-40a4-8196-7b4b519027ca None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.582016 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08459a60-bcc8-40a4-8196-7b4b519027ca None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.583263 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08459a60-bcc8-40a4-8196-7b4b519027ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.598669 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-e11ffd50-c3c8-4486-a730-001ef17042cc None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:23.599809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e11ffd50-c3c8-4486-a730-001ef17042cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:23.616098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-08459a60-bcc8-40a4-8196-7b4b519027ca None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:23.617720 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-08459a60-bcc8-40a4-8196-7b4b519027ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:23.629906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 768/1546] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:23.632755 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ffd50-c3c8-4486-a730-001ef17042cc None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:23.642035 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 779/1547] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:23.643850 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e63981-58b3-45bf-9943-34482db09681 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.646928 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e63981-58b3-45bf-9943-34482db09681 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.647691 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e63981-58b3-45bf-9943-34482db09681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.664969 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ffd50-c3c8-4486-a730-001ef17042cc None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:23.682323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eccedb-d9cf-4ef8-9891-ed34797ab418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:23.682999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eccedb-d9cf-4ef8-9891-ed34797ab418 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.683279 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eccedb-d9cf-4ef8-9891-ed34797ab418 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.683605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eccedb-d9cf-4ef8-9891-ed34797ab418 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.684339 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eccedb-d9cf-4ef8-9891-ed34797ab418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:23.686258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eccedb-d9cf-4ef8-9891-ed34797ab418 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:23.688413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-22e63981-58b3-45bf-9943-34482db09681 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:23.689598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-22e63981-58b3-45bf-9943-34482db09681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:23.710316 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 780/1548] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:23.712160 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63f96d-6155-4f29-8f3b-9d548c982d8b None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.712661 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63f96d-6155-4f29-8f3b-9d548c982d8b None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.712936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63f96d-6155-4f29-8f3b-9d548c982d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.736280 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 769/1549] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:23.740176 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4ef9a-ff9d-4c62-a08e-7836ab4f2df0 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.741202 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4ef9a-ff9d-4c62-a08e-7836ab4f2df0 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.741979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4ef9a-ff9d-4c62-a08e-7836ab4f2df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.750758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-ed63f96d-6155-4f29-8f3b-9d548c982d8b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:23.752106 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ed63f96d-6155-4f29-8f3b-9d548c982d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:23.761455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-73b4ef9a-ff9d-4c62-a08e-7836ab4f2df0 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:23.762986 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-73b4ef9a-ff9d-4c62-a08e-7836ab4f2df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:23.816049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 781/1550] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:23.817505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7db252-f6d1-477d-9218-38097fd86b49 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.817747 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7db252-f6d1-477d-9218-38097fd86b49 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.818024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7db252-f6d1-477d-9218-38097fd86b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.823059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 770/1551] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:23.824423 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7d294-6386-4c86-9318-20a624a13f71 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.824707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7d294-6386-4c86-9318-20a624a13f71 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.824973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7d294-6386-4c86-9318-20a624a13f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.835803 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-7e7db252-f6d1-477d-9218-38097fd86b49 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:23.837016 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7e7db252-f6d1-477d-9218-38097fd86b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:23.842001 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-39f7d294-6386-4c86-9318-20a624a13f71 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:23.843261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-39f7d294-6386-4c86-9318-20a624a13f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:23.844929 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 782/1552] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:23.845445 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7db252-f6d1-477d-9218-38097fd86b49 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:23.854810 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7db252-f6d1-477d-9218-38097fd86b49 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:23.858731 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 771/1553] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:23.859172 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977359d-38ba-405b-8e61-404c9f036dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:23.859823 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977359d-38ba-405b-8e61-404c9f036dee admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.860056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759cbf7-8b6e-43a9-b28e-b04190173764 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.860165 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977359d-38ba-405b-8e61-404c9f036dee admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.860372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759cbf7-8b6e-43a9-b28e-b04190173764 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.860482 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977359d-38ba-405b-8e61-404c9f036dee admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.860635 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759cbf7-8b6e-43a9-b28e-b04190173764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.861113 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977359d-38ba-405b-8e61-404c9f036dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:23.863166 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977359d-38ba-405b-8e61-404c9f036dee admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:23.878263 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-9759cbf7-8b6e-43a9-b28e-b04190173764 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:23.879420 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-9759cbf7-8b6e-43a9-b28e-b04190173764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:23.883970 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 783/1554] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/users => generated 292 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:23.885301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d949aa2-871d-4b5a-a246-88fbd95059e9 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.885580 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d949aa2-871d-4b5a-a246-88fbd95059e9 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.885853 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d949aa2-871d-4b5a-a246-88fbd95059e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.887800 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 772/1555] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:23.888999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616fbc9-fb19-4482-8495-f4df43d565aa None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.889280 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616fbc9-fb19-4482-8495-f4df43d565aa None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.889553 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616fbc9-fb19-4482-8495-f4df43d565aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.905248 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-7d949aa2-871d-4b5a-a246-88fbd95059e9 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:23.906451 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7d949aa2-871d-4b5a-a246-88fbd95059e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:23.907569 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-d616fbc9-fb19-4482-8495-f4df43d565aa None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:23.908721 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-d616fbc9-fb19-4482-8495-f4df43d565aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:23.914825 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 784/1556] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:23.916542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 773/1557] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:23.917347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616fbc9-fb19-4482-8495-f4df43d565aa None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:23.917514 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d949aa2-871d-4b5a-a246-88fbd95059e9 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:23.927736 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d949aa2-871d-4b5a-a246-88fbd95059e9 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:23.932273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a16fba-b388-4314-a946-5feea0c9a08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:23.932934 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a16fba-b388-4314-a946-5feea0c9a08a admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.933051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616fbc9-fb19-4482-8495-f4df43d565aa None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:23.933212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a16fba-b388-4314-a946-5feea0c9a08a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.933514 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a16fba-b388-4314-a946-5feea0c9a08a admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.934257 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a16fba-b388-4314-a946-5feea0c9a08a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:23.934569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a16fba-b388-4314-a946-5feea0c9a08a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:23.936182 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a16fba-b388-4314-a946-5feea0c9a08a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:23.937523 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87659336-83b9-4533-8e20-482b770f7ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:23.938172 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87659336-83b9-4533-8e20-482b770f7ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.938446 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87659336-83b9-4533-8e20-482b770f7ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.938746 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87659336-83b9-4533-8e20-482b770f7ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.939458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87659336-83b9-4533-8e20-482b770f7ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:23.939756 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87659336-83b9-4533-8e20-482b770f7ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:23.940795 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING py.warnings [None req-87659336-83b9-4533-8e20-482b770f7ae7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:52:23.940795 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: warnings.warn(msg) Nov 02 12:52:23.940795 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: Nov 02 12:52:23.941660 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87659336-83b9-4533-8e20-482b770f7ae7 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:23.947560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 785/1558] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:23.949209 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d564104-f6ad-47ce-a9cc-5ae7a31d722c None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.949209 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d564104-f6ad-47ce-a9cc-5ae7a31d722c None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.949445 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d564104-f6ad-47ce-a9cc-5ae7a31d722c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.954246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 774/1559] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:23.955268 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87659336-83b9-4533-8e20-482b770f7ae7 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:23.966332 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87659336-83b9-4533-8e20-482b770f7ae7 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:23.970160 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-1d564104-f6ad-47ce-a9cc-5ae7a31d722c None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:23.970951 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df0185-8694-4508-af38-620ce73ea925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:23.971375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1d564104-f6ad-47ce-a9cc-5ae7a31d722c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:23.971594 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df0185-8694-4508-af38-620ce73ea925 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.971869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df0185-8694-4508-af38-620ce73ea925 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.972136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df0185-8694-4508-af38-620ce73ea925 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.972883 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df0185-8694-4508-af38-620ce73ea925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:23.973181 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df0185-8694-4508-af38-620ce73ea925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:23.974784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df0185-8694-4508-af38-620ce73ea925 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:23.979229 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 786/1560] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:23.980053 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d564104-f6ad-47ce-a9cc-5ae7a31d722c None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:23.986717 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 775/1561] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:23.988015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f0ec2-d08d-43bc-9369-1d893d7154cc None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.988328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f0ec2-d08d-43bc-9369-1d893d7154cc None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.988601 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f0ec2-d08d-43bc-9369-1d893d7154cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.989846 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d564104-f6ad-47ce-a9cc-5ae7a31d722c None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:23.994540 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf18e93-929c-4ca9-bd77-e82f6e73784f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:23.995202 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf18e93-929c-4ca9-bd77-e82f6e73784f admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.995478 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf18e93-929c-4ca9-bd77-e82f6e73784f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.995762 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf18e93-929c-4ca9-bd77-e82f6e73784f admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.996772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf18e93-929c-4ca9-bd77-e82f6e73784f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:23.998796 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf18e93-929c-4ca9-bd77-e82f6e73784f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.007365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-b28f0ec2-d08d-43bc-9369-1d893d7154cc None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:24.008985 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b28f0ec2-d08d-43bc-9369-1d893d7154cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:24.009122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 787/1562] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:24.009972 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c446d87-6b1f-49b7-b871-65bc41e7a3e6 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.010254 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c446d87-6b1f-49b7-b871-65bc41e7a3e6 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.010527 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c446d87-6b1f-49b7-b871-65bc41e7a3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.017239 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 776/1563] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:24.018580 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b180a-a449-423a-aeaf-250d404f3590 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.018860 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b180a-a449-423a-aeaf-250d404f3590 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.019127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b180a-a449-423a-aeaf-250d404f3590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.029143 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-3c446d87-6b1f-49b7-b871-65bc41e7a3e6 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:24.030309 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-3c446d87-6b1f-49b7-b871-65bc41e7a3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:24.037196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-419b180a-a449-423a-aeaf-250d404f3590 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:24.038339 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-419b180a-a449-423a-aeaf-250d404f3590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:24.038464 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 788/1564] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:24.039337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c446d87-6b1f-49b7-b871-65bc41e7a3e6 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.048536 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 777/1565] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:24.049100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c446d87-6b1f-49b7-b871-65bc41e7a3e6 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.049331 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b180a-a449-423a-aeaf-250d404f3590 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.053762 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233b6ca-35e5-4e24-ab2d-8b96b2493a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.054414 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233b6ca-35e5-4e24-ab2d-8b96b2493a4e admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.054697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233b6ca-35e5-4e24-ab2d-8b96b2493a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.054969 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233b6ca-35e5-4e24-ab2d-8b96b2493a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.056017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233b6ca-35e5-4e24-ab2d-8b96b2493a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.056765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING py.warnings [None req-b233b6ca-35e5-4e24-ab2d-8b96b2493a4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:52:24.056765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: warnings.warn(msg) Nov 02 12:52:24.056765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: Nov 02 12:52:24.057919 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233b6ca-35e5-4e24-ab2d-8b96b2493a4e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.058809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b180a-a449-423a-aeaf-250d404f3590 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.063410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e88af-c8f9-4145-87ce-2144480fd96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.064148 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e88af-c8f9-4145-87ce-2144480fd96b admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.064511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e88af-c8f9-4145-87ce-2144480fd96b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.064846 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e88af-c8f9-4145-87ce-2144480fd96b admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.065586 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e88af-c8f9-4145-87ce-2144480fd96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.067674 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e88af-c8f9-4145-87ce-2144480fd96b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.083566 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 789/1566] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.084672 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233b6ca-35e5-4e24-ab2d-8b96b2493a4e admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.095440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 778/1567] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.096391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e88af-c8f9-4145-87ce-2144480fd96b admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.145506 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233b6ca-35e5-4e24-ab2d-8b96b2493a4e admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.160102 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e88af-c8f9-4145-87ce-2144480fd96b admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.165054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eeb627-065b-4c17-91b8-2994187cee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.165844 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eeb627-065b-4c17-91b8-2994187cee42 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.166165 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eeb627-065b-4c17-91b8-2994187cee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.166532 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eeb627-065b-4c17-91b8-2994187cee42 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.167214 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eeb627-065b-4c17-91b8-2994187cee42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.169301 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eeb627-065b-4c17-91b8-2994187cee42 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.193979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 779/1568] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.194800 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eeb627-065b-4c17-91b8-2994187cee42 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.200490 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420764d-739f-43ef-bc27-56af9ec371a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.201164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420764d-739f-43ef-bc27-56af9ec371a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.201438 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420764d-739f-43ef-bc27-56af9ec371a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.201701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420764d-739f-43ef-bc27-56af9ec371a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.202416 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420764d-739f-43ef-bc27-56af9ec371a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:24.202715 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420764d-739f-43ef-bc27-56af9ec371a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.204338 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420764d-739f-43ef-bc27-56af9ec371a5 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.216565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 790/1569] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:24.217401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420764d-739f-43ef-bc27-56af9ec371a5 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.227056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420764d-739f-43ef-bc27-56af9ec371a5 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.255772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eeb627-065b-4c17-91b8-2994187cee42 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.260495 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8068b0-60fe-467e-bcb4-84fd86ddd7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.261156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8068b0-60fe-467e-bcb4-84fd86ddd7aa admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.261435 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8068b0-60fe-467e-bcb4-84fd86ddd7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.261731 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8068b0-60fe-467e-bcb4-84fd86ddd7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.262453 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8068b0-60fe-467e-bcb4-84fd86ddd7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.264051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8068b0-60fe-467e-bcb4-84fd86ddd7aa admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.274256 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 780/1570] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:24.276716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8068b0-60fe-467e-bcb4-84fd86ddd7aa admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.284225 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51954f8-4e16-436b-8fea-fb6e3886a97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.285223 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51954f8-4e16-436b-8fea-fb6e3886a97c admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.285519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51954f8-4e16-436b-8fea-fb6e3886a97c admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.285769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51954f8-4e16-436b-8fea-fb6e3886a97c admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.286526 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51954f8-4e16-436b-8fea-fb6e3886a97c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:24.286843 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51954f8-4e16-436b-8fea-fb6e3886a97c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.287971 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8068b0-60fe-467e-bcb4-84fd86ddd7aa admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.288458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51954f8-4e16-436b-8fea-fb6e3886a97c admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.292703 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1398b2b-3ed9-4871-be7d-4047c53f229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.293540 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1398b2b-3ed9-4871-be7d-4047c53f229b admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.293803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1398b2b-3ed9-4871-be7d-4047c53f229b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.294070 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1398b2b-3ed9-4871-be7d-4047c53f229b admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.294774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1398b2b-3ed9-4871-be7d-4047c53f229b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:24.295197 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1398b2b-3ed9-4871-be7d-4047c53f229b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.296804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1398b2b-3ed9-4871-be7d-4047c53f229b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.300355 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 791/1571] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:24.301394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51954f8-4e16-436b-8fea-fb6e3886a97c admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.309357 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 781/1572] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:24.310255 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1398b2b-3ed9-4871-be7d-4047c53f229b admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.320121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51954f8-4e16-436b-8fea-fb6e3886a97c admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.324071 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1398b2b-3ed9-4871-be7d-4047c53f229b admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.324885 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444d76e-a6a7-4538-a57c-c82309abdf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.325634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444d76e-a6a7-4538-a57c-c82309abdf29 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.325912 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444d76e-a6a7-4538-a57c-c82309abdf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.326185 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444d76e-a6a7-4538-a57c-c82309abdf29 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.326903 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444d76e-a6a7-4538-a57c-c82309abdf29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:24.327204 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444d76e-a6a7-4538-a57c-c82309abdf29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.328843 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444d76e-a6a7-4538-a57c-c82309abdf29 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.328956 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672ee65-c367-4968-a3ca-87db0ffbaba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.329541 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672ee65-c367-4968-a3ca-87db0ffbaba9 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.329822 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672ee65-c367-4968-a3ca-87db0ffbaba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.330231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672ee65-c367-4968-a3ca-87db0ffbaba9 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.330780 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672ee65-c367-4968-a3ca-87db0ffbaba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.331788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING py.warnings [None req-9672ee65-c367-4968-a3ca-87db0ffbaba9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:52:24.331788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: warnings.warn(msg) Nov 02 12:52:24.331788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: Nov 02 12:52:24.333014 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672ee65-c367-4968-a3ca-87db0ffbaba9 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.340819 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 792/1573] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:24.342541 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444d76e-a6a7-4538-a57c-c82309abdf29 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.356093 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 782/1574] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.356931 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672ee65-c367-4968-a3ca-87db0ffbaba9 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.360767 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444d76e-a6a7-4538-a57c-c82309abdf29 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.365158 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855db5d5-5001-4df1-933a-38f93f7b0b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.365843 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855db5d5-5001-4df1-933a-38f93f7b0b70 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.366115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855db5d5-5001-4df1-933a-38f93f7b0b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.366384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855db5d5-5001-4df1-933a-38f93f7b0b70 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.366752 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672ee65-c367-4968-a3ca-87db0ffbaba9 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.367059 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855db5d5-5001-4df1-933a-38f93f7b0b70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.369330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855db5d5-5001-4df1-933a-38f93f7b0b70 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.371280 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1b655-9eac-494c-9a34-521e0396afbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.371928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1b655-9eac-494c-9a34-521e0396afbb admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.372228 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1b655-9eac-494c-9a34-521e0396afbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.372585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1b655-9eac-494c-9a34-521e0396afbb admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.373260 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1b655-9eac-494c-9a34-521e0396afbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.375162 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1b655-9eac-494c-9a34-521e0396afbb admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.392102 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 793/1575] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/users => generated 288 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.393121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855db5d5-5001-4df1-933a-38f93f7b0b70 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.398156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 783/1576] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/users => generated 296 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.398971 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1b655-9eac-494c-9a34-521e0396afbb admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.405333 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855db5d5-5001-4df1-933a-38f93f7b0b70 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.408517 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1b655-9eac-494c-9a34-521e0396afbb admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.410434 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca146ee-434e-46b2-81e4-3cfe8d4079fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.411082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca146ee-434e-46b2-81e4-3cfe8d4079fb admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.411361 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca146ee-434e-46b2-81e4-3cfe8d4079fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.411641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca146ee-434e-46b2-81e4-3cfe8d4079fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.412357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca146ee-434e-46b2-81e4-3cfe8d4079fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.413117 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0927cf-d644-48a7-9200-a4a8e62e70e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.414006 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0927cf-d644-48a7-9200-a4a8e62e70e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.414269 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca146ee-434e-46b2-81e4-3cfe8d4079fb admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.414376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0927cf-d644-48a7-9200-a4a8e62e70e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.414541 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0927cf-d644-48a7-9200-a4a8e62e70e5 admin admin] PATH_INFO: `/v3/projects/5d515d4c1420428984835605607e2699/users/9e3276c1f93f4effbdc418cf43d4f0a4/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.430332 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0927cf-d644-48a7-9200-a4a8e62e70e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d515d4c1420428984835605607e2699, user_id=9e3276c1f93f4effbdc418cf43d4f0a4, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.433519 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0927cf-d644-48a7-9200-a4a8e62e70e5 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.441612 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 794/1577] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.445825 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca146ee-434e-46b2-81e4-3cfe8d4079fb admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.447968 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 784/1578] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:24 2022] PUT /identity/v3/projects/5d515d4c1420428984835605607e2699/users/9e3276c1f93f4effbdc418cf43d4f0a4/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:24.448792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0927cf-d644-48a7-9200-a4a8e62e70e5 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.512159 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca146ee-434e-46b2-81e4-3cfe8d4079fb admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.515901 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0927cf-d644-48a7-9200-a4a8e62e70e5 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.516979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589fc5-155e-4ee3-8918-bbdb7093213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.517696 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589fc5-155e-4ee3-8918-bbdb7093213c admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.517976 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589fc5-155e-4ee3-8918-bbdb7093213c admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.518255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589fc5-155e-4ee3-8918-bbdb7093213c admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.518950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589fc5-155e-4ee3-8918-bbdb7093213c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.520530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275e75e-8644-4ad6-9aa9-7a86c7343a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.520905 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589fc5-155e-4ee3-8918-bbdb7093213c admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.521185 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275e75e-8644-4ad6-9aa9-7a86c7343a4e admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.521462 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275e75e-8644-4ad6-9aa9-7a86c7343a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.521735 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275e75e-8644-4ad6-9aa9-7a86c7343a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.522714 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275e75e-8644-4ad6-9aa9-7a86c7343a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.524698 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275e75e-8644-4ad6-9aa9-7a86c7343a4e admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.548804 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 795/1579] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.549445 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589fc5-155e-4ee3-8918-bbdb7093213c admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.554788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 785/1580] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.554788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275e75e-8644-4ad6-9aa9-7a86c7343a4e admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.608309 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589fc5-155e-4ee3-8918-bbdb7093213c admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.612854 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad797b-19f5-498c-b574-8a1e0ecd5adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.613282 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275e75e-8644-4ad6-9aa9-7a86c7343a4e admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.613507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad797b-19f5-498c-b574-8a1e0ecd5adc admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.613778 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad797b-19f5-498c-b574-8a1e0ecd5adc admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.614041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad797b-19f5-498c-b574-8a1e0ecd5adc admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.614710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad797b-19f5-498c-b574-8a1e0ecd5adc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.616674 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad797b-19f5-498c-b574-8a1e0ecd5adc admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.617839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d20c6-f545-4c19-b665-90fac9cc3d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.618484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d20c6-f545-4c19-b665-90fac9cc3d86 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.618791 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d20c6-f545-4c19-b665-90fac9cc3d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.619065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d20c6-f545-4c19-b665-90fac9cc3d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.619788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d20c6-f545-4c19-b665-90fac9cc3d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.621438 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d20c6-f545-4c19-b665-90fac9cc3d86 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.631242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 786/1581] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:24.631983 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d20c6-f545-4c19-b665-90fac9cc3d86 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.643095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d20c6-f545-4c19-b665-90fac9cc3d86 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.644972 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 796/1582] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.647684 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad797b-19f5-498c-b574-8a1e0ecd5adc admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.713237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba6141-8d7a-4aa8-8781-f8d525495fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.713909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba6141-8d7a-4aa8-8781-f8d525495fcc admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.714189 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba6141-8d7a-4aa8-8781-f8d525495fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.714461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba6141-8d7a-4aa8-8781-f8d525495fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.715215 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba6141-8d7a-4aa8-8781-f8d525495fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.717013 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba6141-8d7a-4aa8-8781-f8d525495fcc admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.722991 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad797b-19f5-498c-b574-8a1e0ecd5adc admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.730316 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad8e76-d441-4917-b6fb-19f56ec749df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.730548 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 787/1583] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:24.730652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad8e76-d441-4917-b6fb-19f56ec749df admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.730652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad8e76-d441-4917-b6fb-19f56ec749df admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.730822 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba6141-8d7a-4aa8-8781-f8d525495fcc admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.730904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad8e76-d441-4917-b6fb-19f56ec749df admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.730904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad8e76-d441-4917-b6fb-19f56ec749df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.731401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad8e76-d441-4917-b6fb-19f56ec749df admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.740629 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba6141-8d7a-4aa8-8781-f8d525495fcc admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.742411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 797/1584] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:24.743697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0654e-fbef-47f5-aee6-7e571a4000e9 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.743983 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0654e-fbef-47f5-aee6-7e571a4000e9 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.745367 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0654e-fbef-47f5-aee6-7e571a4000e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.752237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c44b30-72df-4d82-be97-d179bfceb705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.752925 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c44b30-72df-4d82-be97-d179bfceb705 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.753250 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c44b30-72df-4d82-be97-d179bfceb705 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.753477 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c44b30-72df-4d82-be97-d179bfceb705 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.754169 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c44b30-72df-4d82-be97-d179bfceb705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.756616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c44b30-72df-4d82-be97-d179bfceb705 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.771987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-fec0654e-fbef-47f5-aee6-7e571a4000e9 None None] MFA Rules not processed for user `9e3276c1f93f4effbdc418cf43d4f0a4`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:24.776557 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-fec0654e-fbef-47f5-aee6-7e571a4000e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:24.790727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 788/1585] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/users => generated 283 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.790727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c44b30-72df-4d82-be97-d179bfceb705 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.803496 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c44b30-72df-4d82-be97-d179bfceb705 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.809841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edd6dc-7b74-43e2-b92d-23fb4616f218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.810650 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edd6dc-7b74-43e2-b92d-23fb4616f218 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.811028 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edd6dc-7b74-43e2-b92d-23fb4616f218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.811396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edd6dc-7b74-43e2-b92d-23fb4616f218 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.812182 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edd6dc-7b74-43e2-b92d-23fb4616f218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.814228 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edd6dc-7b74-43e2-b92d-23fb4616f218 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.836984 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 789/1586] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.838125 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edd6dc-7b74-43e2-b92d-23fb4616f218 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.843453 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 798/1587] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:24.844753 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0654e-fbef-47f5-aee6-7e571a4000e9 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.848566 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edd6dc-7b74-43e2-b92d-23fb4616f218 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.854696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc6f22-6f47-4157-8b69-43b653b14033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.855535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0654e-fbef-47f5-aee6-7e571a4000e9 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.856010 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc6f22-6f47-4157-8b69-43b653b14033 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.856317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc6f22-6f47-4157-8b69-43b653b14033 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.856713 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc6f22-6f47-4157-8b69-43b653b14033 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.857386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc6f22-6f47-4157-8b69-43b653b14033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.859309 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc6f22-6f47-4157-8b69-43b653b14033 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.860801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908d203-5c07-4146-a0d2-a233190e0a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.861476 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908d203-5c07-4146-a0d2-a233190e0a69 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.861750 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908d203-5c07-4146-a0d2-a233190e0a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.862002 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908d203-5c07-4146-a0d2-a233190e0a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.862727 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908d203-5c07-4146-a0d2-a233190e0a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.864357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908d203-5c07-4146-a0d2-a233190e0a69 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.876839 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 799/1588] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:24.877666 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908d203-5c07-4146-a0d2-a233190e0a69 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.884154 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 790/1589] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.888535 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc6f22-6f47-4157-8b69-43b653b14033 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.890818 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908d203-5c07-4146-a0d2-a233190e0a69 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.895414 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f57a0-aae8-4391-991b-9e65036742eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.896138 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f57a0-aae8-4391-991b-9e65036742eb admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.896445 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f57a0-aae8-4391-991b-9e65036742eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.896721 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f57a0-aae8-4391-991b-9e65036742eb admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.897742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f57a0-aae8-4391-991b-9e65036742eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.899147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc6f22-6f47-4157-8b69-43b653b14033 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.899783 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f57a0-aae8-4391-991b-9e65036742eb admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.904086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f89354-b17d-4e50-b0c2-c0543528d66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.905071 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f89354-b17d-4e50-b0c2-c0543528d66e admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.905529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f89354-b17d-4e50-b0c2-c0543528d66e admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.905962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f89354-b17d-4e50-b0c2-c0543528d66e admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.906841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f89354-b17d-4e50-b0c2-c0543528d66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.908464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f89354-b17d-4e50-b0c2-c0543528d66e admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.919766 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 791/1590] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:24.920668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f89354-b17d-4e50-b0c2-c0543528d66e admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.924260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 800/1591] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.924260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f57a0-aae8-4391-991b-9e65036742eb admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.932392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f57a0-aae8-4391-991b-9e65036742eb admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.934432 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f89354-b17d-4e50-b0c2-c0543528d66e admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.936975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe69fa3-d507-4530-8d74-a4f53d066eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.937679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69fa3-d507-4530-8d74-a4f53d066eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.937991 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69fa3-d507-4530-8d74-a4f53d066eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.938212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69fa3-d507-4530-8d74-a4f53d066eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.938922 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe69fa3-d507-4530-8d74-a4f53d066eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.939692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75f24a-f1d2-4f1b-942e-bce746e1a23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.940409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75f24a-f1d2-4f1b-942e-bce746e1a23b admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.940594 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe69fa3-d507-4530-8d74-a4f53d066eb3 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.940698 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75f24a-f1d2-4f1b-942e-bce746e1a23b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.940954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75f24a-f1d2-4f1b-942e-bce746e1a23b admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.941676 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75f24a-f1d2-4f1b-942e-bce746e1a23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.943384 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75f24a-f1d2-4f1b-942e-bce746e1a23b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.955799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 801/1592] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:24.955799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe69fa3-d507-4530-8d74-a4f53d066eb3 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.956078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 792/1593] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:24.956078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb070f2-8afb-4d19-bcd9-63279f7fad68 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.956078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb070f2-8afb-4d19-bcd9-63279f7fad68 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.956531 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb070f2-8afb-4d19-bcd9-63279f7fad68 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.959221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 793/1594] 10.222.0.90 () {54 vars in 959 bytes} [Wed Nov 2 12:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:52:24.959221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb070f2-8afb-4d19-bcd9-63279f7fad68 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.969087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe69fa3-d507-4530-8d74-a4f53d066eb3 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.971547 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb070f2-8afb-4d19-bcd9-63279f7fad68 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.973587 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452059b5-e6bd-4ff3-9d15-dcca8d053a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.974304 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452059b5-e6bd-4ff3-9d15-dcca8d053a5a admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.974581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452059b5-e6bd-4ff3-9d15-dcca8d053a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.974950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452059b5-e6bd-4ff3-9d15-dcca8d053a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.975675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452059b5-e6bd-4ff3-9d15-dcca8d053a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.976314 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06c424-2328-430e-af9a-bc043e955ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.977198 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06c424-2328-430e-af9a-bc043e955ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.977317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452059b5-e6bd-4ff3-9d15-dcca8d053a5a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.977469 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06c424-2328-430e-af9a-bc043e955ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.977739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06c424-2328-430e-af9a-bc043e955ac9 admin admin] PATH_INFO: `/v3/projects/cbac433718c142539d5d9e3f268e661e/users/8ff6826688a849a597e48fd9c798b0f8/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.987447 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 802/1595] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:24.988301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452059b5-e6bd-4ff3-9d15-dcca8d053a5a admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.994488 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06c424-2328-430e-af9a-bc043e955ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbac433718c142539d5d9e3f268e661e, user_id=8ff6826688a849a597e48fd9c798b0f8, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.997260 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06c424-2328-430e-af9a-bc043e955ac9 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.999390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452059b5-e6bd-4ff3-9d15-dcca8d053a5a admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.004256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6931b-afd9-4c24-999a-536b559f42eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.004910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6931b-afd9-4c24-999a-536b559f42eb admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.005164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6931b-afd9-4c24-999a-536b559f42eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.005430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6931b-afd9-4c24-999a-536b559f42eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.008824 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6931b-afd9-4c24-999a-536b559f42eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.010503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6931b-afd9-4c24-999a-536b559f42eb admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.018307 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 794/1596] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:24 2022] PUT /identity/v3/projects/cbac433718c142539d5d9e3f268e661e/users/8ff6826688a849a597e48fd9c798b0f8/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:25.018307 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06c424-2328-430e-af9a-bc043e955ac9 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.024054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 803/1597] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:25.024054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6931b-afd9-4c24-999a-536b559f42eb admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.032304 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6931b-afd9-4c24-999a-536b559f42eb admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.084662 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06c424-2328-430e-af9a-bc043e955ac9 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.087420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a224f6-9ac9-4040-a0f1-c6124410d814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.088161 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a224f6-9ac9-4040-a0f1-c6124410d814 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.088475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a224f6-9ac9-4040-a0f1-c6124410d814 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.088745 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a224f6-9ac9-4040-a0f1-c6124410d814 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.089489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a224f6-9ac9-4040-a0f1-c6124410d814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.089590 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fa64c-4221-4919-b264-129bbc95446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.090467 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fa64c-4221-4919-b264-129bbc95446d admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.090746 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fa64c-4221-4919-b264-129bbc95446d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.091016 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fa64c-4221-4919-b264-129bbc95446d admin admin] PATH_INFO: `/v3/projects/7d2c4b25d8f447e99927fa32e9f35b1a/users/fd0b35be3944451d961e68ed1e39afc2/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.091161 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a224f6-9ac9-4040-a0f1-c6124410d814 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.100759 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 804/1598] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:25.101560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a224f6-9ac9-4040-a0f1-c6124410d814 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.105471 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fa64c-4221-4919-b264-129bbc95446d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2c4b25d8f447e99927fa32e9f35b1a, user_id=fd0b35be3944451d961e68ed1e39afc2, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.108117 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fa64c-4221-4919-b264-129bbc95446d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.111678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a224f6-9ac9-4040-a0f1-c6124410d814 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.116746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a57f9b-d156-4ce8-bfdd-cf94a41f6436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.117425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a57f9b-d156-4ce8-bfdd-cf94a41f6436 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.117740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a57f9b-d156-4ce8-bfdd-cf94a41f6436 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.118017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a57f9b-d156-4ce8-bfdd-cf94a41f6436 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.118875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a57f9b-d156-4ce8-bfdd-cf94a41f6436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.120468 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a57f9b-d156-4ce8-bfdd-cf94a41f6436 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.122638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 795/1599] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:25 2022] PUT /identity/v3/projects/7d2c4b25d8f447e99927fa32e9f35b1a/users/fd0b35be3944451d961e68ed1e39afc2/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:25.123262 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fa64c-4221-4919-b264-129bbc95446d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.134171 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 805/1600] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:25.135710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d2e90-450e-459b-a990-a84d733f5d63 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.136117 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d2e90-450e-459b-a990-a84d733f5d63 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.136458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d2e90-450e-459b-a990-a84d733f5d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.155066 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-a42d2e90-450e-459b-a990-a84d733f5d63 None None] MFA Rules not processed for user `fbcda58f298444eebf4f08ce01deffc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:25.156276 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a42d2e90-450e-459b-a990-a84d733f5d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:25.186240 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fa64c-4221-4919-b264-129bbc95446d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.191028 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f09519-ee8a-4702-be11-d2c36c8f43ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.191920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f09519-ee8a-4702-be11-d2c36c8f43ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.192211 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f09519-ee8a-4702-be11-d2c36c8f43ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.192492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f09519-ee8a-4702-be11-d2c36c8f43ac admin admin] PATH_INFO: `/v3/projects/9d086a8e68a94153b5d2a15d6d54fc63/users/12d35ac129c24e118df9ebee0c8c9f6f/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.210186 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f09519-ee8a-4702-be11-d2c36c8f43ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d086a8e68a94153b5d2a15d6d54fc63, user_id=12d35ac129c24e118df9ebee0c8c9f6f, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.212934 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f09519-ee8a-4702-be11-d2c36c8f43ac admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.223112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 806/1601] 10.222.0.90 () {58 vars in 1056 bytes} [Wed Nov 2 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:25.223936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d2e90-450e-459b-a990-a84d733f5d63 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.228813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 796/1602] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:25 2022] PUT /identity/v3/projects/9d086a8e68a94153b5d2a15d6d54fc63/users/12d35ac129c24e118df9ebee0c8c9f6f/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:25.233305 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f09519-ee8a-4702-be11-d2c36c8f43ac admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.234345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d2e90-450e-459b-a990-a84d733f5d63 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.289897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673a3fe-8d8a-4fa5-ab63-47fb26a29912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.290724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673a3fe-8d8a-4fa5-ab63-47fb26a29912 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.291072 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673a3fe-8d8a-4fa5-ab63-47fb26a29912 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.291407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673a3fe-8d8a-4fa5-ab63-47fb26a29912 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.292221 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673a3fe-8d8a-4fa5-ab63-47fb26a29912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.293940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673a3fe-8d8a-4fa5-ab63-47fb26a29912 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.294127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f09519-ee8a-4702-be11-d2c36c8f43ac admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.298882 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8949b06-fbd8-4b86-a73c-af1cd91b693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.299542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8949b06-fbd8-4b86-a73c-af1cd91b693a admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.299814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8949b06-fbd8-4b86-a73c-af1cd91b693a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.300081 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8949b06-fbd8-4b86-a73c-af1cd91b693a admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.300856 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8949b06-fbd8-4b86-a73c-af1cd91b693a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.302461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8949b06-fbd8-4b86-a73c-af1cd91b693a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.303650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 807/1603] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:25.304700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e168ff2-1bfc-45c7-8f2f-137c1bc04c02 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.304998 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e168ff2-1bfc-45c7-8f2f-137c1bc04c02 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.305269 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e168ff2-1bfc-45c7-8f2f-137c1bc04c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.313341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 797/1604] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:25.314233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8949b06-fbd8-4b86-a73c-af1cd91b693a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.324321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8949b06-fbd8-4b86-a73c-af1cd91b693a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.328786 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf31ae8-cfaa-45cb-9b2c-e25af5254670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.329439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf31ae8-cfaa-45cb-9b2c-e25af5254670 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.329717 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf31ae8-cfaa-45cb-9b2c-e25af5254670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.329989 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf31ae8-cfaa-45cb-9b2c-e25af5254670 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.330699 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf31ae8-cfaa-45cb-9b2c-e25af5254670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.331879 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-7e168ff2-1bfc-45c7-8f2f-137c1bc04c02 None None] MFA Rules not processed for user `8ff6826688a849a597e48fd9c798b0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:25.332307 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf31ae8-cfaa-45cb-9b2c-e25af5254670 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.333098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7e168ff2-1bfc-45c7-8f2f-137c1bc04c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:25.341978 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 798/1605] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:25.343157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40923e9-590c-459a-b904-36efa29b4985 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.343450 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40923e9-590c-459a-b904-36efa29b4985 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.343727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40923e9-590c-459a-b904-36efa29b4985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.361232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-f40923e9-590c-459a-b904-36efa29b4985 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:25.362443 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f40923e9-590c-459a-b904-36efa29b4985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:25.370495 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 799/1606] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:25.371098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40923e9-590c-459a-b904-36efa29b4985 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.380422 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40923e9-590c-459a-b904-36efa29b4985 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.385743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4c221-85d0-431c-b72a-93483b8e0de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.386638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4c221-85d0-431c-b72a-93483b8e0de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.386976 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4c221-85d0-431c-b72a-93483b8e0de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.387360 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4c221-85d0-431c-b72a-93483b8e0de5 admin admin] PATH_INFO: `/v3/projects/ef61ab312aa949dcaa9875fb08960e5a/users/771c42af4a674278b80613409e4d512a/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.404338 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 808/1607] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:25.404338 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e168ff2-1bfc-45c7-8f2f-137c1bc04c02 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.404629 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4c221-85d0-431c-b72a-93483b8e0de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef61ab312aa949dcaa9875fb08960e5a, user_id=771c42af4a674278b80613409e4d512a, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.405518 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4c221-85d0-431c-b72a-93483b8e0de5 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.419396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 800/1608] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:25 2022] PUT /identity/v3/projects/ef61ab312aa949dcaa9875fb08960e5a/users/771c42af4a674278b80613409e4d512a/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:25.420725 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea838ab9-e07f-4ae5-b35a-0b79fbf50369 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.421038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea838ab9-e07f-4ae5-b35a-0b79fbf50369 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.421314 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea838ab9-e07f-4ae5-b35a-0b79fbf50369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.438782 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-ea838ab9-e07f-4ae5-b35a-0b79fbf50369 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:25.440029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ea838ab9-e07f-4ae5-b35a-0b79fbf50369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:25.481509 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e168ff2-1bfc-45c7-8f2f-137c1bc04c02 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.498156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 801/1609] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:25.499175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea838ab9-e07f-4ae5-b35a-0b79fbf50369 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.508992 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea838ab9-e07f-4ae5-b35a-0b79fbf50369 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.514754 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12847d07-2b8e-40f7-b1ce-50331871d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.515656 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12847d07-2b8e-40f7-b1ce-50331871d5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.515936 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12847d07-2b8e-40f7-b1ce-50331871d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.516571 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12847d07-2b8e-40f7-b1ce-50331871d5ec admin admin] PATH_INFO: `/v3/projects/2090a129b9d7453182069e28a631c253/users/7ef5d27eed58447692e8a9d5ce526319/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.531728 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12847d07-2b8e-40f7-b1ce-50331871d5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=2090a129b9d7453182069e28a631c253, user_id=7ef5d27eed58447692e8a9d5ce526319, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.534406 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12847d07-2b8e-40f7-b1ce-50331871d5ec admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.545194 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178e6e2-5c39-4702-b1ae-de337edeb010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.545870 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178e6e2-5c39-4702-b1ae-de337edeb010 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.546137 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178e6e2-5c39-4702-b1ae-de337edeb010 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.546404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178e6e2-5c39-4702-b1ae-de337edeb010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.549364 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 802/1610] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:25 2022] PUT /identity/v3/projects/2090a129b9d7453182069e28a631c253/users/7ef5d27eed58447692e8a9d5ce526319/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:25.550256 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12847d07-2b8e-40f7-b1ce-50331871d5ec admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.600665 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178e6e2-5c39-4702-b1ae-de337edeb010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.602278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178e6e2-5c39-4702-b1ae-de337edeb010 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.607782 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12847d07-2b8e-40f7-b1ce-50331871d5ec admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.610936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 809/1611] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:25.611730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178e6e2-5c39-4702-b1ae-de337edeb010 service nova] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.612461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc225cca-f37c-4ccb-adbf-db3d4a75d014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.613410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc225cca-f37c-4ccb-adbf-db3d4a75d014 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.613692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc225cca-f37c-4ccb-adbf-db3d4a75d014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.613963 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc225cca-f37c-4ccb-adbf-db3d4a75d014 admin admin] PATH_INFO: `/v3/projects/7cf71ef682d140f9b9c9c756b24cbb5b/users/a2c786462bac45848eeff3a966e71149/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.621155 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178e6e2-5c39-4702-b1ae-de337edeb010 service nova] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.625635 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95455239-2eae-47b4-8b43-316563a556ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.626503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95455239-2eae-47b4-8b43-316563a556ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.626781 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95455239-2eae-47b4-8b43-316563a556ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.627053 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95455239-2eae-47b4-8b43-316563a556ec admin admin] PATH_INFO: `/v3/projects/ac56ac8efe2d4a07aa0f1c7976ad8fe7/users/3a45298a10af4fc3991887cb4da55e86/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.628812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc225cca-f37c-4ccb-adbf-db3d4a75d014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf71ef682d140f9b9c9c756b24cbb5b, user_id=a2c786462bac45848eeff3a966e71149, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.631604 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc225cca-f37c-4ccb-adbf-db3d4a75d014 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.641724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95455239-2eae-47b4-8b43-316563a556ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac56ac8efe2d4a07aa0f1c7976ad8fe7, user_id=3a45298a10af4fc3991887cb4da55e86, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.642743 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING py.warnings [None req-95455239-2eae-47b4-8b43-316563a556ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:52:25.642743 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: warnings.warn(msg) Nov 02 12:52:25.642743 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: Nov 02 12:52:25.644700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95455239-2eae-47b4-8b43-316563a556ec admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.648785 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 803/1612] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:25 2022] PUT /identity/v3/projects/7cf71ef682d140f9b9c9c756b24cbb5b/users/a2c786462bac45848eeff3a966e71149/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:25.649613 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc225cca-f37c-4ccb-adbf-db3d4a75d014 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.669348 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 810/1613] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:25 2022] PUT /identity/v3/projects/ac56ac8efe2d4a07aa0f1c7976ad8fe7/users/3a45298a10af4fc3991887cb4da55e86/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:25.669348 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95455239-2eae-47b4-8b43-316563a556ec admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.714562 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc225cca-f37c-4ccb-adbf-db3d4a75d014 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.737680 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95455239-2eae-47b4-8b43-316563a556ec admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.742763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359454f6-4dc3-4a6e-b72e-e6864b75a8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.743652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359454f6-4dc3-4a6e-b72e-e6864b75a8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.743990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359454f6-4dc3-4a6e-b72e-e6864b75a8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.744361 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359454f6-4dc3-4a6e-b72e-e6864b75a8d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.745124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359454f6-4dc3-4a6e-b72e-e6864b75a8d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.747296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359454f6-4dc3-4a6e-b72e-e6864b75a8d3 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.775869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a807ad6-a252-484d-ad66-ed375529ff7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.776737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a807ad6-a252-484d-ad66-ed375529ff7b service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.777490 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a807ad6-a252-484d-ad66-ed375529ff7b service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.777862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a807ad6-a252-484d-ad66-ed375529ff7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.778424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 811/1614] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:25 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:25.779835 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aab6c-c799-4de0-ba89-39e72fa3da3b None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.780267 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aab6c-c799-4de0-ba89-39e72fa3da3b None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.780643 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aab6c-c799-4de0-ba89-39e72fa3da3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.789922 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a807ad6-a252-484d-ad66-ed375529ff7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.799399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a807ad6-a252-484d-ad66-ed375529ff7b service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.811746 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 804/1615] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:25.812861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a807ad6-a252-484d-ad66-ed375529ff7b service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.822676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-0a0aab6c-c799-4de0-ba89-39e72fa3da3b None None] MFA Rules not processed for user `771c42af4a674278b80613409e4d512a`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:25.823636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a807ad6-a252-484d-ad66-ed375529ff7b service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.825737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0a0aab6c-c799-4de0-ba89-39e72fa3da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:25.879426 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350e169-7be6-4fc4-b6b0-1b776ae16bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.880150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350e169-7be6-4fc4-b6b0-1b776ae16bbd service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.880561 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350e169-7be6-4fc4-b6b0-1b776ae16bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.880886 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350e169-7be6-4fc4-b6b0-1b776ae16bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.908159 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 812/1616] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:25.913164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc97b03-19cd-4b39-a114-fbb5e8c3ca14 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.913490 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc97b03-19cd-4b39-a114-fbb5e8c3ca14 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.913764 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc97b03-19cd-4b39-a114-fbb5e8c3ca14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.940036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-2bc97b03-19cd-4b39-a114-fbb5e8c3ca14 None None] MFA Rules not processed for user `7ef5d27eed58447692e8a9d5ce526319`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:25.941452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-2bc97b03-19cd-4b39-a114-fbb5e8c3ca14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:25.947962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350e169-7be6-4fc4-b6b0-1b776ae16bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.949825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350e169-7be6-4fc4-b6b0-1b776ae16bbd service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.959831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 805/1617] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:25.961270 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf50d0-51a5-4b6d-8221-d8529945a06b None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.961836 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf50d0-51a5-4b6d-8221-d8529945a06b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.962123 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf50d0-51a5-4b6d-8221-d8529945a06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.979884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-49cf50d0-51a5-4b6d-8221-d8529945a06b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:25.981461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-49cf50d0-51a5-4b6d-8221-d8529945a06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:25.989420 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 806/1618] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:25.990682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36392e-fb10-48d2-8033-e04f9796ba05 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.990943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36392e-fb10-48d2-8033-e04f9796ba05 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.991212 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36392e-fb10-48d2-8033-e04f9796ba05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.009011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-1d36392e-fb10-48d2-8033-e04f9796ba05 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:26.010310 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1d36392e-fb10-48d2-8033-e04f9796ba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:26.018181 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 807/1619] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:26.018774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36392e-fb10-48d2-8033-e04f9796ba05 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.028500 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36392e-fb10-48d2-8033-e04f9796ba05 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.033992 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3621d5-cdf1-4fe1-9155-dbdc425ed520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.034688 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3621d5-cdf1-4fe1-9155-dbdc425ed520 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.035022 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3621d5-cdf1-4fe1-9155-dbdc425ed520 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.035291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3621d5-cdf1-4fe1-9155-dbdc425ed520 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.035737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 813/1620] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:26.036302 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3621d5-cdf1-4fe1-9155-dbdc425ed520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.037596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f56233-fad7-4297-98bd-f2ddb4ea3d79 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.037890 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f56233-fad7-4297-98bd-f2ddb4ea3d79 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.038204 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f56233-fad7-4297-98bd-f2ddb4ea3d79 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.038381 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3621d5-cdf1-4fe1-9155-dbdc425ed520 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.040557 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 814/1621] 10.222.0.90 () {54 vars in 912 bytes} [Wed Nov 2 12:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:52:26.047120 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f56233-fad7-4297-98bd-f2ddb4ea3d79 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.062610 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f56233-fad7-4297-98bd-f2ddb4ea3d79 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.064327 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 808/1622] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:26 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:26.065705 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3621d5-cdf1-4fe1-9155-dbdc425ed520 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.067318 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5a3621d5-cdf1-4fe1-9155-dbdc425ed520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:26.071289 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895243cb-013d-4fc3-9831-3bf690e72853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.071964 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895243cb-013d-4fc3-9831-3bf690e72853 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.072419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895243cb-013d-4fc3-9831-3bf690e72853 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.072696 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895243cb-013d-4fc3-9831-3bf690e72853 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.073671 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895243cb-013d-4fc3-9831-3bf690e72853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.075398 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895243cb-013d-4fc3-9831-3bf690e72853 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.080107 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3621d5-cdf1-4fe1-9155-dbdc425ed520 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.083681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377effe9-d05f-4f35-80dd-e8a33148b967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.084515 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377effe9-d05f-4f35-80dd-e8a33148b967 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.084797 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377effe9-d05f-4f35-80dd-e8a33148b967 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.085147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377effe9-d05f-4f35-80dd-e8a33148b967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.096110 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377effe9-d05f-4f35-80dd-e8a33148b967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.097965 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377effe9-d05f-4f35-80dd-e8a33148b967 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.105754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 815/1623] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:26 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:26.106579 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895243cb-013d-4fc3-9831-3bf690e72853 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.111437 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 809/1624] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:26.112828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ac91b-5cd4-44f4-b6c2-f356a05d98b6 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.113117 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ac91b-5cd4-44f4-b6c2-f356a05d98b6 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.113392 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ac91b-5cd4-44f4-b6c2-f356a05d98b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.132456 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-ab8ac91b-5cd4-44f4-b6c2-f356a05d98b6 None None] MFA Rules not processed for user `fbcda58f298444eebf4f08ce01deffc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:26.133668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ab8ac91b-5cd4-44f4-b6c2-f356a05d98b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:26.208093 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895243cb-013d-4fc3-9831-3bf690e72853 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.215062 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3432f41-3df7-407d-8b1b-be68a11e26ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.215722 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3432f41-3df7-407d-8b1b-be68a11e26ab service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.216006 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3432f41-3df7-407d-8b1b-be68a11e26ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.216308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3432f41-3df7-407d-8b1b-be68a11e26ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.229400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 810/1625] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Nov 2 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:26.231854 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabdb3d-895b-42f4-a5f6-d9c641cca4fe None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.232410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabdb3d-895b-42f4-a5f6-d9c641cca4fe None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.232896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabdb3d-895b-42f4-a5f6-d9c641cca4fe None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.235286 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 811/1626] 10.222.0.90 () {54 vars in 959 bytes} [Wed Nov 2 12:52:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:52:26.236472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabdb3d-895b-42f4-a5f6-d9c641cca4fe None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.301458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3432f41-3df7-407d-8b1b-be68a11e26ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.303518 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3432f41-3df7-407d-8b1b-be68a11e26ab service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.317250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 816/1627] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:26.318905 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3432f41-3df7-407d-8b1b-be68a11e26ab service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.326621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabdb3d-895b-42f4-a5f6-d9c641cca4fe None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.330971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3432f41-3df7-407d-8b1b-be68a11e26ab service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.334856 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c75176-773e-4ebb-9d40-99a34e243746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.335773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c75176-773e-4ebb-9d40-99a34e243746 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.336874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524d3f7-c0c2-436c-95ea-a97d5b6d78cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.337228 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c75176-773e-4ebb-9d40-99a34e243746 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.337402 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524d3f7-c0c2-436c-95ea-a97d5b6d78cb admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.337802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524d3f7-c0c2-436c-95ea-a97d5b6d78cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.338029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c75176-773e-4ebb-9d40-99a34e243746 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.338604 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524d3f7-c0c2-436c-95ea-a97d5b6d78cb admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.339261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c75176-773e-4ebb-9d40-99a34e243746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.339378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524d3f7-c0c2-436c-95ea-a97d5b6d78cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.341880 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524d3f7-c0c2-436c-95ea-a97d5b6d78cb admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.343165 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c75176-773e-4ebb-9d40-99a34e243746 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.364710 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 812/1628] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:26.366103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bd4af-dda4-4b5f-be98-8914a1510716 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.366772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bd4af-dda4-4b5f-be98-8914a1510716 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.366772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bd4af-dda4-4b5f-be98-8914a1510716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.377431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 817/1629] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:26 2022] POST /identity/v3/users => generated 288 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:26.379658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524d3f7-c0c2-436c-95ea-a97d5b6d78cb admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.393451 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-001bd4af-dda4-4b5f-be98-8914a1510716 None None] MFA Rules not processed for user `fbcda58f298444eebf4f08ce01deffc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:26.394675 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-001bd4af-dda4-4b5f-be98-8914a1510716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:26.406246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 813/1630] 10.222.0.90 () {58 vars in 1056 bytes} [Wed Nov 2 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:26.407175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bd4af-dda4-4b5f-be98-8914a1510716 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.419268 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bd4af-dda4-4b5f-be98-8914a1510716 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.425954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07e15a-4856-4891-9190-7f727b49534a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.426993 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07e15a-4856-4891-9190-7f727b49534a admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.427455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07e15a-4856-4891-9190-7f727b49534a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.427803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07e15a-4856-4891-9190-7f727b49534a admin admin] PATH_INFO: `/v3/projects/3144b08002f5453d9748cdab86f354fd/users/2d17e4e729a1460ca2c97d48009a378d/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.448120 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07e15a-4856-4891-9190-7f727b49534a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3144b08002f5453d9748cdab86f354fd, user_id=2d17e4e729a1460ca2c97d48009a378d, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.452096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07e15a-4856-4891-9190-7f727b49534a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.463795 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524d3f7-c0c2-436c-95ea-a97d5b6d78cb admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.468185 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50ccb7-e630-40af-9707-bc5da70629ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.469518 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50ccb7-e630-40af-9707-bc5da70629ba service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.469792 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50ccb7-e630-40af-9707-bc5da70629ba service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.470071 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50ccb7-e630-40af-9707-bc5da70629ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.477067 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 814/1631] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:26 2022] PUT /identity/v3/projects/3144b08002f5453d9748cdab86f354fd/users/2d17e4e729a1460ca2c97d48009a378d/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:26.477922 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07e15a-4856-4891-9190-7f727b49534a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.486092 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50ccb7-e630-40af-9707-bc5da70629ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.487813 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50ccb7-e630-40af-9707-bc5da70629ba service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.499941 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 818/1632] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:26.501334 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50ccb7-e630-40af-9707-bc5da70629ba service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.512821 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50ccb7-e630-40af-9707-bc5da70629ba service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.562438 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07e15a-4856-4891-9190-7f727b49534a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.568637 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f42106-4e73-4506-bb11-f4b1f5a86dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.569544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f42106-4e73-4506-bb11-f4b1f5a86dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.569871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f42106-4e73-4506-bb11-f4b1f5a86dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.570152 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f42106-4e73-4506-bb11-f4b1f5a86dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.570885 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f42106-4e73-4506-bb11-f4b1f5a86dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.572832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f42106-4e73-4506-bb11-f4b1f5a86dd2 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.584165 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b034b-1132-4761-bc4f-9084a8755d68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.584394 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 815/1633] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:26.587996 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b034b-1132-4761-bc4f-9084a8755d68 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.587996 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b034b-1132-4761-bc4f-9084a8755d68 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.588297 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f42106-4e73-4506-bb11-f4b1f5a86dd2 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.588403 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b034b-1132-4761-bc4f-9084a8755d68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.596585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f42106-4e73-4506-bb11-f4b1f5a86dd2 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.603812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52559bdf-8ea0-439b-bd76-9ceed67304a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.604734 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52559bdf-8ea0-439b-bd76-9ceed67304a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.605064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52559bdf-8ea0-439b-bd76-9ceed67304a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.605565 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52559bdf-8ea0-439b-bd76-9ceed67304a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.606490 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52559bdf-8ea0-439b-bd76-9ceed67304a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.608689 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52559bdf-8ea0-439b-bd76-9ceed67304a9 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.622410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 816/1634] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:26.623737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52559bdf-8ea0-439b-bd76-9ceed67304a9 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.651099 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52559bdf-8ea0-439b-bd76-9ceed67304a9 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.652584 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b034b-1132-4761-bc4f-9084a8755d68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.654433 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b034b-1132-4761-bc4f-9084a8755d68 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.665383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 819/1635] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:26.666558 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b034b-1132-4761-bc4f-9084a8755d68 service nova] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.672862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12541bcb-ae2d-49a9-b74e-1873acd90080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.675083 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12541bcb-ae2d-49a9-b74e-1873acd90080 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.677096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12541bcb-ae2d-49a9-b74e-1873acd90080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.677851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b034b-1132-4761-bc4f-9084a8755d68 service nova] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.678737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12541bcb-ae2d-49a9-b74e-1873acd90080 admin admin] PATH_INFO: `/v3/projects/48da814f60fa4c86a8f948e01754231a/users/6b4ca30290b240738ade047e3fefdefc/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.684338 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cca9f4-0547-4c08-ba89-610bf8cdfe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.685239 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cca9f4-0547-4c08-ba89-610bf8cdfe78 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.685511 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cca9f4-0547-4c08-ba89-610bf8cdfe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.685780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cca9f4-0547-4c08-ba89-610bf8cdfe78 admin admin] PATH_INFO: `/v3/projects/3144b08002f5453d9748cdab86f354fd/users/2d17e4e729a1460ca2c97d48009a378d/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.688370 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cca9f4-0547-4c08-ba89-610bf8cdfe78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3144b08002f5453d9748cdab86f354fd, user_id=2d17e4e729a1460ca2c97d48009a378d, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.691215 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cca9f4-0547-4c08-ba89-610bf8cdfe78 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.698850 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12541bcb-ae2d-49a9-b74e-1873acd90080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48da814f60fa4c86a8f948e01754231a, user_id=6b4ca30290b240738ade047e3fefdefc, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.702293 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12541bcb-ae2d-49a9-b74e-1873acd90080 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.708447 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 820/1636] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:26 2022] PUT /identity/v3/projects/3144b08002f5453d9748cdab86f354fd/users/2d17e4e729a1460ca2c97d48009a378d/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:26.716493 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6993e2-1a52-48e6-a982-2dc1210f74de None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.716793 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6993e2-1a52-48e6-a982-2dc1210f74de None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.717055 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6993e2-1a52-48e6-a982-2dc1210f74de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.729143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 817/1637] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:26 2022] PUT /identity/v3/projects/48da814f60fa4c86a8f948e01754231a/users/6b4ca30290b240738ade047e3fefdefc/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:26.736119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12541bcb-ae2d-49a9-b74e-1873acd90080 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.756687 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-4f6993e2-1a52-48e6-a982-2dc1210f74de None None] MFA Rules not processed for user `2d17e4e729a1460ca2c97d48009a378d`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:26.757791 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4f6993e2-1a52-48e6-a982-2dc1210f74de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:26.854292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 821/1638] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:26.868258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6993e2-1a52-48e6-a982-2dc1210f74de None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.938435 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12541bcb-ae2d-49a9-b74e-1873acd90080 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.954908 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315552a3-9e7d-4e36-8dbd-eb2a5da287bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.955669 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315552a3-9e7d-4e36-8dbd-eb2a5da287bc admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.956323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315552a3-9e7d-4e36-8dbd-eb2a5da287bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.956323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315552a3-9e7d-4e36-8dbd-eb2a5da287bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.957527 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315552a3-9e7d-4e36-8dbd-eb2a5da287bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.959342 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315552a3-9e7d-4e36-8dbd-eb2a5da287bc admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.984853 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6993e2-1a52-48e6-a982-2dc1210f74de None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.985913 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 818/1639] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:26.990015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315552a3-9e7d-4e36-8dbd-eb2a5da287bc admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.996729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c5796-d59b-4fa8-85b4-1cf97626f22c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.997409 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c5796-d59b-4fa8-85b4-1cf97626f22c service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.997693 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c5796-d59b-4fa8-85b4-1cf97626f22c service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.997955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c5796-d59b-4fa8-85b4-1cf97626f22c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.013787 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315552a3-9e7d-4e36-8dbd-eb2a5da287bc admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:27.018329 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c5796-d59b-4fa8-85b4-1cf97626f22c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:27.023841 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c5796-d59b-4fa8-85b4-1cf97626f22c service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:27.031593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade3fc7-1f63-44c2-953f-670851b70fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:27.034281 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade3fc7-1f63-44c2-953f-670851b70fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:27.034639 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade3fc7-1f63-44c2-953f-670851b70fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:27.034927 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade3fc7-1f63-44c2-953f-670851b70fc4 admin admin] PATH_INFO: `/v3/projects/48da814f60fa4c86a8f948e01754231a/users/6b4ca30290b240738ade047e3fefdefc/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.036773 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 822/1640] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:27.041846 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade3fc7-1f63-44c2-953f-670851b70fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48da814f60fa4c86a8f948e01754231a, user_id=6b4ca30290b240738ade047e3fefdefc, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:27.050983 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade3fc7-1f63-44c2-953f-670851b70fc4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:27.096660 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 819/1641] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:26 2022] PUT /identity/v3/projects/48da814f60fa4c86a8f948e01754231a/users/6b4ca30290b240738ade047e3fefdefc/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:27.098426 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fcd27-d845-4b97-a4f8-72d7b05e4525 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:27.098822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fcd27-d845-4b97-a4f8-72d7b05e4525 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:27.099222 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fcd27-d845-4b97-a4f8-72d7b05e4525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.164254 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-488fcd27-d845-4b97-a4f8-72d7b05e4525 None None] MFA Rules not processed for user `6b4ca30290b240738ade047e3fefdefc`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:27.166105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-488fcd27-d845-4b97-a4f8-72d7b05e4525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:27.199695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a0cf8-f37f-44c2-af56-095f3cf787b7 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:27.200047 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a0cf8-f37f-44c2-af56-095f3cf787b7 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:27.200273 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a0cf8-f37f-44c2-af56-095f3cf787b7 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.202262 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 820/1642] 10.222.0.90 () {54 vars in 912 bytes} [Wed Nov 2 12:52:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:52:27.211001 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b2019-5d24-45c5-a180-a72e39ea3023 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:27.212115 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b2019-5d24-45c5-a180-a72e39ea3023 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:27.212545 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b2019-5d24-45c5-a180-a72e39ea3023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.237865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-8b2b2019-5d24-45c5-a180-a72e39ea3023 None None] MFA Rules not processed for user `fbcda58f298444eebf4f08ce01deffc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:27.239206 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8b2b2019-5d24-45c5-a180-a72e39ea3023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:27.309475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 823/1643] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:27.310723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fcd27-d845-4b97-a4f8-72d7b05e4525 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:27.329678 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 821/1644] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Nov 2 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:27.394105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fcd27-d845-4b97-a4f8-72d7b05e4525 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:27.399070 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f311e5-1f5e-4353-a2ae-a667d3e0f53e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:27.400505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f311e5-1f5e-4353-a2ae-a667d3e0f53e service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:27.400734 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f311e5-1f5e-4353-a2ae-a667d3e0f53e service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:27.400935 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f311e5-1f5e-4353-a2ae-a667d3e0f53e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.477421 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b2019-5d24-45c5-a180-a72e39ea3023 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:27.482834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f311e5-1f5e-4353-a2ae-a667d3e0f53e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:27.484713 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f311e5-1f5e-4353-a2ae-a667d3e0f53e service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:27.488536 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b2019-5d24-45c5-a180-a72e39ea3023 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:27.493085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd26eb0-c174-4e3c-94b5-67c264eb0307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:27.493947 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd26eb0-c174-4e3c-94b5-67c264eb0307 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:27.494234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd26eb0-c174-4e3c-94b5-67c264eb0307 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:27.494546 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd26eb0-c174-4e3c-94b5-67c264eb0307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.496489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 824/1645] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:27.505225 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd26eb0-c174-4e3c-94b5-67c264eb0307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:27.510109 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd26eb0-c174-4e3c-94b5-67c264eb0307 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:27.540313 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 822/1646] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:27 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:52:27.612797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f311e5-1f5e-4353-a2ae-a667d3e0f53e service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:27.623590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f311e5-1f5e-4353-a2ae-a667d3e0f53e service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:27.630093 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909f4d7-4855-4d82-b4d6-635175abd1db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:27.630843 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909f4d7-4855-4d82-b4d6-635175abd1db service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:27.631171 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909f4d7-4855-4d82-b4d6-635175abd1db service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:27.631450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909f4d7-4855-4d82-b4d6-635175abd1db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.652300 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909f4d7-4855-4d82-b4d6-635175abd1db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:27.655431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909f4d7-4855-4d82-b4d6-635175abd1db service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:27.687095 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 825/1647] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:28.038526 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd26eb0-c174-4e3c-94b5-67c264eb0307 service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:28.163120 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd26eb0-c174-4e3c-94b5-67c264eb0307 service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:28.170189 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66980f12-344a-4dd6-baeb-29c25c8b69be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:28.171696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66980f12-344a-4dd6-baeb-29c25c8b69be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:28.172312 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66980f12-344a-4dd6-baeb-29c25c8b69be admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:28.172785 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66980f12-344a-4dd6-baeb-29c25c8b69be admin admin] PATH_INFO: `/v3/users/7ef5d27eed58447692e8a9d5ce526319` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:28.175571 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66980f12-344a-4dd6-baeb-29c25c8b69be admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef5d27eed58447692e8a9d5ce526319)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:28.177893 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66980f12-344a-4dd6-baeb-29c25c8b69be admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:28.284233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-66980f12-344a-4dd6-baeb-29c25c8b69be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef5d27eed58447692e8a9d5ce526319'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:28.285199 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-66980f12-344a-4dd6-baeb-29c25c8b69be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef5d27eed58447692e8a9d5ce526319'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:28.301274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-66980f12-344a-4dd6-baeb-29c25c8b69be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef5d27eed58447692e8a9d5ce526319'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:28.301991 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-66980f12-344a-4dd6-baeb-29c25c8b69be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef5d27eed58447692e8a9d5ce526319'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:28.317793 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-66980f12-344a-4dd6-baeb-29c25c8b69be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef5d27eed58447692e8a9d5ce526319'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:28.345577 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 823/1648] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:28 2022] DELETE /identity/v3/users/7ef5d27eed58447692e8a9d5ce526319 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:28.347978 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86725f23-09ae-4168-9318-c62232ac7e44 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:28.348536 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86725f23-09ae-4168-9318-c62232ac7e44 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:28.349991 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86725f23-09ae-4168-9318-c62232ac7e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:28.381301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-86725f23-09ae-4168-9318-c62232ac7e44 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:28.382752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-86725f23-09ae-4168-9318-c62232ac7e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:28.524829 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 826/1649] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:28.531966 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66980f12-344a-4dd6-baeb-29c25c8b69be admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:28.533576 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-66980f12-344a-4dd6-baeb-29c25c8b69be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:28.552287 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86725f23-09ae-4168-9318-c62232ac7e44 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:28.553722 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-86725f23-09ae-4168-9318-c62232ac7e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:28.571714 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86725f23-09ae-4168-9318-c62232ac7e44 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:28.578311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f73dfe-d79f-4a26-bdae-e8b4786af20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:28.579483 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f73dfe-d79f-4a26-bdae-e8b4786af20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:28.579829 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f73dfe-d79f-4a26-bdae-e8b4786af20e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:28.580175 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f73dfe-d79f-4a26-bdae-e8b4786af20e admin admin] PATH_INFO: `/v3/users/771c42af4a674278b80613409e4d512a` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:28.583114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f73dfe-d79f-4a26-bdae-e8b4786af20e admin admin] RBAC: Authorizing `identity:delete_user(user_id=771c42af4a674278b80613409e4d512a)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:28.584343 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: WARNING py.warnings [None req-c6f73dfe-d79f-4a26-bdae-e8b4786af20e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:52:28.584343 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: warnings.warn(msg) Nov 02 12:52:28.584343 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: Nov 02 12:52:28.585772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f73dfe-d79f-4a26-bdae-e8b4786af20e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:28.630174 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66980f12-344a-4dd6-baeb-29c25c8b69be admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:28.635622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b6bc7-6255-4cde-8059-0486cbe038a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:28.639980 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b6bc7-6255-4cde-8059-0486cbe038a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:28.640391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b6bc7-6255-4cde-8059-0486cbe038a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:28.641462 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b6bc7-6255-4cde-8059-0486cbe038a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:28.656515 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b6bc7-6255-4cde-8059-0486cbe038a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:28.661304 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b6bc7-6255-4cde-8059-0486cbe038a4 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:28.666609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c6f73dfe-d79f-4a26-bdae-e8b4786af20e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771c42af4a674278b80613409e4d512a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:28.667577 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c6f73dfe-d79f-4a26-bdae-e8b4786af20e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771c42af4a674278b80613409e4d512a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:28.681936 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 824/1650] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:28.706198 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c6f73dfe-d79f-4a26-bdae-e8b4786af20e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771c42af4a674278b80613409e4d512a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:28.707059 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c6f73dfe-d79f-4a26-bdae-e8b4786af20e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771c42af4a674278b80613409e4d512a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:28.717658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c6f73dfe-d79f-4a26-bdae-e8b4786af20e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771c42af4a674278b80613409e4d512a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:28.755836 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 827/1651] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:28 2022] DELETE /identity/v3/users/771c42af4a674278b80613409e4d512a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:52:28.762560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f3476-73c0-487c-976a-1b3952e58bab None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:28.763418 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f3476-73c0-487c-976a-1b3952e58bab None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:28.763836 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f3476-73c0-487c-976a-1b3952e58bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:28.802493 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-232f3476-73c0-487c-976a-1b3952e58bab None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:28.804145 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-232f3476-73c0-487c-976a-1b3952e58bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:28.972356 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 825/1652] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:28.994081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f73dfe-d79f-4a26-bdae-e8b4786af20e admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:28.996060 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c6f73dfe-d79f-4a26-bdae-e8b4786af20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:29.151341 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f73dfe-d79f-4a26-bdae-e8b4786af20e admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:29.162091 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961b0a5-2986-46e7-9076-b5d24e17f81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:29.162785 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961b0a5-2986-46e7-9076-b5d24e17f81c service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.163098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961b0a5-2986-46e7-9076-b5d24e17f81c service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.163330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961b0a5-2986-46e7-9076-b5d24e17f81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.184354 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961b0a5-2986-46e7-9076-b5d24e17f81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:29.185869 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961b0a5-2986-46e7-9076-b5d24e17f81c service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:29.220261 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 828/1653] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:52:29.384567 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f3476-73c0-487c-976a-1b3952e58bab None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:29.386308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-232f3476-73c0-487c-976a-1b3952e58bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:29.404855 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f3476-73c0-487c-976a-1b3952e58bab None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:29.417274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c65ca7-087a-48f5-95e0-93ed13f75548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:29.418182 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c65ca7-087a-48f5-95e0-93ed13f75548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.418478 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c65ca7-087a-48f5-95e0-93ed13f75548 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.418722 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c65ca7-087a-48f5-95e0-93ed13f75548 admin admin] PATH_INFO: `/v3/projects/2090a129b9d7453182069e28a631c253` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.421121 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c65ca7-087a-48f5-95e0-93ed13f75548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2090a129b9d7453182069e28a631c253)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:29.422178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: WARNING py.warnings [None req-67c65ca7-087a-48f5-95e0-93ed13f75548 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:52:29.422178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: warnings.warn(msg) Nov 02 12:52:29.422178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: Nov 02 12:52:29.423433 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c65ca7-087a-48f5-95e0-93ed13f75548 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:29.542621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-67c65ca7-087a-48f5-95e0-93ed13f75548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2090a129b9d7453182069e28a631c253', 'request_id': 'req-67c65ca7-087a-48f5-95e0-93ed13f75548'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:29.556306 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-67c65ca7-087a-48f5-95e0-93ed13f75548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2090a129b9d7453182069e28a631c253', 'request_id': 'req-67c65ca7-087a-48f5-95e0-93ed13f75548'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:29.585802 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-67c65ca7-087a-48f5-95e0-93ed13f75548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2090a129b9d7453182069e28a631c253', 'request_id': 'req-67c65ca7-087a-48f5-95e0-93ed13f75548'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:29.611476 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-67c65ca7-087a-48f5-95e0-93ed13f75548 admin admin] The token cache is being invalidate because project 2090a129b9d7453182069e28a631c253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:29.611771 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-67c65ca7-087a-48f5-95e0-93ed13f75548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:29.613175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-67c65ca7-087a-48f5-95e0-93ed13f75548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:29.617212 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 826/1654] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:29 2022] DELETE /identity/v3/projects/2090a129b9d7453182069e28a631c253 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:29.622531 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733fbcc-121a-4295-84cc-adbebcc38d35 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.623124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733fbcc-121a-4295-84cc-adbebcc38d35 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.623124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733fbcc-121a-4295-84cc-adbebcc38d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.656047 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-c733fbcc-121a-4295-84cc-adbebcc38d35 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:29.657415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c733fbcc-121a-4295-84cc-adbebcc38d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:29.842707 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 829/1655] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:29.844841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eefa5b-937e-47d3-8262-9fa8a3048e8d None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.845662 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eefa5b-937e-47d3-8262-9fa8a3048e8d None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.845662 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eefa5b-937e-47d3-8262-9fa8a3048e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.858428 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733fbcc-121a-4295-84cc-adbebcc38d35 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:29.861032 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c733fbcc-121a-4295-84cc-adbebcc38d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:29.906001 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-67eefa5b-937e-47d3-8262-9fa8a3048e8d None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:29.907076 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733fbcc-121a-4295-84cc-adbebcc38d35 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:29.908678 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-67eefa5b-937e-47d3-8262-9fa8a3048e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:29.923811 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c0fdc-e2aa-4616-a674-28076a0c2af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:29.926008 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c0fdc-e2aa-4616-a674-28076a0c2af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.926292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c0fdc-e2aa-4616-a674-28076a0c2af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.926565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c0fdc-e2aa-4616-a674-28076a0c2af8 admin admin] PATH_INFO: `/v3/projects/ef61ab312aa949dcaa9875fb08960e5a` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.929945 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c0fdc-e2aa-4616-a674-28076a0c2af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef61ab312aa949dcaa9875fb08960e5a)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:29.939269 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c0fdc-e2aa-4616-a674-28076a0c2af8 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:29.941018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 827/1656] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:29.941985 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eefa5b-937e-47d3-8262-9fa8a3048e8d None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:29.972481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eefa5b-937e-47d3-8262-9fa8a3048e8d None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:29.986288 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3dae4-b97b-425b-bc2a-5565b40a4ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:29.988897 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3dae4-b97b-425b-bc2a-5565b40a4ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.989184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3dae4-b97b-425b-bc2a-5565b40a4ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.989737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3dae4-b97b-425b-bc2a-5565b40a4ca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.990612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3dae4-b97b-425b-bc2a-5565b40a4ca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:30.008419 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3dae4-b97b-425b-bc2a-5565b40a4ca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:30.012349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3dae4-b97b-425b-bc2a-5565b40a4ca0 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:30.041899 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 828/1657] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:30.045118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3dae4-b97b-425b-bc2a-5565b40a4ca0 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:30.061499 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-777c0fdc-e2aa-4616-a674-28076a0c2af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef61ab312aa949dcaa9875fb08960e5a', 'request_id': 'req-777c0fdc-e2aa-4616-a674-28076a0c2af8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:30.064268 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3dae4-b97b-425b-bc2a-5565b40a4ca0 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:30.073540 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-777c0fdc-e2aa-4616-a674-28076a0c2af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef61ab312aa949dcaa9875fb08960e5a', 'request_id': 'req-777c0fdc-e2aa-4616-a674-28076a0c2af8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:30.113412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-777c0fdc-e2aa-4616-a674-28076a0c2af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef61ab312aa949dcaa9875fb08960e5a', 'request_id': 'req-777c0fdc-e2aa-4616-a674-28076a0c2af8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:30.132519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-777c0fdc-e2aa-4616-a674-28076a0c2af8 admin admin] The token cache is being invalidate because project ef61ab312aa949dcaa9875fb08960e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:30.132809 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-777c0fdc-e2aa-4616-a674-28076a0c2af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:30.133471 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-777c0fdc-e2aa-4616-a674-28076a0c2af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:30.138022 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 830/1658] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:29 2022] DELETE /identity/v3/projects/ef61ab312aa949dcaa9875fb08960e5a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:52:30.142155 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c0fdc-e2aa-4616-a674-28076a0c2af8 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:30.146821 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-777c0fdc-e2aa-4616-a674-28076a0c2af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:30.194078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7133f40-bcd1-4502-9948-358fa84a429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:30.194786 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7133f40-bcd1-4502-9948-358fa84a429a admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:30.195064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7133f40-bcd1-4502-9948-358fa84a429a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:30.195333 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7133f40-bcd1-4502-9948-358fa84a429a admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:30.196945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7133f40-bcd1-4502-9948-358fa84a429a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:30.198198 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7133f40-bcd1-4502-9948-358fa84a429a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:30.264914 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 829/1659] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:30 2022] POST /identity/v3/projects => generated 373 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:30.266704 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7133f40-bcd1-4502-9948-358fa84a429a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:30.270430 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-a7133f40-bcd1-4502-9948-358fa84a429a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:30.310727 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c0fdc-e2aa-4616-a674-28076a0c2af8 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:30.356278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7133f40-bcd1-4502-9948-358fa84a429a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:30.382424 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0431e-4b45-4708-93ea-7cfc71d15300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:30.383392 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0431e-4b45-4708-93ea-7cfc71d15300 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:30.383789 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0431e-4b45-4708-93ea-7cfc71d15300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:30.384168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0431e-4b45-4708-93ea-7cfc71d15300 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:30.385028 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0431e-4b45-4708-93ea-7cfc71d15300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:30.388604 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0431e-4b45-4708-93ea-7cfc71d15300 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:30.430217 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 830/1660] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:30 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:30.431365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0431e-4b45-4708-93ea-7cfc71d15300 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:30.437461 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c64a54-ca36-4db2-8642-6c22803108a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:30.438668 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c64a54-ca36-4db2-8642-6c22803108a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:30.439113 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c64a54-ca36-4db2-8642-6c22803108a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:30.439559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c64a54-ca36-4db2-8642-6c22803108a9 admin admin] PATH_INFO: `/v3/users/6b4ca30290b240738ade047e3fefdefc` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:30.441025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c64a54-ca36-4db2-8642-6c22803108a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b4ca30290b240738ade047e3fefdefc)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:30.443133 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c64a54-ca36-4db2-8642-6c22803108a9 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:30.475621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0431e-4b45-4708-93ea-7cfc71d15300 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:30.492990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55702f4f-79fd-44c2-bd5b-93d1b3a4b0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:30.493960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55702f4f-79fd-44c2-bd5b-93d1b3a4b0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:30.494493 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55702f4f-79fd-44c2-bd5b-93d1b3a4b0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:30.495224 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55702f4f-79fd-44c2-bd5b-93d1b3a4b0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:30.497118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55702f4f-79fd-44c2-bd5b-93d1b3a4b0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:30.500563 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55702f4f-79fd-44c2-bd5b-93d1b3a4b0b4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:30.519903 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 831/1661] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:30.525021 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55702f4f-79fd-44c2-bd5b-93d1b3a4b0b4 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:30.548536 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55702f4f-79fd-44c2-bd5b-93d1b3a4b0b4 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:30.553485 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-59c64a54-ca36-4db2-8642-6c22803108a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4ca30290b240738ade047e3fefdefc'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:30.556639 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5a213-f1f6-43be-8c8f-8c7e7e75ac64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:30.557404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a213-f1f6-43be-8c8f-8c7e7e75ac64 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:30.557690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a213-f1f6-43be-8c8f-8c7e7e75ac64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:30.557964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a213-f1f6-43be-8c8f-8c7e7e75ac64 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:30.559018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5a213-f1f6-43be-8c8f-8c7e7e75ac64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:30.560361 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-59c64a54-ca36-4db2-8642-6c22803108a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4ca30290b240738ade047e3fefdefc'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:30.561954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5a213-f1f6-43be-8c8f-8c7e7e75ac64 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:30.589585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 832/1662] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:30.592101 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5a213-f1f6-43be-8c8f-8c7e7e75ac64 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:30.594219 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-59c64a54-ca36-4db2-8642-6c22803108a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4ca30290b240738ade047e3fefdefc'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:30.597401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-59c64a54-ca36-4db2-8642-6c22803108a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4ca30290b240738ade047e3fefdefc'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:30.611901 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-59c64a54-ca36-4db2-8642-6c22803108a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4ca30290b240738ade047e3fefdefc'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:30.614918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5a213-f1f6-43be-8c8f-8c7e7e75ac64 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:30.635320 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27858b1e-4469-4fe6-81e5-8d8dd5394734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:30.637739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858b1e-4469-4fe6-81e5-8d8dd5394734 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:30.639233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858b1e-4469-4fe6-81e5-8d8dd5394734 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:30.640742 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858b1e-4469-4fe6-81e5-8d8dd5394734 admin admin] PATH_INFO: `/v3/projects/d7beff57800b4322a820a692551e3e12/users/fb864812313644eea9dd2cc21c420988/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:30.642899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 831/1663] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:30 2022] DELETE /identity/v3/users/6b4ca30290b240738ade047e3fefdefc => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:52:30.661342 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27858b1e-4469-4fe6-81e5-8d8dd5394734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7beff57800b4322a820a692551e3e12, user_id=fb864812313644eea9dd2cc21c420988, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:30.672977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27858b1e-4469-4fe6-81e5-8d8dd5394734 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:30.722358 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71773d-7f8f-46a1-9987-984cc33e7fb3 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:30.722796 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71773d-7f8f-46a1-9987-984cc33e7fb3 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:30.723218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71773d-7f8f-46a1-9987-984cc33e7fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:30.727873 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 833/1664] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:30 2022] PUT /identity/v3/projects/d7beff57800b4322a820a692551e3e12/users/fb864812313644eea9dd2cc21c420988/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:30.796863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-3e71773d-7f8f-46a1-9987-984cc33e7fb3 None None] MFA Rules not processed for user `fb864812313644eea9dd2cc21c420988`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:30.801933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-3e71773d-7f8f-46a1-9987-984cc33e7fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:30.995282 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 832/1665] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:31.001855 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27858b1e-4469-4fe6-81e5-8d8dd5394734 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:31.007880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-27858b1e-4469-4fe6-81e5-8d8dd5394734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:31.177641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27858b1e-4469-4fe6-81e5-8d8dd5394734 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:31.186100 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6baf6-ad79-4d11-b677-269725c5ee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:31.187063 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6baf6-ad79-4d11-b677-269725c5ee2d admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:31.187452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6baf6-ad79-4d11-b677-269725c5ee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:31.187998 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6baf6-ad79-4d11-b677-269725c5ee2d admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:31.188886 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6baf6-ad79-4d11-b677-269725c5ee2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:31.191417 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6baf6-ad79-4d11-b677-269725c5ee2d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:31.247601 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 834/1666] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:31 2022] POST /identity/v3/projects => generated 373 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:31.250274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71773d-7f8f-46a1-9987-984cc33e7fb3 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:31.266462 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71773d-7f8f-46a1-9987-984cc33e7fb3 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:31.443982 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9fb75-4a05-4979-86a3-ee887937d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:31.446033 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9fb75-4a05-4979-86a3-ee887937d6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:31.446321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9fb75-4a05-4979-86a3-ee887937d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:31.446595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9fb75-4a05-4979-86a3-ee887937d6a2 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:31.450006 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9fb75-4a05-4979-86a3-ee887937d6a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:31.464559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9fb75-4a05-4979-86a3-ee887937d6a2 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:31.516266 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 833/1667] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:31 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:31.517461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6baf6-ad79-4d11-b677-269725c5ee2d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:31.539186 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6baf6-ad79-4d11-b677-269725c5ee2d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:31.559313 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709c535-963e-4984-be34-221c26571849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:31.561801 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709c535-963e-4984-be34-221c26571849 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:31.562108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709c535-963e-4984-be34-221c26571849 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:31.562428 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709c535-963e-4984-be34-221c26571849 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:31.569753 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709c535-963e-4984-be34-221c26571849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:31.574313 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709c535-963e-4984-be34-221c26571849 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:31.623012 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 835/1668] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:31.627136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9fb75-4a05-4979-86a3-ee887937d6a2 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:31.647431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9fb75-4a05-4979-86a3-ee887937d6a2 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:31.667938 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261c25a-33e8-459a-8b83-173604d44f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:31.669137 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261c25a-33e8-459a-8b83-173604d44f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:31.669424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261c25a-33e8-459a-8b83-173604d44f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:31.669696 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261c25a-33e8-459a-8b83-173604d44f04 admin admin] PATH_INFO: `/v3/projects/7850f4e57258461d975baa9766b4cb6e/users/9c1107647e5f4280895711c414e6672e/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:31.712034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261c25a-33e8-459a-8b83-173604d44f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7850f4e57258461d975baa9766b4cb6e, user_id=9c1107647e5f4280895711c414e6672e, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:31.716422 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261c25a-33e8-459a-8b83-173604d44f04 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:31.749794 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 834/1669] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:31 2022] PUT /identity/v3/projects/7850f4e57258461d975baa9766b4cb6e/users/9c1107647e5f4280895711c414e6672e/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:31.753695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709c535-963e-4984-be34-221c26571849 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:31.774722 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709c535-963e-4984-be34-221c26571849 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:32.036534 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81fec7-870a-40c3-8448-31bc6314740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:32.037384 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81fec7-870a-40c3-8448-31bc6314740d admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:32.037672 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81fec7-870a-40c3-8448-31bc6314740d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:32.037949 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81fec7-870a-40c3-8448-31bc6314740d admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:32.038707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81fec7-870a-40c3-8448-31bc6314740d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:32.046477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261c25a-33e8-459a-8b83-173604d44f04 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:32.048768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0261c25a-33e8-459a-8b83-173604d44f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:32.062200 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81fec7-870a-40c3-8448-31bc6314740d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:32.073343 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261c25a-33e8-459a-8b83-173604d44f04 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:32.085727 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e2619-395a-4805-9fab-90aa29d47bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:32.089386 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e2619-395a-4805-9fab-90aa29d47bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:32.089714 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e2619-395a-4805-9fab-90aa29d47bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:32.089993 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e2619-395a-4805-9fab-90aa29d47bf6 admin admin] PATH_INFO: `/v3/projects/48da814f60fa4c86a8f948e01754231a` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:32.093634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e2619-395a-4805-9fab-90aa29d47bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48da814f60fa4c86a8f948e01754231a)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:32.095601 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e2619-395a-4805-9fab-90aa29d47bf6 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:32.108131 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 836/1670] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:32.117001 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81fec7-870a-40c3-8448-31bc6314740d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:32.149741 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81fec7-870a-40c3-8448-31bc6314740d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:32.157570 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a31184-29e9-4efb-9915-e2497182a15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:32.158563 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a31184-29e9-4efb-9915-e2497182a15a admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:32.158880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a31184-29e9-4efb-9915-e2497182a15a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:32.159170 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a31184-29e9-4efb-9915-e2497182a15a admin admin] PATH_INFO: `/v3/projects/7850f4e57258461d975baa9766b4cb6e/users/9c1107647e5f4280895711c414e6672e/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:32.168113 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a31184-29e9-4efb-9915-e2497182a15a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7850f4e57258461d975baa9766b4cb6e, user_id=9c1107647e5f4280895711c414e6672e, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:32.178008 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a31184-29e9-4efb-9915-e2497182a15a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:32.217780 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 837/1671] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:32 2022] PUT /identity/v3/projects/7850f4e57258461d975baa9766b4cb6e/users/9c1107647e5f4280895711c414e6672e/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:32.220091 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3d4e4-5898-4cbe-9145-cd2e8df3476e None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:32.220413 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3d4e4-5898-4cbe-9145-cd2e8df3476e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:32.220699 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3d4e4-5898-4cbe-9145-cd2e8df3476e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:32.232645 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0b7e2619-395a-4805-9fab-90aa29d47bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48da814f60fa4c86a8f948e01754231a', 'request_id': 'req-0b7e2619-395a-4805-9fab-90aa29d47bf6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:32.256378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0b7e2619-395a-4805-9fab-90aa29d47bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48da814f60fa4c86a8f948e01754231a', 'request_id': 'req-0b7e2619-395a-4805-9fab-90aa29d47bf6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:32.281150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0b7e2619-395a-4805-9fab-90aa29d47bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48da814f60fa4c86a8f948e01754231a', 'request_id': 'req-0b7e2619-395a-4805-9fab-90aa29d47bf6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:32.305990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-e0e3d4e4-5898-4cbe-9145-cd2e8df3476e None None] MFA Rules not processed for user `9c1107647e5f4280895711c414e6672e`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:32.308743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e0e3d4e4-5898-4cbe-9145-cd2e8df3476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:32.313677 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0b7e2619-395a-4805-9fab-90aa29d47bf6 admin admin] The token cache is being invalidate because project 48da814f60fa4c86a8f948e01754231a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:32.313982 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0b7e2619-395a-4805-9fab-90aa29d47bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:32.316525 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0b7e2619-395a-4805-9fab-90aa29d47bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:32.318704 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 835/1672] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:32 2022] DELETE /identity/v3/projects/48da814f60fa4c86a8f948e01754231a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:32.323520 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcdb3a-f595-4c2d-b22a-54a419947a5b None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:32.323813 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcdb3a-f595-4c2d-b22a-54a419947a5b None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:32.324132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcdb3a-f595-4c2d-b22a-54a419947a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:32.423826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-c8bcdb3a-f595-4c2d-b22a-54a419947a5b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:32.425796 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c8bcdb3a-f595-4c2d-b22a-54a419947a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:32.477756 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 838/1673] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:32.491445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3d4e4-5898-4cbe-9145-cd2e8df3476e None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:32.495374 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e0e3d4e4-5898-4cbe-9145-cd2e8df3476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:32.569216 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 836/1674] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:32.577868 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e2e3d-6372-4554-9db0-64f0e90ed204 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:32.580231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e2e3d-6372-4554-9db0-64f0e90ed204 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:32.581762 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e2e3d-6372-4554-9db0-64f0e90ed204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:32.595751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3d4e4-5898-4cbe-9145-cd2e8df3476e None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:32.600093 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c97ce7-6e48-4668-abbe-6ca1f845d6c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:32.600973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c97ce7-6e48-4668-abbe-6ca1f845d6c2 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:32.601303 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c97ce7-6e48-4668-abbe-6ca1f845d6c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:32.601580 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c97ce7-6e48-4668-abbe-6ca1f845d6c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:32.620222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c97ce7-6e48-4668-abbe-6ca1f845d6c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:32.629399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c97ce7-6e48-4668-abbe-6ca1f845d6c2 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:32.637334 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-851e2e3d-6372-4554-9db0-64f0e90ed204 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:32.640065 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-851e2e3d-6372-4554-9db0-64f0e90ed204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:32.652038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 839/1675] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:32.655151 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 837/1676] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:32.658640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c97ce7-6e48-4668-abbe-6ca1f845d6c2 service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:32.676916 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c97ce7-6e48-4668-abbe-6ca1f845d6c2 service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:32.688558 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c8f82-b2f6-4c8b-b406-68f768111467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:32.689398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c8f82-b2f6-4c8b-b406-68f768111467 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:32.689784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c8f82-b2f6-4c8b-b406-68f768111467 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:32.690141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c8f82-b2f6-4c8b-b406-68f768111467 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:32.690938 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c8f82-b2f6-4c8b-b406-68f768111467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:32.696267 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c8f82-b2f6-4c8b-b406-68f768111467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:32.704397 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c8f82-b2f6-4c8b-b406-68f768111467 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:32.723629 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 840/1677] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:32.724936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e2e3d-6372-4554-9db0-64f0e90ed204 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:32.736689 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e2e3d-6372-4554-9db0-64f0e90ed204 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:32.749787 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c335fa-c52b-4374-9dfe-7fe9de8f53a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:32.750391 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c335fa-c52b-4374-9dfe-7fe9de8f53a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:32.750669 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c335fa-c52b-4374-9dfe-7fe9de8f53a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:32.750939 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c335fa-c52b-4374-9dfe-7fe9de8f53a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:32.751648 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c335fa-c52b-4374-9dfe-7fe9de8f53a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:32.753630 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c335fa-c52b-4374-9dfe-7fe9de8f53a5 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:32.817963 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 838/1678] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:32 2022] POST /identity/v3/projects => generated 357 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:32.819267 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c8f82-b2f6-4c8b-b406-68f768111467 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:32.838425 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c8f82-b2f6-4c8b-b406-68f768111467 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:32.969133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b80467-a358-4900-908f-944353973f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:32.970171 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b80467-a358-4900-908f-944353973f25 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:32.972677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b80467-a358-4900-908f-944353973f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:32.973258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b80467-a358-4900-908f-944353973f25 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:32.973679 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b80467-a358-4900-908f-944353973f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:32.978862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b80467-a358-4900-908f-944353973f25 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:33.017214 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 841/1679] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:32 2022] POST /identity/v3/users => generated 279 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:52:33.021553 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c335fa-c52b-4374-9dfe-7fe9de8f53a5 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:33.035962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c335fa-c52b-4374-9dfe-7fe9de8f53a5 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:33.044294 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82534056-ce77-4ca9-8c45-a05d4c20a2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:33.067702 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82534056-ce77-4ca9-8c45-a05d4c20a2fd admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:33.071170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82534056-ce77-4ca9-8c45-a05d4c20a2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:33.071870 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82534056-ce77-4ca9-8c45-a05d4c20a2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:33.072320 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82534056-ce77-4ca9-8c45-a05d4c20a2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:33.082575 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82534056-ce77-4ca9-8c45-a05d4c20a2fd admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:33.119130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 839/1680] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:33.123651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b80467-a358-4900-908f-944353973f25 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:33.138051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b80467-a358-4900-908f-944353973f25 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:33.153361 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc2639-7174-4c71-8722-118a169d959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:33.154993 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc2639-7174-4c71-8722-118a169d959c admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:33.160825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc2639-7174-4c71-8722-118a169d959c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:33.161130 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc2639-7174-4c71-8722-118a169d959c admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:33.164003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc2639-7174-4c71-8722-118a169d959c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:33.167130 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc2639-7174-4c71-8722-118a169d959c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:33.196346 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 842/1681] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:33.197955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82534056-ce77-4ca9-8c45-a05d4c20a2fd admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:33.211147 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82534056-ce77-4ca9-8c45-a05d4c20a2fd admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:33.228256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8f490-3cf0-4ab3-b7bb-3527cfecf9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:33.229448 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8f490-3cf0-4ab3-b7bb-3527cfecf9f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:33.229788 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8f490-3cf0-4ab3-b7bb-3527cfecf9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:33.230107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8f490-3cf0-4ab3-b7bb-3527cfecf9f4 admin admin] PATH_INFO: `/v3/projects/1647093592124a1db08fb07a31be065f/users/fea9ab0ee2e94297ae7634e83beee25b/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:33.268085 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8f490-3cf0-4ab3-b7bb-3527cfecf9f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1647093592124a1db08fb07a31be065f, user_id=fea9ab0ee2e94297ae7634e83beee25b, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:33.273508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8f490-3cf0-4ab3-b7bb-3527cfecf9f4 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:33.315624 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 840/1682] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:33 2022] PUT /identity/v3/projects/1647093592124a1db08fb07a31be065f/users/fea9ab0ee2e94297ae7634e83beee25b/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:33.328106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ad09e-5473-45d6-b5bd-4b37bffe5cf9 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:33.328464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ad09e-5473-45d6-b5bd-4b37bffe5cf9 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:33.328742 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ad09e-5473-45d6-b5bd-4b37bffe5cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:33.334714 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8f490-3cf0-4ab3-b7bb-3527cfecf9f4 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:33.338186 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-eab8f490-3cf0-4ab3-b7bb-3527cfecf9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:33.444151 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-209ad09e-5473-45d6-b5bd-4b37bffe5cf9 None None] MFA Rules not processed for user `fea9ab0ee2e94297ae7634e83beee25b`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:33.452031 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-209ad09e-5473-45d6-b5bd-4b37bffe5cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:33.565678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8f490-3cf0-4ab3-b7bb-3527cfecf9f4 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:33.579552 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60029eff-07a6-44de-a7b2-2de3e7d5b72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:33.580497 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60029eff-07a6-44de-a7b2-2de3e7d5b72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:33.580772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60029eff-07a6-44de-a7b2-2de3e7d5b72a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:33.581041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60029eff-07a6-44de-a7b2-2de3e7d5b72a admin admin] PATH_INFO: `/v3/users/fb864812313644eea9dd2cc21c420988` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:33.583599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60029eff-07a6-44de-a7b2-2de3e7d5b72a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb864812313644eea9dd2cc21c420988)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:33.587876 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60029eff-07a6-44de-a7b2-2de3e7d5b72a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:33.630121 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 843/1683] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:33.645223 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ad09e-5473-45d6-b5bd-4b37bffe5cf9 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:33.686999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ad09e-5473-45d6-b5bd-4b37bffe5cf9 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:33.702155 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499b22f-4a6b-43df-bd05-8efae9227571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:33.702911 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499b22f-4a6b-43df-bd05-8efae9227571 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:33.703188 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499b22f-4a6b-43df-bd05-8efae9227571 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:33.703465 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499b22f-4a6b-43df-bd05-8efae9227571 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:33.707031 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499b22f-4a6b-43df-bd05-8efae9227571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:33.708851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-60029eff-07a6-44de-a7b2-2de3e7d5b72a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb864812313644eea9dd2cc21c420988'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:33.709347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499b22f-4a6b-43df-bd05-8efae9227571 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:33.710683 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-60029eff-07a6-44de-a7b2-2de3e7d5b72a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb864812313644eea9dd2cc21c420988'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:33.744303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-60029eff-07a6-44de-a7b2-2de3e7d5b72a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb864812313644eea9dd2cc21c420988'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:33.747545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-60029eff-07a6-44de-a7b2-2de3e7d5b72a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb864812313644eea9dd2cc21c420988'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:33.762110 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-60029eff-07a6-44de-a7b2-2de3e7d5b72a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb864812313644eea9dd2cc21c420988'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:33.766187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 844/1684] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:33 2022] POST /identity/v3/projects => generated 355 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:33.770425 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499b22f-4a6b-43df-bd05-8efae9227571 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:33.774344 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4499b22f-4a6b-43df-bd05-8efae9227571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:33.797570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 841/1685] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:33 2022] DELETE /identity/v3/users/fb864812313644eea9dd2cc21c420988 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:33.802953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e348cd-6482-44f3-9b43-dc7302e330c3 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:33.803229 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e348cd-6482-44f3-9b43-dc7302e330c3 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:33.803506 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e348cd-6482-44f3-9b43-dc7302e330c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:33.859863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-24e348cd-6482-44f3-9b43-dc7302e330c3 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:33.861985 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-24e348cd-6482-44f3-9b43-dc7302e330c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:33.917481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499b22f-4a6b-43df-bd05-8efae9227571 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:34.037500 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba7d50-e52a-4e8b-97b8-3d12bad9a401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:34.038441 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba7d50-e52a-4e8b-97b8-3d12bad9a401 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.038864 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba7d50-e52a-4e8b-97b8-3d12bad9a401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.039406 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba7d50-e52a-4e8b-97b8-3d12bad9a401 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.040390 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba7d50-e52a-4e8b-97b8-3d12bad9a401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:34.042807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba7d50-e52a-4e8b-97b8-3d12bad9a401 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:34.065333 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 842/1686] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:34.091232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e348cd-6482-44f3-9b43-dc7302e330c3 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:34.092697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-24e348cd-6482-44f3-9b43-dc7302e330c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:34.097160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 845/1687] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:33 2022] POST /identity/v3/users => generated 284 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:34.103312 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba7d50-e52a-4e8b-97b8-3d12bad9a401 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:34.123882 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba7d50-e52a-4e8b-97b8-3d12bad9a401 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:34.135780 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06222a58-f9b1-4429-a86d-b26fc1f2736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:34.136787 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06222a58-f9b1-4429-a86d-b26fc1f2736f admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.141157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06222a58-f9b1-4429-a86d-b26fc1f2736f admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.141618 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06222a58-f9b1-4429-a86d-b26fc1f2736f admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.142627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06222a58-f9b1-4429-a86d-b26fc1f2736f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:34.144983 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06222a58-f9b1-4429-a86d-b26fc1f2736f admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:34.162477 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 846/1688] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:34.168600 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06222a58-f9b1-4429-a86d-b26fc1f2736f admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:34.189674 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06222a58-f9b1-4429-a86d-b26fc1f2736f admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:34.195853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd70e8-46c7-4642-906e-038bee00b162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:34.196944 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd70e8-46c7-4642-906e-038bee00b162 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.197242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd70e8-46c7-4642-906e-038bee00b162 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.197513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd70e8-46c7-4642-906e-038bee00b162 admin admin] PATH_INFO: `/v3/projects/f551ebd538484329b744fb96626c1ad3/users/f9888b783f3849a0beffa7d9c8944942/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.212701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e348cd-6482-44f3-9b43-dc7302e330c3 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:34.222135 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd70e8-46c7-4642-906e-038bee00b162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f551ebd538484329b744fb96626c1ad3, user_id=f9888b783f3849a0beffa7d9c8944942, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:34.225233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd70e8-46c7-4642-906e-038bee00b162 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:34.226739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ac9f5-a87f-4ec4-a49d-f066a68a8d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:34.227899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac9f5-a87f-4ec4-a49d-f066a68a8d65 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.228357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac9f5-a87f-4ec4-a49d-f066a68a8d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.228766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac9f5-a87f-4ec4-a49d-f066a68a8d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.252630 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 847/1689] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:34 2022] PUT /identity/v3/projects/f551ebd538484329b744fb96626c1ad3/users/f9888b783f3849a0beffa7d9c8944942/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:34.254008 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ac9f5-a87f-4ec4-a49d-f066a68a8d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:34.255803 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ac9f5-a87f-4ec4-a49d-f066a68a8d65 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:34.258203 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd70e8-46c7-4642-906e-038bee00b162 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:34.293077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 843/1690] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:34.395565 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd70e8-46c7-4642-906e-038bee00b162 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:34.415818 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b699452-b66b-4a9a-9e51-1ed57dce2657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:34.419561 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b699452-b66b-4a9a-9e51-1ed57dce2657 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.420038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b699452-b66b-4a9a-9e51-1ed57dce2657 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.421909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b699452-b66b-4a9a-9e51-1ed57dce2657 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.422868 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b699452-b66b-4a9a-9e51-1ed57dce2657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:34.425520 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b699452-b66b-4a9a-9e51-1ed57dce2657 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:34.440910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 848/1691] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:34.445757 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ac9f5-a87f-4ec4-a49d-f066a68a8d65 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:34.461408 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ac9f5-a87f-4ec4-a49d-f066a68a8d65 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:34.472805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15386ca-25d1-47bd-8ef5-2afbeeff0c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:34.473949 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15386ca-25d1-47bd-8ef5-2afbeeff0c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.474228 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15386ca-25d1-47bd-8ef5-2afbeeff0c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.474500 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15386ca-25d1-47bd-8ef5-2afbeeff0c17 admin admin] PATH_INFO: `/v3/projects/f551ebd538484329b744fb96626c1ad3/users/f9888b783f3849a0beffa7d9c8944942/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.478183 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15386ca-25d1-47bd-8ef5-2afbeeff0c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f551ebd538484329b744fb96626c1ad3, user_id=f9888b783f3849a0beffa7d9c8944942, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:34.482498 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15386ca-25d1-47bd-8ef5-2afbeeff0c17 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:34.533943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 844/1692] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:34 2022] PUT /identity/v3/projects/f551ebd538484329b744fb96626c1ad3/users/f9888b783f3849a0beffa7d9c8944942/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:34.544807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfec3e-c91d-410d-87dc-ada8fe5e01bb None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.545225 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfec3e-c91d-410d-87dc-ada8fe5e01bb None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.545769 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfec3e-c91d-410d-87dc-ada8fe5e01bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.593446 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-22cfec3e-c91d-410d-87dc-ada8fe5e01bb None None] MFA Rules not processed for user `f9888b783f3849a0beffa7d9c8944942`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:34.594863 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-22cfec3e-c91d-410d-87dc-ada8fe5e01bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:34.767159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 849/1693] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:34.780786 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15386ca-25d1-47bd-8ef5-2afbeeff0c17 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:34.783981 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c15386ca-25d1-47bd-8ef5-2afbeeff0c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:34.904503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15386ca-25d1-47bd-8ef5-2afbeeff0c17 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:34.910367 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43465d-9fad-4883-99e9-f36a4c477cd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:34.911107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43465d-9fad-4883-99e9-f36a4c477cd0 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.911427 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43465d-9fad-4883-99e9-f36a4c477cd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.911734 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43465d-9fad-4883-99e9-f36a4c477cd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.934039 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43465d-9fad-4883-99e9-f36a4c477cd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:34.935908 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43465d-9fad-4883-99e9-f36a4c477cd0 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:34.955075 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 845/1694] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:35.131552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfec3e-c91d-410d-87dc-ada8fe5e01bb None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:35.133234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-22cfec3e-c91d-410d-87dc-ada8fe5e01bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:35.159090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfec3e-c91d-410d-87dc-ada8fe5e01bb None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:35.178405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40ae44-9d77-443a-8a6f-511d2fc8e0ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:35.181163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40ae44-9d77-443a-8a6f-511d2fc8e0ba service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:35.181603 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40ae44-9d77-443a-8a6f-511d2fc8e0ba service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:35.184737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40ae44-9d77-443a-8a6f-511d2fc8e0ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:35.188829 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2a40ae44-9d77-443a-8a6f-511d2fc8e0ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:35.307834 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40ae44-9d77-443a-8a6f-511d2fc8e0ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:35.311630 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40ae44-9d77-443a-8a6f-511d2fc8e0ba service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:35.337217 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 850/1695] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:35 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:35.750663 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43465d-9fad-4883-99e9-f36a4c477cd0 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:35.752280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-8b43465d-9fad-4883-99e9-f36a4c477cd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:35.884104 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43465d-9fad-4883-99e9-f36a4c477cd0 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:35.888882 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3a8eb-8380-4208-922d-77f48ceeb149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:35.889763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3a8eb-8380-4208-922d-77f48ceeb149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:35.890043 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3a8eb-8380-4208-922d-77f48ceeb149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:35.890759 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3a8eb-8380-4208-922d-77f48ceeb149 admin admin] PATH_INFO: `/v3/projects/d7beff57800b4322a820a692551e3e12` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:35.892026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3a8eb-8380-4208-922d-77f48ceeb149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7beff57800b4322a820a692551e3e12)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:35.894188 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3a8eb-8380-4208-922d-77f48ceeb149 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:35.949926 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-bec3a8eb-8380-4208-922d-77f48ceeb149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7beff57800b4322a820a692551e3e12', 'request_id': 'req-bec3a8eb-8380-4208-922d-77f48ceeb149'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:35.959208 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-bec3a8eb-8380-4208-922d-77f48ceeb149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7beff57800b4322a820a692551e3e12', 'request_id': 'req-bec3a8eb-8380-4208-922d-77f48ceeb149'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:35.966113 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-bec3a8eb-8380-4208-922d-77f48ceeb149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7beff57800b4322a820a692551e3e12', 'request_id': 'req-bec3a8eb-8380-4208-922d-77f48ceeb149'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:35.979572 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-bec3a8eb-8380-4208-922d-77f48ceeb149 admin admin] The token cache is being invalidate because project d7beff57800b4322a820a692551e3e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:35.979898 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-bec3a8eb-8380-4208-922d-77f48ceeb149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:35.980810 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-bec3a8eb-8380-4208-922d-77f48ceeb149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:35.982994 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 846/1696] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:35 2022] DELETE /identity/v3/projects/d7beff57800b4322a820a692551e3e12 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:35.989836 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40ae44-9d77-443a-8a6f-511d2fc8e0ba service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:36.003166 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40ae44-9d77-443a-8a6f-511d2fc8e0ba service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:36.086126 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabcbed-c69e-4b5e-ba04-f351a12c8c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:36.089132 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabcbed-c69e-4b5e-ba04-f351a12c8c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:36.089573 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabcbed-c69e-4b5e-ba04-f351a12c8c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:36.090152 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabcbed-c69e-4b5e-ba04-f351a12c8c54 admin admin] PATH_INFO: `/v3/users/9c1107647e5f4280895711c414e6672e` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:36.091688 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabcbed-c69e-4b5e-ba04-f351a12c8c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1107647e5f4280895711c414e6672e)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:36.094347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabcbed-c69e-4b5e-ba04-f351a12c8c54 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:36.198506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1dabcbed-c69e-4b5e-ba04-f351a12c8c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1107647e5f4280895711c414e6672e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:36.200385 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1dabcbed-c69e-4b5e-ba04-f351a12c8c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1107647e5f4280895711c414e6672e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:36.233693 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1dabcbed-c69e-4b5e-ba04-f351a12c8c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1107647e5f4280895711c414e6672e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:36.238007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1dabcbed-c69e-4b5e-ba04-f351a12c8c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1107647e5f4280895711c414e6672e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:36.263834 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1dabcbed-c69e-4b5e-ba04-f351a12c8c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1107647e5f4280895711c414e6672e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:36.295253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 851/1697] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:35 2022] DELETE /identity/v3/users/9c1107647e5f4280895711c414e6672e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:38.134014 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb3f2c-0811-47c3-9e09-14fff356f0c1 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:38.135935 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb3f2c-0811-47c3-9e09-14fff356f0c1 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:38.136449 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb3f2c-0811-47c3-9e09-14fff356f0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:38.200330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-4dbb3f2c-0811-47c3-9e09-14fff356f0c1 None None] MFA Rules not processed for user `a2c786462bac45848eeff3a966e71149`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:38.203442 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4dbb3f2c-0811-47c3-9e09-14fff356f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:38.291498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabcbed-c69e-4b5e-ba04-f351a12c8c54 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:38.293962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1dabcbed-c69e-4b5e-ba04-f351a12c8c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:38.449107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 847/1698] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:38.472062 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb3f2c-0811-47c3-9e09-14fff356f0c1 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:38.474697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4dbb3f2c-0811-47c3-9e09-14fff356f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:38.580441 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabcbed-c69e-4b5e-ba04-f351a12c8c54 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:38.599246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfb371-953f-4483-9946-c64f7aafda76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:38.600361 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfb371-953f-4483-9946-c64f7aafda76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:38.600485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfb371-953f-4483-9946-c64f7aafda76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:38.600714 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfb371-953f-4483-9946-c64f7aafda76 admin admin] PATH_INFO: `/v3/projects/7850f4e57258461d975baa9766b4cb6e` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:38.602239 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfb371-953f-4483-9946-c64f7aafda76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7850f4e57258461d975baa9766b4cb6e)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:38.607398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfb371-953f-4483-9946-c64f7aafda76 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:38.745035 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb3f2c-0811-47c3-9e09-14fff356f0c1 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:38.753112 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5bcfb371-953f-4483-9946-c64f7aafda76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7850f4e57258461d975baa9766b4cb6e', 'request_id': 'req-5bcfb371-953f-4483-9946-c64f7aafda76'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:38.771414 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5bcfb371-953f-4483-9946-c64f7aafda76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7850f4e57258461d975baa9766b4cb6e', 'request_id': 'req-5bcfb371-953f-4483-9946-c64f7aafda76'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:38.782245 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5bcfb371-953f-4483-9946-c64f7aafda76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7850f4e57258461d975baa9766b4cb6e', 'request_id': 'req-5bcfb371-953f-4483-9946-c64f7aafda76'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:38.810962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5bcfb371-953f-4483-9946-c64f7aafda76 admin admin] The token cache is being invalidate because project 7850f4e57258461d975baa9766b4cb6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:38.811796 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5bcfb371-953f-4483-9946-c64f7aafda76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:38.813709 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5bcfb371-953f-4483-9946-c64f7aafda76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:38.822278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 852/1699] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:38 2022] DELETE /identity/v3/projects/7850f4e57258461d975baa9766b4cb6e => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:52:38.825482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dd8b9-af80-451d-8330-c1c7c54a0e74 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:38.825966 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dd8b9-af80-451d-8330-c1c7c54a0e74 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:38.826482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dd8b9-af80-451d-8330-c1c7c54a0e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:38.876076 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-1c6dd8b9-af80-451d-8330-c1c7c54a0e74 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:38.877756 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1c6dd8b9-af80-451d-8330-c1c7c54a0e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:38.916224 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcf0ec-e552-4d97-a2b4-daf2f3d31451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:38.916922 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcf0ec-e552-4d97-a2b4-daf2f3d31451 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:38.917206 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcf0ec-e552-4d97-a2b4-daf2f3d31451 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:38.917831 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcf0ec-e552-4d97-a2b4-daf2f3d31451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:38.934180 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-cdfcf0ec-e552-4d97-a2b4-daf2f3d31451 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:39.070250 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 853/1700] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:39.085783 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a542068-d634-47bb-b09d-1ff3513a5809 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.086099 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a542068-d634-47bb-b09d-1ff3513a5809 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.086377 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a542068-d634-47bb-b09d-1ff3513a5809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.097625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcf0ec-e552-4d97-a2b4-daf2f3d31451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:39.099628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcf0ec-e552-4d97-a2b4-daf2f3d31451 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:39.114869 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 848/1701] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:39.163158 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-7a542068-d634-47bb-b09d-1ff3513a5809 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:39.172067 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-7a542068-d634-47bb-b09d-1ff3513a5809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:39.205633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 854/1702] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:39.209715 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcf0ec-e552-4d97-a2b4-daf2f3d31451 service nova] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:39.228491 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcf0ec-e552-4d97-a2b4-daf2f3d31451 service nova] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:39.243929 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48adabf-70f2-4d52-9fd2-046f6867eefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:39.244590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48adabf-70f2-4d52-9fd2-046f6867eefc admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.244872 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48adabf-70f2-4d52-9fd2-046f6867eefc admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.248776 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48adabf-70f2-4d52-9fd2-046f6867eefc admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.249646 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48adabf-70f2-4d52-9fd2-046f6867eefc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:39.249967 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48adabf-70f2-4d52-9fd2-046f6867eefc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:39.260992 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48adabf-70f2-4d52-9fd2-046f6867eefc admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:39.288436 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a542068-d634-47bb-b09d-1ff3513a5809 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:39.289513 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 849/1703] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:39.303327 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a542068-d634-47bb-b09d-1ff3513a5809 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:39.324506 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ddb80-0530-4de3-bfa7-336a9f77810e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.325056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ddb80-0530-4de3-bfa7-336a9f77810e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.325523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ddb80-0530-4de3-bfa7-336a9f77810e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.333899 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8547f81-bdc0-48f8-b90a-99e57855e21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:39.337559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8547f81-bdc0-48f8-b90a-99e57855e21d admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.338060 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8547f81-bdc0-48f8-b90a-99e57855e21d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.344287 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8547f81-bdc0-48f8-b90a-99e57855e21d admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.347711 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8547f81-bdc0-48f8-b90a-99e57855e21d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:39.349711 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8547f81-bdc0-48f8-b90a-99e57855e21d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:39.405782 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-a51ddb80-0530-4de3-bfa7-336a9f77810e None None] MFA Rules not processed for user `fd0b35be3944451d961e68ed1e39afc2`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:39.407290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a51ddb80-0530-4de3-bfa7-336a9f77810e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:39.413827 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 855/1704] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:39 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:52:39.437277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8547f81-bdc0-48f8-b90a-99e57855e21d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:39.576612 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 850/1705] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:39.578995 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943da46-6aac-425b-924c-0deb7953063f None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.580057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8547f81-bdc0-48f8-b90a-99e57855e21d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:39.580978 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943da46-6aac-425b-924c-0deb7953063f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.581422 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943da46-6aac-425b-924c-0deb7953063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.592330 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c3295-e3ed-4bce-a8f1-a4b50fcbf299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:39.593507 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c3295-e3ed-4bce-a8f1-a4b50fcbf299 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.595215 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c3295-e3ed-4bce-a8f1-a4b50fcbf299 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.595780 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c3295-e3ed-4bce-a8f1-a4b50fcbf299 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.597603 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c3295-e3ed-4bce-a8f1-a4b50fcbf299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:39.603957 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c3295-e3ed-4bce-a8f1-a4b50fcbf299 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:39.621704 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-0943da46-6aac-425b-924c-0deb7953063f None None] MFA Rules not processed for user `fd0b35be3944451d961e68ed1e39afc2`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:39.625632 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0943da46-6aac-425b-924c-0deb7953063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:39.647731 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 856/1706] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:39 2022] POST /identity/v3/users => generated 284 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:52:39.652169 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c3295-e3ed-4bce-a8f1-a4b50fcbf299 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:39.681117 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c3295-e3ed-4bce-a8f1-a4b50fcbf299 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:39.699065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caf7b1-c64e-45f2-a919-e5774befe2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:39.700167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caf7b1-c64e-45f2-a919-e5774befe2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.700562 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caf7b1-c64e-45f2-a919-e5774befe2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.700858 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caf7b1-c64e-45f2-a919-e5774befe2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.701779 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caf7b1-c64e-45f2-a919-e5774befe2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:39.704788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caf7b1-c64e-45f2-a919-e5774befe2d2 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:39.728672 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 857/1707] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:39.731434 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caf7b1-c64e-45f2-a919-e5774befe2d2 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:39.741105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 851/1708] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:39.750598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943da46-6aac-425b-924c-0deb7953063f None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:39.752853 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0943da46-6aac-425b-924c-0deb7953063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:39.772560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caf7b1-c64e-45f2-a919-e5774befe2d2 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:39.786445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758869f-3698-4c78-a7d4-8b803ac5f85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:39.787326 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758869f-3698-4c78-a7d4-8b803ac5f85b admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.787799 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758869f-3698-4c78-a7d4-8b803ac5f85b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.788090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758869f-3698-4c78-a7d4-8b803ac5f85b admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.788900 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758869f-3698-4c78-a7d4-8b803ac5f85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:39.791068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758869f-3698-4c78-a7d4-8b803ac5f85b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:39.817942 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 858/1709] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:39.822143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758869f-3698-4c78-a7d4-8b803ac5f85b admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:39.842593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758869f-3698-4c78-a7d4-8b803ac5f85b admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:39.854760 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7e9fb-3425-48b0-a72e-e545f8e044e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:39.856026 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7e9fb-3425-48b0-a72e-e545f8e044e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.856480 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7e9fb-3425-48b0-a72e-e545f8e044e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.859130 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7e9fb-3425-48b0-a72e-e545f8e044e8 admin admin] PATH_INFO: `/v3/projects/59358f47de754a4f8fb01367ae1da680/users/81aee3dc68094447822e48f7ad64a6bd/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.880839 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943da46-6aac-425b-924c-0deb7953063f None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:39.884446 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7e9fb-3425-48b0-a72e-e545f8e044e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59358f47de754a4f8fb01367ae1da680, user_id=81aee3dc68094447822e48f7ad64a6bd, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:39.888341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7e9fb-3425-48b0-a72e-e545f8e044e8 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:39.890745 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091b542-d652-4705-9a56-19f0fdd3c5b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:39.891660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091b542-d652-4705-9a56-19f0fdd3c5b4 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.891951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091b542-d652-4705-9a56-19f0fdd3c5b4 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.892424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091b542-d652-4705-9a56-19f0fdd3c5b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.907599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091b542-d652-4705-9a56-19f0fdd3c5b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:39.909408 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091b542-d652-4705-9a56-19f0fdd3c5b4 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:39.920463 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 859/1710] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:39 2022] PUT /identity/v3/projects/59358f47de754a4f8fb01367ae1da680/users/81aee3dc68094447822e48f7ad64a6bd/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:39.933537 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed9c02-94eb-4dd8-8a26-d7b8f46c040b None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.933844 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed9c02-94eb-4dd8-8a26-d7b8f46c040b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.934118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed9c02-94eb-4dd8-8a26-d7b8f46c040b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.936874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 852/1711] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:39.987095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-e4ed9c02-94eb-4dd8-8a26-d7b8f46c040b None None] MFA Rules not processed for user `81aee3dc68094447822e48f7ad64a6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:39.989073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e4ed9c02-94eb-4dd8-8a26-d7b8f46c040b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:40.155548 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 860/1712] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:40.162023 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091b542-d652-4705-9a56-19f0fdd3c5b4 service nova] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:40.176774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091b542-d652-4705-9a56-19f0fdd3c5b4 service nova] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:40.258045 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25a15d-8b70-4f11-9023-e6dfeac88650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:40.261189 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25a15d-8b70-4f11-9023-e6dfeac88650 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:40.261783 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25a15d-8b70-4f11-9023-e6dfeac88650 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:40.262207 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25a15d-8b70-4f11-9023-e6dfeac88650 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:40.263202 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25a15d-8b70-4f11-9023-e6dfeac88650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:40.265321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25a15d-8b70-4f11-9023-e6dfeac88650 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:40.318336 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed9c02-94eb-4dd8-8a26-d7b8f46c040b None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:40.333113 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 853/1713] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:40 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:40.340696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed9c02-94eb-4dd8-8a26-d7b8f46c040b None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:40.420308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85271f11-c4e2-4dd3-9a13-c59108e3983c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:40.421029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85271f11-c4e2-4dd3-9a13-c59108e3983c admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:40.421311 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85271f11-c4e2-4dd3-9a13-c59108e3983c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:40.421808 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85271f11-c4e2-4dd3-9a13-c59108e3983c admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:40.422475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85271f11-c4e2-4dd3-9a13-c59108e3983c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:40.427230 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85271f11-c4e2-4dd3-9a13-c59108e3983c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:40.480047 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 861/1714] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:40 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:40.485124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25a15d-8b70-4f11-9023-e6dfeac88650 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:40.512859 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25a15d-8b70-4f11-9023-e6dfeac88650 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:40.537042 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8ba18-6454-4161-928a-ef4dba8f70b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:40.537736 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8ba18-6454-4161-928a-ef4dba8f70b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:40.538016 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8ba18-6454-4161-928a-ef4dba8f70b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:40.538288 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8ba18-6454-4161-928a-ef4dba8f70b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:40.539044 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8ba18-6454-4161-928a-ef4dba8f70b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:40.540985 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8ba18-6454-4161-928a-ef4dba8f70b7 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:40.566738 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 854/1715] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:40.567923 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85271f11-c4e2-4dd3-9a13-c59108e3983c admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:40.587533 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85271f11-c4e2-4dd3-9a13-c59108e3983c admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:40.598925 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed43a0-be6c-4c9f-a123-858ce0723d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:40.599906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed43a0-be6c-4c9f-a123-858ce0723d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:40.607100 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed43a0-be6c-4c9f-a123-858ce0723d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:40.607483 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed43a0-be6c-4c9f-a123-858ce0723d71 admin admin] PATH_INFO: `/v3/projects/d8ea99b78692498295cb741dcf6a2178/users/c0c8e3762d6e4b6b80568b6a6c85614c/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:40.658436 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed43a0-be6c-4c9f-a123-858ce0723d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ea99b78692498295cb741dcf6a2178, user_id=c0c8e3762d6e4b6b80568b6a6c85614c, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:40.667391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed43a0-be6c-4c9f-a123-858ce0723d71 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:40.735372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 862/1716] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:40 2022] PUT /identity/v3/projects/d8ea99b78692498295cb741dcf6a2178/users/c0c8e3762d6e4b6b80568b6a6c85614c/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:40.739387 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8ba18-6454-4161-928a-ef4dba8f70b7 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:40.753757 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8ba18-6454-4161-928a-ef4dba8f70b7 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:40.904839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa9ac2-ed4e-4b48-af44-b106372ba7d7 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:40.904839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa9ac2-ed4e-4b48-af44-b106372ba7d7 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:40.904839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa9ac2-ed4e-4b48-af44-b106372ba7d7 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:40.904839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 863/1717] 10.222.0.90 () {54 vars in 912 bytes} [Wed Nov 2 12:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:52:40.909862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838bec7-3752-4b34-882b-10cf809b97ad None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:40.910137 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838bec7-3752-4b34-882b-10cf809b97ad None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:40.910431 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838bec7-3752-4b34-882b-10cf809b97ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:40.987635 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86ec5a-ce3e-4490-90bf-0d7de699618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:40.988563 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86ec5a-ce3e-4490-90bf-0d7de699618e admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:40.989487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86ec5a-ce3e-4490-90bf-0d7de699618e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:40.989768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86ec5a-ce3e-4490-90bf-0d7de699618e admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:40.990525 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86ec5a-ce3e-4490-90bf-0d7de699618e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:40.995350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86ec5a-ce3e-4490-90bf-0d7de699618e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:41.019598 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-f838bec7-3752-4b34-882b-10cf809b97ad None None] MFA Rules not processed for user `89a11da83d84467ca9ae04b9693beede`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:41.020883 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f838bec7-3752-4b34-882b-10cf809b97ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:41.028108 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 855/1718] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:41.044032 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86ec5a-ce3e-4490-90bf-0d7de699618e admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:41.067730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86ec5a-ce3e-4490-90bf-0d7de699618e admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:41.077561 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9a1e1-08ea-43e0-bee5-25c322ab0b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:41.078728 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9a1e1-08ea-43e0-bee5-25c322ab0b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:41.079154 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9a1e1-08ea-43e0-bee5-25c322ab0b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:41.079763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9a1e1-08ea-43e0-bee5-25c322ab0b9f admin admin] PATH_INFO: `/v3/projects/d8ea99b78692498295cb741dcf6a2178/users/c0c8e3762d6e4b6b80568b6a6c85614c/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:41.082811 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9a1e1-08ea-43e0-bee5-25c322ab0b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ea99b78692498295cb741dcf6a2178, user_id=c0c8e3762d6e4b6b80568b6a6c85614c, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:41.089911 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9a1e1-08ea-43e0-bee5-25c322ab0b9f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:41.138713 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 856/1719] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:41 2022] PUT /identity/v3/projects/d8ea99b78692498295cb741dcf6a2178/users/c0c8e3762d6e4b6b80568b6a6c85614c/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:41.148891 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 864/1720] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Nov 2 12:52:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:41.149165 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813eb3a-edc8-4010-984b-698b5dfd43b5 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:41.149545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813eb3a-edc8-4010-984b-698b5dfd43b5 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:41.149837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813eb3a-edc8-4010-984b-698b5dfd43b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:41.160809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838bec7-3752-4b34-882b-10cf809b97ad None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:41.162475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f838bec7-3752-4b34-882b-10cf809b97ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:41.174535 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838bec7-3752-4b34-882b-10cf809b97ad None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:41.195205 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-6813eb3a-edc8-4010-984b-698b5dfd43b5 None None] MFA Rules not processed for user `c0c8e3762d6e4b6b80568b6a6c85614c`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:41.196807 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-6813eb3a-edc8-4010-984b-698b5dfd43b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:41.316797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 857/1721] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:41.328429 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813eb3a-edc8-4010-984b-698b5dfd43b5 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:41.330094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-6813eb3a-edc8-4010-984b-698b5dfd43b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:41.333627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc7b84-cf5b-46d5-85b2-289fa747cd10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:41.334890 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc7b84-cf5b-46d5-85b2-289fa747cd10 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:41.335323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc7b84-cf5b-46d5-85b2-289fa747cd10 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:41.335879 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc7b84-cf5b-46d5-85b2-289fa747cd10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:41.352680 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc7b84-cf5b-46d5-85b2-289fa747cd10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:41.354402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc7b84-cf5b-46d5-85b2-289fa747cd10 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:41.384403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 865/1722] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:41.485431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813eb3a-edc8-4010-984b-698b5dfd43b5 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:41.496005 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d79a-7af9-4631-9829-ba24f1b9c463 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:41.496902 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d79a-7af9-4631-9829-ba24f1b9c463 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:41.497213 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d79a-7af9-4631-9829-ba24f1b9c463 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:41.497484 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d79a-7af9-4631-9829-ba24f1b9c463 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:41.517835 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0d79a-7af9-4631-9829-ba24f1b9c463 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:41.519662 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0d79a-7af9-4631-9829-ba24f1b9c463 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:41.553219 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 858/1723] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:41 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:42.021633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a59a8-2691-4f7a-9aed-82ee0e3d2fa1 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:42.022472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a59a8-2691-4f7a-9aed-82ee0e3d2fa1 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:42.022895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a59a8-2691-4f7a-9aed-82ee0e3d2fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:42.117317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-118a59a8-2691-4f7a-9aed-82ee0e3d2fa1 None None] MFA Rules not processed for user `3a45298a10af4fc3991887cb4da55e86`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:42.118838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-118a59a8-2691-4f7a-9aed-82ee0e3d2fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:42.230541 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ea117-47db-4068-84db-3fbd030e6c31 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:42.230795 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ea117-47db-4068-84db-3fbd030e6c31 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:42.231074 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ea117-47db-4068-84db-3fbd030e6c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:42.335692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-dc4ea117-47db-4068-84db-3fbd030e6c31 None None] MFA Rules not processed for user `12d35ac129c24e118df9ebee0c8c9f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:42.337169 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-dc4ea117-47db-4068-84db-3fbd030e6c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:42.350402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 866/1724] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:42.369533 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a59a8-2691-4f7a-9aed-82ee0e3d2fa1 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:42.371440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-118a59a8-2691-4f7a-9aed-82ee0e3d2fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:42.610316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a59a8-2691-4f7a-9aed-82ee0e3d2fa1 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:42.611660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 859/1725] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:42.626780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462668a9-901d-4164-9e25-9414d5d43061 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:42.626955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462668a9-901d-4164-9e25-9414d5d43061 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:42.627228 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462668a9-901d-4164-9e25-9414d5d43061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:42.641902 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad96e4-0ffd-4bf3-a66d-e8c666403e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:42.642889 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad96e4-0ffd-4bf3-a66d-e8c666403e82 service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:42.643318 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad96e4-0ffd-4bf3-a66d-e8c666403e82 service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:42.643865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad96e4-0ffd-4bf3-a66d-e8c666403e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:42.668831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad96e4-0ffd-4bf3-a66d-e8c666403e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:42.675514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad96e4-0ffd-4bf3-a66d-e8c666403e82 service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:42.696979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-462668a9-901d-4164-9e25-9414d5d43061 None None] MFA Rules not processed for user `12d35ac129c24e118df9ebee0c8c9f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:42.701188 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-462668a9-901d-4164-9e25-9414d5d43061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:42.719744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 860/1726] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:42.721442 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 867/1727] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:42.744777 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eaa58-13e3-408f-9754-7db5b7fb4b57 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:42.745345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eaa58-13e3-408f-9754-7db5b7fb4b57 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:42.745667 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eaa58-13e3-408f-9754-7db5b7fb4b57 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:42.748492 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 861/1728] 10.222.0.90 () {54 vars in 960 bytes} [Wed Nov 2 12:52:42 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:52:42.756043 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d480-bd88-49a3-a9c6-b42ffbdc8632 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:42.760697 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d480-bd88-49a3-a9c6-b42ffbdc8632 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:42.761414 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d480-bd88-49a3-a9c6-b42ffbdc8632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:42.809793 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-54c0d480-bd88-49a3-a9c6-b42ffbdc8632 None None] MFA Rules not processed for user `65e89359a42b4b0592db48f5a5a6e465`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:42.816514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-54c0d480-bd88-49a3-a9c6-b42ffbdc8632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:42.936074 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eaa58-13e3-408f-9754-7db5b7fb4b57 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:42.974605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eaa58-13e3-408f-9754-7db5b7fb4b57 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:43.020089 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3b268-0002-4149-9ec8-3825fb653ecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:43.020822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3b268-0002-4149-9ec8-3825fb653ecf service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:43.021103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3b268-0002-4149-9ec8-3825fb653ecf service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:43.021375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3b268-0002-4149-9ec8-3825fb653ecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:43.059146 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3b268-0002-4149-9ec8-3825fb653ecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:43.063448 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3b268-0002-4149-9ec8-3825fb653ecf service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:43.088608 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 862/1729] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:43.102458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 868/1730] 10.222.0.90 () {58 vars in 1057 bytes} [Wed Nov 2 12:52:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:43.121598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3b268-0002-4149-9ec8-3825fb653ecf service nova] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:43.145434 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3b268-0002-4149-9ec8-3825fb653ecf service nova] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:43.173070 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ceecd-b5c7-4570-80bf-0906b01d08e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:43.174153 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ceecd-b5c7-4570-80bf-0906b01d08e0 service placement] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:43.175152 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ceecd-b5c7-4570-80bf-0906b01d08e0 service placement] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:43.175648 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ceecd-b5c7-4570-80bf-0906b01d08e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:43.178652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-6e4ceecd-b5c7-4570-80bf-0906b01d08e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:43.236036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ceecd-b5c7-4570-80bf-0906b01d08e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:43.238502 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ceecd-b5c7-4570-80bf-0906b01d08e0 service placement] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:43.274211 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 863/1731] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:44.549981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60605599-b915-4797-b13c-860c824c72a6 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:44.550464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60605599-b915-4797-b13c-860c824c72a6 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:44.550464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60605599-b915-4797-b13c-860c824c72a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:44.615924 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-60605599-b915-4797-b13c-860c824c72a6 None None] MFA Rules not processed for user `a2c786462bac45848eeff3a966e71149`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:44.617180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-60605599-b915-4797-b13c-860c824c72a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:44.859215 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 869/1732] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:46.211569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ceecd-b5c7-4570-80bf-0906b01d08e0 service placement] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:46.399799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ceecd-b5c7-4570-80bf-0906b01d08e0 service placement] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:46.416894 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de997696-a012-40be-815c-a8a91ce8f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:46.418739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de997696-a012-40be-815c-a8a91ce8f026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:46.419184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de997696-a012-40be-815c-a8a91ce8f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:46.419604 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de997696-a012-40be-815c-a8a91ce8f026 admin admin] PATH_INFO: `/v3/users/81aee3dc68094447822e48f7ad64a6bd` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:46.422625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de997696-a012-40be-815c-a8a91ce8f026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81aee3dc68094447822e48f7ad64a6bd)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:46.428267 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de997696-a012-40be-815c-a8a91ce8f026 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:46.531764 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-de997696-a012-40be-815c-a8a91ce8f026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81aee3dc68094447822e48f7ad64a6bd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:46.532998 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-de997696-a012-40be-815c-a8a91ce8f026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81aee3dc68094447822e48f7ad64a6bd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:46.628167 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-de997696-a012-40be-815c-a8a91ce8f026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81aee3dc68094447822e48f7ad64a6bd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:46.629549 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-de997696-a012-40be-815c-a8a91ce8f026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81aee3dc68094447822e48f7ad64a6bd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:46.645953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-de997696-a012-40be-815c-a8a91ce8f026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81aee3dc68094447822e48f7ad64a6bd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:46.689317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 864/1733] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:46 2022] DELETE /identity/v3/users/81aee3dc68094447822e48f7ad64a6bd => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:46.693647 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eff8ec-3ceb-44ec-87f4-c2fce6ad9343 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:46.695677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eff8ec-3ceb-44ec-87f4-c2fce6ad9343 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:46.696153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eff8ec-3ceb-44ec-87f4-c2fce6ad9343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:46.754110 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-91eff8ec-3ceb-44ec-87f4-c2fce6ad9343 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:46.759053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-91eff8ec-3ceb-44ec-87f4-c2fce6ad9343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:46.870906 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbec542-e96a-463c-962c-3c94e679fbce None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:46.877165 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbec542-e96a-463c-962c-3c94e679fbce None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:46.877640 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbec542-e96a-463c-962c-3c94e679fbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:46.904503 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 870/1734] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:46.906722 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a794d71-101c-4720-9fc6-118e072ad03e None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:46.907251 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a794d71-101c-4720-9fc6-118e072ad03e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:46.908048 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a794d71-101c-4720-9fc6-118e072ad03e None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:46.911237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 871/1735] 10.222.0.90 () {54 vars in 912 bytes} [Wed Nov 2 12:52:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:52:46.919398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4c36f-b2da-4b3b-ad01-ecf350d75b69 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:46.923007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4c36f-b2da-4b3b-ad01-ecf350d75b69 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:46.923739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4c36f-b2da-4b3b-ad01-ecf350d75b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:46.940056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-7dbec542-e96a-463c-962c-3c94e679fbce None None] MFA Rules not processed for user `12d35ac129c24e118df9ebee0c8c9f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:46.942641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7dbec542-e96a-463c-962c-3c94e679fbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:46.971580 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-e2f4c36f-b2da-4b3b-ad01-ecf350d75b69 None None] MFA Rules not processed for user `89a11da83d84467ca9ae04b9693beede`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:46.975120 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e2f4c36f-b2da-4b3b-ad01-ecf350d75b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:47.123900 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 865/1736] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:47.125264 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbec542-e96a-463c-962c-3c94e679fbce None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:47.130329 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7dbec542-e96a-463c-962c-3c94e679fbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:47.149739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 872/1737] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Nov 2 12:52:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:47.150878 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4c36f-b2da-4b3b-ad01-ecf350d75b69 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:47.154686 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e2f4c36f-b2da-4b3b-ad01-ecf350d75b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:47.168920 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbec542-e96a-463c-962c-3c94e679fbce None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:47.192894 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdaddd5-ab11-4432-978a-98b6f87370d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:47.193786 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdaddd5-ab11-4432-978a-98b6f87370d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:47.194258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdaddd5-ab11-4432-978a-98b6f87370d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:47.194768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdaddd5-ab11-4432-978a-98b6f87370d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:47.207743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4c36f-b2da-4b3b-ad01-ecf350d75b69 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:47.219946 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdaddd5-ab11-4432-978a-98b6f87370d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:47.225775 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdaddd5-ab11-4432-978a-98b6f87370d0 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:47.227975 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508fa15-64da-4dc6-aa97-79dfd62ace0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:47.229067 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508fa15-64da-4dc6-aa97-79dfd62ace0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:47.233700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508fa15-64da-4dc6-aa97-79dfd62ace0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:47.234740 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508fa15-64da-4dc6-aa97-79dfd62ace0a admin admin] PATH_INFO: `/v3/users/9e3276c1f93f4effbdc418cf43d4f0a4` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:47.241552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508fa15-64da-4dc6-aa97-79dfd62ace0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e3276c1f93f4effbdc418cf43d4f0a4)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:47.243034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 866/1738] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:47.245248 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdaddd5-ab11-4432-978a-98b6f87370d0 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:47.249093 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508fa15-64da-4dc6-aa97-79dfd62ace0a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:47.256357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdaddd5-ab11-4432-978a-98b6f87370d0 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:47.270194 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab233c-52d8-4576-83d1-30bd826d10f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:47.271124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab233c-52d8-4576-83d1-30bd826d10f5 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:47.271497 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab233c-52d8-4576-83d1-30bd826d10f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:47.272233 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab233c-52d8-4576-83d1-30bd826d10f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:47.293921 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab233c-52d8-4576-83d1-30bd826d10f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:47.298402 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab233c-52d8-4576-83d1-30bd826d10f5 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:47.311075 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 867/1739] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:47.312617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba6073-4e86-433c-a7f0-51f2fbb42247 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:47.318684 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba6073-4e86-433c-a7f0-51f2fbb42247 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:47.320054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba6073-4e86-433c-a7f0-51f2fbb42247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:47.348733 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-c3ba6073-4e86-433c-a7f0-51f2fbb42247 None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:47.350847 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c3ba6073-4e86-433c-a7f0-51f2fbb42247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:47.404435 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3508fa15-64da-4dc6-aa97-79dfd62ace0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3276c1f93f4effbdc418cf43d4f0a4'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:47.405603 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3508fa15-64da-4dc6-aa97-79dfd62ace0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3276c1f93f4effbdc418cf43d4f0a4'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:47.428352 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3508fa15-64da-4dc6-aa97-79dfd62ace0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3276c1f93f4effbdc418cf43d4f0a4'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:47.429118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3508fa15-64da-4dc6-aa97-79dfd62ace0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3276c1f93f4effbdc418cf43d4f0a4'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:47.450308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3508fa15-64da-4dc6-aa97-79dfd62ace0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3276c1f93f4effbdc418cf43d4f0a4'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:47.477638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 873/1740] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:47 2022] DELETE /identity/v3/users/9e3276c1f93f4effbdc418cf43d4f0a4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:47.482180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c65d37-1467-4f06-a895-fb84dd927e9e None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:47.482475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c65d37-1467-4f06-a895-fb84dd927e9e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:47.482804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c65d37-1467-4f06-a895-fb84dd927e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:47.546122 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-53c65d37-1467-4f06-a895-fb84dd927e9e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:47.547631 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-53c65d37-1467-4f06-a895-fb84dd927e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:47.556170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 868/1741] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Nov 2 12:52:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:47.683456 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 874/1742] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:47.713288 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba6073-4e86-433c-a7f0-51f2fbb42247 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:47.715452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c3ba6073-4e86-433c-a7f0-51f2fbb42247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:47.741677 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba6073-4e86-433c-a7f0-51f2fbb42247 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:47.858086 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900e7b4-1d87-42dc-93a8-ef68e0f8c290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:47.859038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900e7b4-1d87-42dc-93a8-ef68e0f8c290 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:47.859776 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900e7b4-1d87-42dc-93a8-ef68e0f8c290 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:47.861051 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900e7b4-1d87-42dc-93a8-ef68e0f8c290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:47.865232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c65d37-1467-4f06-a895-fb84dd927e9e None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:47.866621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-53c65d37-1467-4f06-a895-fb84dd927e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:47.880593 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900e7b4-1d87-42dc-93a8-ef68e0f8c290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:47.882406 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900e7b4-1d87-42dc-93a8-ef68e0f8c290 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:47.896528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 869/1743] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:47.977625 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c65d37-1467-4f06-a895-fb84dd927e9e None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:47.983846 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d46740-9c97-4b4f-89cc-80ec17534463 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:47.984843 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d46740-9c97-4b4f-89cc-80ec17534463 service swift] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:47.985281 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d46740-9c97-4b4f-89cc-80ec17534463 service swift] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:47.985689 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d46740-9c97-4b4f-89cc-80ec17534463 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:48.086099 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d46740-9c97-4b4f-89cc-80ec17534463 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:48.089374 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d46740-9c97-4b4f-89cc-80ec17534463 service swift] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:48.110618 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 875/1744] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 12:52:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 12:52:48.953707 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a857b-cf63-4f2b-900f-db2e5fce05bb None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:48.954840 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a857b-cf63-4f2b-900f-db2e5fce05bb None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:48.955293 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a857b-cf63-4f2b-900f-db2e5fce05bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:49.016723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-1d7a857b-cf63-4f2b-900f-db2e5fce05bb None None] MFA Rules not processed for user `3a45298a10af4fc3991887cb4da55e86`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:49.021628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1d7a857b-cf63-4f2b-900f-db2e5fce05bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:49.255095 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 870/1745] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:49.405541 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d46740-9c97-4b4f-89cc-80ec17534463 service swift] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:49.407542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-96d46740-9c97-4b4f-89cc-80ec17534463 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:49.436681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d46740-9c97-4b4f-89cc-80ec17534463 service swift] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:49.469073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feabed5-38b2-4412-8fc8-c8fbfddbf291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:49.471679 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feabed5-38b2-4412-8fc8-c8fbfddbf291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:49.472870 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feabed5-38b2-4412-8fc8-c8fbfddbf291 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:49.473293 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feabed5-38b2-4412-8fc8-c8fbfddbf291 admin admin] PATH_INFO: `/v3/projects/5d515d4c1420428984835605607e2699` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:49.476993 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feabed5-38b2-4412-8fc8-c8fbfddbf291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d515d4c1420428984835605607e2699)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:49.484012 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feabed5-38b2-4412-8fc8-c8fbfddbf291 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:49.707482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-9feabed5-38b2-4412-8fc8-c8fbfddbf291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d515d4c1420428984835605607e2699', 'request_id': 'req-9feabed5-38b2-4412-8fc8-c8fbfddbf291'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:49.732757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-9feabed5-38b2-4412-8fc8-c8fbfddbf291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d515d4c1420428984835605607e2699', 'request_id': 'req-9feabed5-38b2-4412-8fc8-c8fbfddbf291'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:49.754184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-9feabed5-38b2-4412-8fc8-c8fbfddbf291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d515d4c1420428984835605607e2699', 'request_id': 'req-9feabed5-38b2-4412-8fc8-c8fbfddbf291'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:49.807712 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-9feabed5-38b2-4412-8fc8-c8fbfddbf291 admin admin] The token cache is being invalidate because project 5d515d4c1420428984835605607e2699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:49.808019 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-9feabed5-38b2-4412-8fc8-c8fbfddbf291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:49.815803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-9feabed5-38b2-4412-8fc8-c8fbfddbf291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:49.825095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 876/1746] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:49 2022] DELETE /identity/v3/projects/5d515d4c1420428984835605607e2699 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:49.830017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69491237-39ed-4a33-8de3-1819b367039e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:49.830638 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69491237-39ed-4a33-8de3-1819b367039e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:49.831042 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69491237-39ed-4a33-8de3-1819b367039e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:49.927102 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-69491237-39ed-4a33-8de3-1819b367039e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:49.936301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-69491237-39ed-4a33-8de3-1819b367039e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:50.174057 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 871/1747] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:50.203007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df53fb-156f-4d34-b30c-5f8822f89fde None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:50.203397 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df53fb-156f-4d34-b30c-5f8822f89fde None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:50.203675 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df53fb-156f-4d34-b30c-5f8822f89fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:50.255932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-c7df53fb-156f-4d34-b30c-5f8822f89fde None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:50.258180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-c7df53fb-156f-4d34-b30c-5f8822f89fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:50.281321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 877/1748] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:50.283995 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69491237-39ed-4a33-8de3-1819b367039e None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:50.294861 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69491237-39ed-4a33-8de3-1819b367039e None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:50.330283 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400c148-7b92-4e67-948f-e67c1943e74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:50.331099 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400c148-7b92-4e67-948f-e67c1943e74e admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:50.331383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400c148-7b92-4e67-948f-e67c1943e74e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:50.331770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400c148-7b92-4e67-948f-e67c1943e74e admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:50.333218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400c148-7b92-4e67-948f-e67c1943e74e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:50.333529 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400c148-7b92-4e67-948f-e67c1943e74e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:50.345975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400c148-7b92-4e67-948f-e67c1943e74e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:50.447923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 872/1749] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:50.453401 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df53fb-156f-4d34-b30c-5f8822f89fde None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:50.465552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df53fb-156f-4d34-b30c-5f8822f89fde None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:50.488071 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0f560-53a4-45bd-866e-5ac988e42f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:50.497235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0f560-53a4-45bd-866e-5ac988e42f8f admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:50.505048 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0f560-53a4-45bd-866e-5ac988e42f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:50.505523 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0f560-53a4-45bd-866e-5ac988e42f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:50.506469 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0f560-53a4-45bd-866e-5ac988e42f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:50.513546 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0f560-53a4-45bd-866e-5ac988e42f8f admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:50.640340 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 878/1750] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:50 2022] POST /identity/v3/projects => generated 405 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:50.644796 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400c148-7b92-4e67-948f-e67c1943e74e admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:50.658955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400c148-7b92-4e67-948f-e67c1943e74e admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:50.859187 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67159a1-90f1-4ec3-9443-dd5b57a17177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:50.859780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67159a1-90f1-4ec3-9443-dd5b57a17177 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:50.860067 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67159a1-90f1-4ec3-9443-dd5b57a17177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:50.860387 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67159a1-90f1-4ec3-9443-dd5b57a17177 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:50.861092 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67159a1-90f1-4ec3-9443-dd5b57a17177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:50.863308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67159a1-90f1-4ec3-9443-dd5b57a17177 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:50.913840 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 873/1751] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:50 2022] POST /identity/v3/users => generated 303 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:52:50.917762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0f560-53a4-45bd-866e-5ac988e42f8f admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:50.955792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0f560-53a4-45bd-866e-5ac988e42f8f admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:50.999161 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74ec6-8278-46c5-90cd-46c8828aa2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:50.999869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74ec6-8278-46c5-90cd-46c8828aa2ad admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:51.000151 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74ec6-8278-46c5-90cd-46c8828aa2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:51.000451 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74ec6-8278-46c5-90cd-46c8828aa2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:51.001198 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f74ec6-8278-46c5-90cd-46c8828aa2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:51.002854 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f74ec6-8278-46c5-90cd-46c8828aa2ad admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:51.093427 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 879/1752] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:51.107317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67159a1-90f1-4ec3-9443-dd5b57a17177 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:51.161716 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67159a1-90f1-4ec3-9443-dd5b57a17177 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:51.234583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35478bfd-8085-4ff2-9c0a-7564cbb926e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:51.235457 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35478bfd-8085-4ff2-9c0a-7564cbb926e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:51.235705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35478bfd-8085-4ff2-9c0a-7564cbb926e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:51.236299 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35478bfd-8085-4ff2-9c0a-7564cbb926e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:51.242714 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35478bfd-8085-4ff2-9c0a-7564cbb926e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:51.261692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35478bfd-8085-4ff2-9c0a-7564cbb926e8 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:51.310807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74ec6-8278-46c5-90cd-46c8828aa2ad admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:51.315318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 874/1753] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:51.340457 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74ec6-8278-46c5-90cd-46c8828aa2ad admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:51.357182 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7bf71-72d6-47e2-9f61-a3407f690704 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:51.357463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7bf71-72d6-47e2-9f61-a3407f690704 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:51.357907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7bf71-72d6-47e2-9f61-a3407f690704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:51.376894 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934cc34-5aea-42f6-8ad2-f6768009674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:51.380141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934cc34-5aea-42f6-8ad2-f6768009674c admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:51.380489 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934cc34-5aea-42f6-8ad2-f6768009674c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:51.380771 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934cc34-5aea-42f6-8ad2-f6768009674c admin admin] PATH_INFO: `/v3/projects/2c9fb9eaca264dc3816784dc5676b0ee/users/8ae4d3c6609d451e9b7d54d111eadfe9/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:51.408649 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-ded7bf71-72d6-47e2-9f61-a3407f690704 None None] MFA Rules not processed for user `89a11da83d84467ca9ae04b9693beede`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:51.417038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ded7bf71-72d6-47e2-9f61-a3407f690704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:51.457610 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934cc34-5aea-42f6-8ad2-f6768009674c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9fb9eaca264dc3816784dc5676b0ee, user_id=8ae4d3c6609d451e9b7d54d111eadfe9, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:51.482103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934cc34-5aea-42f6-8ad2-f6768009674c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:51.581867 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 880/1754] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:51 2022] PUT /identity/v3/projects/2c9fb9eaca264dc3816784dc5676b0ee/users/8ae4d3c6609d451e9b7d54d111eadfe9/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:51.583720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897c250-1f2a-4c91-8b5d-cd3748561b81 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:51.584008 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897c250-1f2a-4c91-8b5d-cd3748561b81 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:51.584452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897c250-1f2a-4c91-8b5d-cd3748561b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:51.666285 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-6897c250-1f2a-4c91-8b5d-cd3748561b81 None None] MFA Rules not processed for user `8ae4d3c6609d451e9b7d54d111eadfe9`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:51.671524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6897c250-1f2a-4c91-8b5d-cd3748561b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:51.771289 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 875/1755] 10.222.0.105 () {58 vars in 1016 bytes} [Wed Nov 2 12:52:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:51.773883 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7bf71-72d6-47e2-9f61-a3407f690704 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:51.778094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ded7bf71-72d6-47e2-9f61-a3407f690704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:51.851426 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7bf71-72d6-47e2-9f61-a3407f690704 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:51.933342 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 881/1756] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:51.936178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897c250-1f2a-4c91-8b5d-cd3748561b81 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:51.945498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6897c250-1f2a-4c91-8b5d-cd3748561b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:52.119844 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897c250-1f2a-4c91-8b5d-cd3748561b81 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:52.130510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e3795-f04e-4158-a3b7-85c1d1fe0717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:52.131719 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e3795-f04e-4158-a3b7-85c1d1fe0717 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:52.132196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e3795-f04e-4158-a3b7-85c1d1fe0717 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:52.132665 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e3795-f04e-4158-a3b7-85c1d1fe0717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:52.135813 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846647b-17e8-4c90-82ba-bef8d8e264a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:52.138330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846647b-17e8-4c90-82ba-bef8d8e264a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:52.138626 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846647b-17e8-4c90-82ba-bef8d8e264a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:52.141102 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846647b-17e8-4c90-82ba-bef8d8e264a5 admin admin] PATH_INFO: `/v3/projects/59358f47de754a4f8fb01367ae1da680` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:52.144265 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846647b-17e8-4c90-82ba-bef8d8e264a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59358f47de754a4f8fb01367ae1da680)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:52.158934 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846647b-17e8-4c90-82ba-bef8d8e264a5 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:52.164792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e3795-f04e-4158-a3b7-85c1d1fe0717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:52.166355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e3795-f04e-4158-a3b7-85c1d1fe0717 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:52.191916 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 882/1757] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:52.192973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e3795-f04e-4158-a3b7-85c1d1fe0717 service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:52.221299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e3795-f04e-4158-a3b7-85c1d1fe0717 service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:52.235631 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac169c-c8ae-46e8-b9ae-8f8acc549aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:52.236388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac169c-c8ae-46e8-b9ae-8f8acc549aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:52.236665 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac169c-c8ae-46e8-b9ae-8f8acc549aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:52.236946 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac169c-c8ae-46e8-b9ae-8f8acc549aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:52.237748 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac169c-c8ae-46e8-b9ae-8f8acc549aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:52.239795 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac169c-c8ae-46e8-b9ae-8f8acc549aa4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:52.351621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 883/1758] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:52 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:52.357522 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac169c-c8ae-46e8-b9ae-8f8acc549aa4 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:52.426528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6846647b-17e8-4c90-82ba-bef8d8e264a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59358f47de754a4f8fb01367ae1da680', 'request_id': 'req-6846647b-17e8-4c90-82ba-bef8d8e264a5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:52.440196 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6846647b-17e8-4c90-82ba-bef8d8e264a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59358f47de754a4f8fb01367ae1da680', 'request_id': 'req-6846647b-17e8-4c90-82ba-bef8d8e264a5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:52.455865 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6846647b-17e8-4c90-82ba-bef8d8e264a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59358f47de754a4f8fb01367ae1da680', 'request_id': 'req-6846647b-17e8-4c90-82ba-bef8d8e264a5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:52.542784 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6846647b-17e8-4c90-82ba-bef8d8e264a5 admin admin] The token cache is being invalidate because project 59358f47de754a4f8fb01367ae1da680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:52.543082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6846647b-17e8-4c90-82ba-bef8d8e264a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:52.546372 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6846647b-17e8-4c90-82ba-bef8d8e264a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:52.560485 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 876/1759] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:51 2022] DELETE /identity/v3/projects/59358f47de754a4f8fb01367ae1da680 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:52.563589 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846647b-17e8-4c90-82ba-bef8d8e264a5 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:52.566803 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-6846647b-17e8-4c90-82ba-bef8d8e264a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:52.620251 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac169c-c8ae-46e8-b9ae-8f8acc549aa4 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:52.650960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149d7db-6f16-4bf5-a051-07cd7b20f44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:52.652065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149d7db-6f16-4bf5-a051-07cd7b20f44d admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:52.652655 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149d7db-6f16-4bf5-a051-07cd7b20f44d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:52.653138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149d7db-6f16-4bf5-a051-07cd7b20f44d admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:52.654073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149d7db-6f16-4bf5-a051-07cd7b20f44d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:52.658778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149d7db-6f16-4bf5-a051-07cd7b20f44d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:52.715908 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 884/1760] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:52 2022] POST /identity/v3/users => generated 308 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:52.726564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149d7db-6f16-4bf5-a051-07cd7b20f44d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:52.756304 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6149d7db-6f16-4bf5-a051-07cd7b20f44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:52.810147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149d7db-6f16-4bf5-a051-07cd7b20f44d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:52.830584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca14a69-8d9b-4d34-9598-a4951c44a32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:52.832584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca14a69-8d9b-4d34-9598-a4951c44a32c admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:52.833798 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca14a69-8d9b-4d34-9598-a4951c44a32c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:52.836592 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca14a69-8d9b-4d34-9598-a4951c44a32c admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:52.838761 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca14a69-8d9b-4d34-9598-a4951c44a32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:52.841302 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca14a69-8d9b-4d34-9598-a4951c44a32c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:52.868880 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846647b-17e8-4c90-82ba-bef8d8e264a5 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:52.895021 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 885/1761] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:52.897012 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21380b55-445d-4d2a-8755-6a193e090803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:52.898229 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21380b55-445d-4d2a-8755-6a193e090803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:52.898591 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21380b55-445d-4d2a-8755-6a193e090803 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:52.898965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21380b55-445d-4d2a-8755-6a193e090803 admin admin] PATH_INFO: `/v3/users/c0c8e3762d6e4b6b80568b6a6c85614c` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:52.900511 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21380b55-445d-4d2a-8755-6a193e090803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c8e3762d6e4b6b80568b6a6c85614c)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:52.900770 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca14a69-8d9b-4d34-9598-a4951c44a32c admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:52.903032 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21380b55-445d-4d2a-8755-6a193e090803 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:52.940523 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca14a69-8d9b-4d34-9598-a4951c44a32c admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:52.962840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0fb7d-f195-4731-8c75-583376f7e98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:52.968574 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0fb7d-f195-4731-8c75-583376f7e98c admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:52.975285 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0fb7d-f195-4731-8c75-583376f7e98c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:52.975973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0fb7d-f195-4731-8c75-583376f7e98c admin admin] PATH_INFO: `/v3/projects/c5eff1d687254d08bc7acf07fd604e93/users/152b36e8c8484d2b9f796c63ef7ceefc/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:53.046427 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0fb7d-f195-4731-8c75-583376f7e98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5eff1d687254d08bc7acf07fd604e93, user_id=152b36e8c8484d2b9f796c63ef7ceefc, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:53.053638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0fb7d-f195-4731-8c75-583376f7e98c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:53.088506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 886/1762] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:52 2022] PUT /identity/v3/projects/c5eff1d687254d08bc7acf07fd604e93/users/152b36e8c8484d2b9f796c63ef7ceefc/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:53.096377 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0fb7d-f195-4731-8c75-583376f7e98c admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:53.130155 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-21380b55-445d-4d2a-8755-6a193e090803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c8e3762d6e4b6b80568b6a6c85614c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:53.132190 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-21380b55-445d-4d2a-8755-6a193e090803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c8e3762d6e4b6b80568b6a6c85614c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:53.209282 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-21380b55-445d-4d2a-8755-6a193e090803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c8e3762d6e4b6b80568b6a6c85614c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:53.212253 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-21380b55-445d-4d2a-8755-6a193e090803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c8e3762d6e4b6b80568b6a6c85614c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:53.233581 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0fb7d-f195-4731-8c75-583376f7e98c admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:53.235523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-21380b55-445d-4d2a-8755-6a193e090803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c8e3762d6e4b6b80568b6a6c85614c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:53.248603 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31376a-f584-4d3f-88bf-1492650d4301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:53.249642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31376a-f584-4d3f-88bf-1492650d4301 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:53.249994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31376a-f584-4d3f-88bf-1492650d4301 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:53.250327 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31376a-f584-4d3f-88bf-1492650d4301 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:53.251133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31376a-f584-4d3f-88bf-1492650d4301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:53.253056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31376a-f584-4d3f-88bf-1492650d4301 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:53.275822 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 887/1763] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:53.281041 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31376a-f584-4d3f-88bf-1492650d4301 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:53.288025 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ad31376a-f584-4d3f-88bf-1492650d4301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:53.300688 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 877/1764] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:52 2022] DELETE /identity/v3/users/c0c8e3762d6e4b6b80568b6a6c85614c => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:53.332630 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31376a-f584-4d3f-88bf-1492650d4301 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:53.496957 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aa251-1899-4502-8b53-cf96c5cf679c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:53.509040 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aa251-1899-4502-8b53-cf96c5cf679c admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:53.509327 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aa251-1899-4502-8b53-cf96c5cf679c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:53.509613 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aa251-1899-4502-8b53-cf96c5cf679c admin admin] PATH_INFO: `/v3/projects/c5eff1d687254d08bc7acf07fd604e93/users/152b36e8c8484d2b9f796c63ef7ceefc/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:53.518940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aa251-1899-4502-8b53-cf96c5cf679c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5eff1d687254d08bc7acf07fd604e93, user_id=152b36e8c8484d2b9f796c63ef7ceefc, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:53.522169 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aa251-1899-4502-8b53-cf96c5cf679c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:53.602495 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 888/1765] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:53 2022] PUT /identity/v3/projects/c5eff1d687254d08bc7acf07fd604e93/users/152b36e8c8484d2b9f796c63ef7ceefc/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:53.614664 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d2da4-09e9-4c7c-a6dc-2367a83687e1 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:53.616956 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d2da4-09e9-4c7c-a6dc-2367a83687e1 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:53.617488 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d2da4-09e9-4c7c-a6dc-2367a83687e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:53.716307 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-ae1d2da4-09e9-4c7c-a6dc-2367a83687e1 None None] MFA Rules not processed for user `152b36e8c8484d2b9f796c63ef7ceefc`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:53.723303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ae1d2da4-09e9-4c7c-a6dc-2367a83687e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:54.018425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 878/1766] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:54.029196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aa251-1899-4502-8b53-cf96c5cf679c admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:54.031964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-169aa251-1899-4502-8b53-cf96c5cf679c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:54.269588 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aa251-1899-4502-8b53-cf96c5cf679c admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:54.289536 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4aeef-0d89-4622-a600-2350da56ad64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:54.290781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4aeef-0d89-4622-a600-2350da56ad64 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:54.291244 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4aeef-0d89-4622-a600-2350da56ad64 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:54.291812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4aeef-0d89-4622-a600-2350da56ad64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:54.320356 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4aeef-0d89-4622-a600-2350da56ad64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:54.323547 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4aeef-0d89-4622-a600-2350da56ad64 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:54.363896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 889/1767] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:54 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:54.666409 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d2da4-09e9-4c7c-a6dc-2367a83687e1 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:54.812507 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4aeef-0d89-4622-a600-2350da56ad64 service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:54.814142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-26e4aeef-0d89-4622-a600-2350da56ad64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:54.935347 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d2da4-09e9-4c7c-a6dc-2367a83687e1 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:54.945635 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f4f1b-95d3-45a3-b8b8-5fb3dd52798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:54.958565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f4f1b-95d3-45a3-b8b8-5fb3dd52798f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:54.958565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f4f1b-95d3-45a3-b8b8-5fb3dd52798f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:54.958565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f4f1b-95d3-45a3-b8b8-5fb3dd52798f admin admin] PATH_INFO: `/v3/users/8ae4d3c6609d451e9b7d54d111eadfe9` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:54.958565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f4f1b-95d3-45a3-b8b8-5fb3dd52798f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae4d3c6609d451e9b7d54d111eadfe9)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:54.958565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f4f1b-95d3-45a3-b8b8-5fb3dd52798f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:55.069009 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4aeef-0d89-4622-a600-2350da56ad64 service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:55.080949 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50270f02-9b25-4f1c-9293-0c01afbc4a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:55.082439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50270f02-9b25-4f1c-9293-0c01afbc4a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:55.082907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50270f02-9b25-4f1c-9293-0c01afbc4a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:55.083333 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50270f02-9b25-4f1c-9293-0c01afbc4a3d admin admin] PATH_INFO: `/v3/projects/d8ea99b78692498295cb741dcf6a2178` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:55.093258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50270f02-9b25-4f1c-9293-0c01afbc4a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ea99b78692498295cb741dcf6a2178)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:55.098671 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50270f02-9b25-4f1c-9293-0c01afbc4a3d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:55.140889 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e24f4f1b-95d3-45a3-b8b8-5fb3dd52798f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae4d3c6609d451e9b7d54d111eadfe9'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:55.141990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e24f4f1b-95d3-45a3-b8b8-5fb3dd52798f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae4d3c6609d451e9b7d54d111eadfe9'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:55.184872 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e24f4f1b-95d3-45a3-b8b8-5fb3dd52798f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae4d3c6609d451e9b7d54d111eadfe9'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:55.186605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e24f4f1b-95d3-45a3-b8b8-5fb3dd52798f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae4d3c6609d451e9b7d54d111eadfe9'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:55.215583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e24f4f1b-95d3-45a3-b8b8-5fb3dd52798f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae4d3c6609d451e9b7d54d111eadfe9'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:55.259314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 879/1768] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:54 2022] DELETE /identity/v3/users/8ae4d3c6609d451e9b7d54d111eadfe9 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:55.264903 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f29d2-5672-4f9c-9317-cc636f50c17a None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:55.265330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f29d2-5672-4f9c-9317-cc636f50c17a None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:55.265889 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f29d2-5672-4f9c-9317-cc636f50c17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:55.279688 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-50270f02-9b25-4f1c-9293-0c01afbc4a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ea99b78692498295cb741dcf6a2178', 'request_id': 'req-50270f02-9b25-4f1c-9293-0c01afbc4a3d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:55.309687 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-50270f02-9b25-4f1c-9293-0c01afbc4a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ea99b78692498295cb741dcf6a2178', 'request_id': 'req-50270f02-9b25-4f1c-9293-0c01afbc4a3d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:55.328947 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-50270f02-9b25-4f1c-9293-0c01afbc4a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ea99b78692498295cb741dcf6a2178', 'request_id': 'req-50270f02-9b25-4f1c-9293-0c01afbc4a3d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:55.332061 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e69f29d2-5672-4f9c-9317-cc636f50c17a None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:55.337989 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e69f29d2-5672-4f9c-9317-cc636f50c17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:55.374892 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-50270f02-9b25-4f1c-9293-0c01afbc4a3d admin admin] The token cache is being invalidate because project d8ea99b78692498295cb741dcf6a2178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:55.375628 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-50270f02-9b25-4f1c-9293-0c01afbc4a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:55.377307 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-50270f02-9b25-4f1c-9293-0c01afbc4a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:55.382041 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 890/1769] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:54 2022] DELETE /identity/v3/projects/d8ea99b78692498295cb741dcf6a2178 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:52:55.390527 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd8713-651f-42b7-939f-b791f3e169ce None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:55.391140 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd8713-651f-42b7-939f-b791f3e169ce None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:55.391611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd8713-651f-42b7-939f-b791f3e169ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:55.452994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-b7dd8713-651f-42b7-939f-b791f3e169ce None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:55.454756 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b7dd8713-651f-42b7-939f-b791f3e169ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:55.589362 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 891/1770] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:55.591090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5ffb1-0ba9-40ec-a484-b4f725dc8629 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:55.591779 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 880/1771] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:55.592325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5ffb1-0ba9-40ec-a484-b4f725dc8629 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:55.592966 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5ffb1-0ba9-40ec-a484-b4f725dc8629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:55.622622 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f29d2-5672-4f9c-9317-cc636f50c17a None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:55.639269 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e69f29d2-5672-4f9c-9317-cc636f50c17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:55.648896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-1cb5ffb1-0ba9-40ec-a484-b4f725dc8629 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:55.651920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1cb5ffb1-0ba9-40ec-a484-b4f725dc8629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:55.684927 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 892/1772] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:55.690145 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5ffb1-0ba9-40ec-a484-b4f725dc8629 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:55.722774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5ffb1-0ba9-40ec-a484-b4f725dc8629 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:55.745234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2d867-5dcd-4386-a6d2-3485a2fde017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:55.746930 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2d867-5dcd-4386-a6d2-3485a2fde017 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:55.747355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2d867-5dcd-4386-a6d2-3485a2fde017 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:55.747693 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2d867-5dcd-4386-a6d2-3485a2fde017 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:55.751366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2d867-5dcd-4386-a6d2-3485a2fde017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:55.754869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2d867-5dcd-4386-a6d2-3485a2fde017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:55.756643 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2d867-5dcd-4386-a6d2-3485a2fde017 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:55.815898 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 893/1773] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:55.822480 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2d867-5dcd-4386-a6d2-3485a2fde017 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:55.863960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2d867-5dcd-4386-a6d2-3485a2fde017 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:55.882009 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a36e2c-282b-454b-b9a0-984a3037bc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:55.882973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a36e2c-282b-454b-b9a0-984a3037bc55 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:55.883461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a36e2c-282b-454b-b9a0-984a3037bc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:55.884134 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a36e2c-282b-454b-b9a0-984a3037bc55 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:55.885033 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a36e2c-282b-454b-b9a0-984a3037bc55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:55.887233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a36e2c-282b-454b-b9a0-984a3037bc55 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:55.899273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f29d2-5672-4f9c-9317-cc636f50c17a None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:55.914429 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c734b9-47c8-4842-ab8e-1e46b9e5e65f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:55.915475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c734b9-47c8-4842-ab8e-1e46b9e5e65f service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:55.916723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c734b9-47c8-4842-ab8e-1e46b9e5e65f service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:55.920106 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c734b9-47c8-4842-ab8e-1e46b9e5e65f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:55.945795 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c734b9-47c8-4842-ab8e-1e46b9e5e65f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:55.948554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c734b9-47c8-4842-ab8e-1e46b9e5e65f service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:55.968322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 881/1774] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:56.002269 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 894/1775] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:55 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:56.004057 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c734b9-47c8-4842-ab8e-1e46b9e5e65f service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:56.047319 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c734b9-47c8-4842-ab8e-1e46b9e5e65f service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:56.259460 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46b66c-dba8-4f77-95cd-7329b2fc2777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:56.260360 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46b66c-dba8-4f77-95cd-7329b2fc2777 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:56.260644 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46b66c-dba8-4f77-95cd-7329b2fc2777 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:56.260965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46b66c-dba8-4f77-95cd-7329b2fc2777 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:56.261829 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46b66c-dba8-4f77-95cd-7329b2fc2777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:56.264592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46b66c-dba8-4f77-95cd-7329b2fc2777 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:56.322565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 882/1776] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:56 2022] POST /identity/v3/users => generated 290 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:56.324345 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a36e2c-282b-454b-b9a0-984a3037bc55 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:56.341451 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a36e2c-282b-454b-b9a0-984a3037bc55 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:56.356007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4722e0-e99f-4d64-a06c-d22df4e18cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:56.357282 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4722e0-e99f-4d64-a06c-d22df4e18cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:56.358080 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4722e0-e99f-4d64-a06c-d22df4e18cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:56.358667 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4722e0-e99f-4d64-a06c-d22df4e18cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:56.361084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4722e0-e99f-4d64-a06c-d22df4e18cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:56.366482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4722e0-e99f-4d64-a06c-d22df4e18cd7 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:56.399788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 895/1777] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:56.401110 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46b66c-dba8-4f77-95cd-7329b2fc2777 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:56.438513 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46b66c-dba8-4f77-95cd-7329b2fc2777 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:56.465394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10200059-8394-455f-a5ea-5374a869bb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:56.466400 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10200059-8394-455f-a5ea-5374a869bb4d admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:56.466891 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10200059-8394-455f-a5ea-5374a869bb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:56.467378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10200059-8394-455f-a5ea-5374a869bb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:56.469079 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10200059-8394-455f-a5ea-5374a869bb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:56.473166 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10200059-8394-455f-a5ea-5374a869bb4d admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:56.538355 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 883/1778] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:56.542009 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4722e0-e99f-4d64-a06c-d22df4e18cd7 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:56.558806 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4722e0-e99f-4d64-a06c-d22df4e18cd7 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:56.580112 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a852f8-790b-428e-8ed1-74ced179f771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:56.581272 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a852f8-790b-428e-8ed1-74ced179f771 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:56.581652 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a852f8-790b-428e-8ed1-74ced179f771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:56.581989 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a852f8-790b-428e-8ed1-74ced179f771 admin admin] PATH_INFO: `/v3/projects/f7fd04930e634d01b17ae381bcfc5d46/users/27c8f1536bcf4c8f842717a4a15a5b0a/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:56.627524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a852f8-790b-428e-8ed1-74ced179f771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7fd04930e634d01b17ae381bcfc5d46, user_id=27c8f1536bcf4c8f842717a4a15a5b0a, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:56.636884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a852f8-790b-428e-8ed1-74ced179f771 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:56.683750 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 896/1779] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:56 2022] PUT /identity/v3/projects/f7fd04930e634d01b17ae381bcfc5d46/users/27c8f1536bcf4c8f842717a4a15a5b0a/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:56.696522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d54b81-7d05-433a-a509-7e2dc0404bd7 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:56.697002 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d54b81-7d05-433a-a509-7e2dc0404bd7 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:56.697501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d54b81-7d05-433a-a509-7e2dc0404bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:56.853363 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-b9d54b81-7d05-433a-a509-7e2dc0404bd7 None None] MFA Rules not processed for user `27c8f1536bcf4c8f842717a4a15a5b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:56.859353 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-b9d54b81-7d05-433a-a509-7e2dc0404bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:57.094593 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 884/1780] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:57.097062 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a852f8-790b-428e-8ed1-74ced179f771 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:57.267267 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a852f8-790b-428e-8ed1-74ced179f771 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:57.289403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b3243-0071-4850-b079-93509cf1f7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:57.290623 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b3243-0071-4850-b079-93509cf1f7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:57.291072 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b3243-0071-4850-b079-93509cf1f7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:57.291751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b3243-0071-4850-b079-93509cf1f7a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:57.293131 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b3243-0071-4850-b079-93509cf1f7a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:57.295863 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b3243-0071-4850-b079-93509cf1f7a0 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:57.388579 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 897/1781] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:57 2022] POST /identity/v3/projects => generated 377 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:57.391046 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d54b81-7d05-433a-a509-7e2dc0404bd7 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:57.418577 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d54b81-7d05-433a-a509-7e2dc0404bd7 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:57.655482 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d66bff-b725-4d9b-92f9-13efb40d9d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:57.656904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d66bff-b725-4d9b-92f9-13efb40d9d16 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:57.657418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d66bff-b725-4d9b-92f9-13efb40d9d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:57.657698 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d66bff-b725-4d9b-92f9-13efb40d9d16 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:57.666521 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d66bff-b725-4d9b-92f9-13efb40d9d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:57.678858 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d66bff-b725-4d9b-92f9-13efb40d9d16 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:57.739971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 885/1782] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:57 2022] POST /identity/v3/users => generated 289 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:57.744467 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b3243-0071-4850-b079-93509cf1f7a0 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:57.790123 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b3243-0071-4850-b079-93509cf1f7a0 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:57.828605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0054a8-102a-4a96-bb03-cf06d995aca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:57.829328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0054a8-102a-4a96-bb03-cf06d995aca1 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:57.829591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0054a8-102a-4a96-bb03-cf06d995aca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:57.830036 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0054a8-102a-4a96-bb03-cf06d995aca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:57.830615 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0054a8-102a-4a96-bb03-cf06d995aca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:57.832481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0054a8-102a-4a96-bb03-cf06d995aca1 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:57.868674 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 898/1783] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:57.871295 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d66bff-b725-4d9b-92f9-13efb40d9d16 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:57.898609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d66bff-b725-4d9b-92f9-13efb40d9d16 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:57.953649 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2108df-94c8-4ae0-83c2-b6f07e643f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:57.954666 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2108df-94c8-4ae0-83c2-b6f07e643f46 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:57.955175 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2108df-94c8-4ae0-83c2-b6f07e643f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:57.955771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2108df-94c8-4ae0-83c2-b6f07e643f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:57.956958 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2108df-94c8-4ae0-83c2-b6f07e643f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:57.959296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2108df-94c8-4ae0-83c2-b6f07e643f46 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:57.972082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47cf85-965b-47c4-b46a-811d989fc6c4 None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:57.972402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47cf85-965b-47c4-b46a-811d989fc6c4 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:57.972685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47cf85-965b-47c4-b46a-811d989fc6c4 None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:57.974638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 899/1784] 10.222.0.90 () {54 vars in 921 bytes} [Wed Nov 2 12:52:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:52:57.992587 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 886/1785] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:57.993817 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47cf85-965b-47c4-b46a-811d989fc6c4 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:58.029256 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47cf85-965b-47c4-b46a-811d989fc6c4 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:58.045896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2826b-97c4-45e8-987b-8dfcd7086365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:58.047591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2826b-97c4-45e8-987b-8dfcd7086365 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:58.048441 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2826b-97c4-45e8-987b-8dfcd7086365 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:58.049153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2826b-97c4-45e8-987b-8dfcd7086365 admin admin] PATH_INFO: `/v3/projects/d51fbe4c7b3d4beeafda4d9d8b058edf/users/7a05f93178384c24b1174acbc064a59e/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:58.097645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2826b-97c4-45e8-987b-8dfcd7086365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51fbe4c7b3d4beeafda4d9d8b058edf, user_id=7a05f93178384c24b1174acbc064a59e, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:58.103945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2826b-97c4-45e8-987b-8dfcd7086365 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:58.142903 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1648b-7b3a-4786-bc20-1d2dff87c9d9 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:58.143517 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1648b-7b3a-4786-bc20-1d2dff87c9d9 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:58.143517 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1648b-7b3a-4786-bc20-1d2dff87c9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:58.146406 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 900/1786] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:57 2022] PUT /identity/v3/projects/d51fbe4c7b3d4beeafda4d9d8b058edf/users/7a05f93178384c24b1174acbc064a59e/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:52:58.159432 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4088454-a3db-4fa5-9f39-5cb753c7cfd2 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:58.159722 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4088454-a3db-4fa5-9f39-5cb753c7cfd2 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:58.160716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4088454-a3db-4fa5-9f39-5cb753c7cfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:58.195162 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-13d1648b-7b3a-4786-bc20-1d2dff87c9d9 None None] MFA Rules not processed for user `fbcda58f298444eebf4f08ce01deffc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:58.198428 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-13d1648b-7b3a-4786-bc20-1d2dff87c9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:58.211016 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-a4088454-a3db-4fa5-9f39-5cb753c7cfd2 None None] MFA Rules not processed for user `7a05f93178384c24b1174acbc064a59e`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:58.213405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-a4088454-a3db-4fa5-9f39-5cb753c7cfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:58.355440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 901/1787] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:58.358094 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4088454-a3db-4fa5-9f39-5cb753c7cfd2 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:58.362471 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 887/1788] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Nov 2 12:52:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:58.551478 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4088454-a3db-4fa5-9f39-5cb753c7cfd2 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:58.573582 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9797f-2673-458e-9a6a-b46b97810a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:58.574451 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9797f-2673-458e-9a6a-b46b97810a33 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:58.575100 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9797f-2673-458e-9a6a-b46b97810a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:58.575193 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9797f-2673-458e-9a6a-b46b97810a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:58.583824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9797f-2673-458e-9a6a-b46b97810a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:58.586003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9797f-2673-458e-9a6a-b46b97810a33 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:58.662591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 902/1789] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:58 2022] POST /identity/v3/projects => generated 377 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:58.667970 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1648b-7b3a-4786-bc20-1d2dff87c9d9 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:58.683806 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1648b-7b3a-4786-bc20-1d2dff87c9d9 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:58.825267 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fed9c4-6f81-4d47-b339-4cd9c774baad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:58.826057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9797f-2673-458e-9a6a-b46b97810a33 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:58.826323 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fed9c4-6f81-4d47-b339-4cd9c774baad admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:58.830623 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e9d9797f-2673-458e-9a6a-b46b97810a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:58.837534 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fed9c4-6f81-4d47-b339-4cd9c774baad admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:58.837950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fed9c4-6f81-4d47-b339-4cd9c774baad admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:58.838839 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fed9c4-6f81-4d47-b339-4cd9c774baad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:58.845673 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fed9c4-6f81-4d47-b339-4cd9c774baad admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:58.897037 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 888/1790] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:58 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:58.899497 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fed9c4-6f81-4d47-b339-4cd9c774baad admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:58.915969 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fed9c4-6f81-4d47-b339-4cd9c774baad admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:58.932460 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31ba8f-3b36-4562-8962-1441cfdf6598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:58.934236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31ba8f-3b36-4562-8962-1441cfdf6598 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:58.934663 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31ba8f-3b36-4562-8962-1441cfdf6598 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:58.935087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31ba8f-3b36-4562-8962-1441cfdf6598 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:58.935993 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31ba8f-3b36-4562-8962-1441cfdf6598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:58.937839 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31ba8f-3b36-4562-8962-1441cfdf6598 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:58.956486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 889/1791] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:58.957828 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31ba8f-3b36-4562-8962-1441cfdf6598 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:58.969141 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31ba8f-3b36-4562-8962-1441cfdf6598 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:58.974262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92bc3f-bbaa-4f58-a09e-87e049ffe02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:58.975246 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92bc3f-bbaa-4f58-a09e-87e049ffe02f admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:58.975616 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92bc3f-bbaa-4f58-a09e-87e049ffe02f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:58.976005 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92bc3f-bbaa-4f58-a09e-87e049ffe02f admin admin] PATH_INFO: `/v3/projects/39b83a7be01e498089c5e92661766edd/users/192830918ce54d0d9a824511e3bec64d/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:58.995329 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9797f-2673-458e-9a6a-b46b97810a33 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:59.001798 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92bc3f-bbaa-4f58-a09e-87e049ffe02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b83a7be01e498089c5e92661766edd, user_id=192830918ce54d0d9a824511e3bec64d, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:59.007514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc1ff6-4b14-4c27-80f4-5b97f7729cce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:59.009854 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc1ff6-4b14-4c27-80f4-5b97f7729cce service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:59.010206 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc1ff6-4b14-4c27-80f4-5b97f7729cce service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:59.011085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc1ff6-4b14-4c27-80f4-5b97f7729cce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:59.011389 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92bc3f-bbaa-4f58-a09e-87e049ffe02f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:59.030819 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc1ff6-4b14-4c27-80f4-5b97f7729cce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:59.034378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc1ff6-4b14-4c27-80f4-5b97f7729cce service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:59.054906 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 890/1792] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:58 2022] PUT /identity/v3/projects/39b83a7be01e498089c5e92661766edd/users/192830918ce54d0d9a824511e3bec64d/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:59.059475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92bc3f-bbaa-4f58-a09e-87e049ffe02f admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:59.078372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 903/1793] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:52:59.157090 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92bc3f-bbaa-4f58-a09e-87e049ffe02f admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:59.172873 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedd725-4ee1-411e-806e-1d3ee4f779dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:59.173944 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedd725-4ee1-411e-806e-1d3ee4f779dc admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:59.174236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedd725-4ee1-411e-806e-1d3ee4f779dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:59.174538 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedd725-4ee1-411e-806e-1d3ee4f779dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:59.175997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedd725-4ee1-411e-806e-1d3ee4f779dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:59.181403 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedd725-4ee1-411e-806e-1d3ee4f779dc admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:59.205996 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 891/1794] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:52:59.210884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc1ff6-4b14-4c27-80f4-5b97f7729cce service nova] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:59.226087 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc1ff6-4b14-4c27-80f4-5b97f7729cce service nova] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:59.235542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99545a31-d678-40fe-a54b-acdac1f5beec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:59.236877 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99545a31-d678-40fe-a54b-acdac1f5beec admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:59.237369 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99545a31-d678-40fe-a54b-acdac1f5beec admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:59.237883 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99545a31-d678-40fe-a54b-acdac1f5beec admin admin] PATH_INFO: `/v3/projects/39b83a7be01e498089c5e92661766edd/users/192830918ce54d0d9a824511e3bec64d/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:59.240347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99545a31-d678-40fe-a54b-acdac1f5beec admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b83a7be01e498089c5e92661766edd, user_id=192830918ce54d0d9a824511e3bec64d, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:59.243460 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99545a31-d678-40fe-a54b-acdac1f5beec admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:59.279029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 904/1795] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:59 2022] PUT /identity/v3/projects/39b83a7be01e498089c5e92661766edd/users/192830918ce54d0d9a824511e3bec64d/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:59.294250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebb5d6-c014-4c25-8bad-0cb2608fda23 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:59.294702 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebb5d6-c014-4c25-8bad-0cb2608fda23 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:59.295038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebb5d6-c014-4c25-8bad-0cb2608fda23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:59.382435 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-ddebb5d6-c014-4c25-8bad-0cb2608fda23 None None] MFA Rules not processed for user `192830918ce54d0d9a824511e3bec64d`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:59.384977 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ddebb5d6-c014-4c25-8bad-0cb2608fda23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:59.520049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 892/1796] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:52:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:59.535158 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99545a31-d678-40fe-a54b-acdac1f5beec admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:59.538549 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-99545a31-d678-40fe-a54b-acdac1f5beec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:59.730072 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99545a31-d678-40fe-a54b-acdac1f5beec admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:59.735772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bec2d-fe99-41f9-a965-3901a3fcfe56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:59.737838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bec2d-fe99-41f9-a965-3901a3fcfe56 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:59.738425 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bec2d-fe99-41f9-a965-3901a3fcfe56 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:59.739039 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bec2d-fe99-41f9-a965-3901a3fcfe56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:59.753879 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bec2d-fe99-41f9-a965-3901a3fcfe56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:59.756969 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bec2d-fe99-41f9-a965-3901a3fcfe56 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:59.782929 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 905/1797] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:00.042595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebb5d6-c014-4c25-8bad-0cb2608fda23 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:00.062007 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebb5d6-c014-4c25-8bad-0cb2608fda23 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:00.070897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a0c85-3ff5-4f7d-bb9f-48d87276dc4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:00.071729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a0c85-3ff5-4f7d-bb9f-48d87276dc4b service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:00.071966 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a0c85-3ff5-4f7d-bb9f-48d87276dc4b service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:00.074675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a0c85-3ff5-4f7d-bb9f-48d87276dc4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:00.228889 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a0c85-3ff5-4f7d-bb9f-48d87276dc4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:00.234878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a0c85-3ff5-4f7d-bb9f-48d87276dc4b service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:00.264986 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 893/1798] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:00.523312 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bec2d-fe99-41f9-a965-3901a3fcfe56 service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:00.525262 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8f7bec2d-fe99-41f9-a965-3901a3fcfe56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:00.706724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bec2d-fe99-41f9-a965-3901a3fcfe56 service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:00.719269 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555039d-94b2-4780-9729-03a029d2a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:00.720566 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555039d-94b2-4780-9729-03a029d2a152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:00.721033 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555039d-94b2-4780-9729-03a029d2a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:00.721459 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555039d-94b2-4780-9729-03a029d2a152 admin admin] PATH_INFO: `/v3/projects/2c9fb9eaca264dc3816784dc5676b0ee` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:00.725054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555039d-94b2-4780-9729-03a029d2a152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c9fb9eaca264dc3816784dc5676b0ee)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:00.727449 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555039d-94b2-4780-9729-03a029d2a152 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:00.868606 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6555039d-94b2-4780-9729-03a029d2a152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9fb9eaca264dc3816784dc5676b0ee', 'request_id': 'req-6555039d-94b2-4780-9729-03a029d2a152'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:00.885958 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6555039d-94b2-4780-9729-03a029d2a152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9fb9eaca264dc3816784dc5676b0ee', 'request_id': 'req-6555039d-94b2-4780-9729-03a029d2a152'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:00.906089 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6555039d-94b2-4780-9729-03a029d2a152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9fb9eaca264dc3816784dc5676b0ee', 'request_id': 'req-6555039d-94b2-4780-9729-03a029d2a152'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:00.933181 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6555039d-94b2-4780-9729-03a029d2a152 admin admin] The token cache is being invalidate because project 2c9fb9eaca264dc3816784dc5676b0ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:00.935113 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6555039d-94b2-4780-9729-03a029d2a152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:00.939003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6555039d-94b2-4780-9729-03a029d2a152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:00.947716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 906/1799] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:00 2022] DELETE /identity/v3/projects/2c9fb9eaca264dc3816784dc5676b0ee => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:00.950049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a0c85-3ff5-4f7d-bb9f-48d87276dc4b service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:00.974443 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a0c85-3ff5-4f7d-bb9f-48d87276dc4b service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:01.197100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712caa1-cc9f-40de-bc50-74b6995807c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:01.199371 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712caa1-cc9f-40de-bc50-74b6995807c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:01.199894 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712caa1-cc9f-40de-bc50-74b6995807c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:01.200414 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712caa1-cc9f-40de-bc50-74b6995807c5 admin admin] PATH_INFO: `/v3/users/152b36e8c8484d2b9f796c63ef7ceefc` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:01.202342 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712caa1-cc9f-40de-bc50-74b6995807c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=152b36e8c8484d2b9f796c63ef7ceefc)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:01.204827 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712caa1-cc9f-40de-bc50-74b6995807c5 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:01.302233 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a712caa1-cc9f-40de-bc50-74b6995807c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152b36e8c8484d2b9f796c63ef7ceefc'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:01.304147 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a712caa1-cc9f-40de-bc50-74b6995807c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152b36e8c8484d2b9f796c63ef7ceefc'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:01.325820 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a712caa1-cc9f-40de-bc50-74b6995807c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152b36e8c8484d2b9f796c63ef7ceefc'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:01.326818 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a712caa1-cc9f-40de-bc50-74b6995807c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152b36e8c8484d2b9f796c63ef7ceefc'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:01.340360 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a712caa1-cc9f-40de-bc50-74b6995807c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152b36e8c8484d2b9f796c63ef7ceefc'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:01.382563 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 894/1800] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:00 2022] DELETE /identity/v3/users/152b36e8c8484d2b9f796c63ef7ceefc => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:01.903155 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555039d-94b2-4780-9729-03a029d2a152 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:01.904725 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6555039d-94b2-4780-9729-03a029d2a152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:01.926436 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555039d-94b2-4780-9729-03a029d2a152 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.036034 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74838865-fc4b-4898-9ffc-b882024674d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.037047 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74838865-fc4b-4898-9ffc-b882024674d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.037254 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74838865-fc4b-4898-9ffc-b882024674d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.037525 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74838865-fc4b-4898-9ffc-b882024674d3 admin admin] PATH_INFO: `/v3/projects/c5eff1d687254d08bc7acf07fd604e93` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.038764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74838865-fc4b-4898-9ffc-b882024674d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5eff1d687254d08bc7acf07fd604e93)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.040743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74838865-fc4b-4898-9ffc-b882024674d3 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.119374 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-74838865-fc4b-4898-9ffc-b882024674d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5eff1d687254d08bc7acf07fd604e93', 'request_id': 'req-74838865-fc4b-4898-9ffc-b882024674d3'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:02.137095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-74838865-fc4b-4898-9ffc-b882024674d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5eff1d687254d08bc7acf07fd604e93', 'request_id': 'req-74838865-fc4b-4898-9ffc-b882024674d3'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:02.147175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-74838865-fc4b-4898-9ffc-b882024674d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5eff1d687254d08bc7acf07fd604e93', 'request_id': 'req-74838865-fc4b-4898-9ffc-b882024674d3'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:02.161917 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-74838865-fc4b-4898-9ffc-b882024674d3 admin admin] The token cache is being invalidate because project c5eff1d687254d08bc7acf07fd604e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:02.162213 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-74838865-fc4b-4898-9ffc-b882024674d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:02.163108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-74838865-fc4b-4898-9ffc-b882024674d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:02.164935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 907/1801] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:01 2022] DELETE /identity/v3/projects/c5eff1d687254d08bc7acf07fd604e93 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:02.169842 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abecfbb-397c-4cd7-a02d-57c79e29c115 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.170430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abecfbb-397c-4cd7-a02d-57c79e29c115 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.170859 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abecfbb-397c-4cd7-a02d-57c79e29c115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.194910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-0abecfbb-397c-4cd7-a02d-57c79e29c115 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:02.196965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0abecfbb-397c-4cd7-a02d-57c79e29c115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:02.258115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 895/1802] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:02.265985 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6c702-ebe1-4742-8644-d49df9b2478b None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.266429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6c702-ebe1-4742-8644-d49df9b2478b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.266907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6c702-ebe1-4742-8644-d49df9b2478b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.288143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-93c6c702-ebe1-4742-8644-d49df9b2478b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:02.289538 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-93c6c702-ebe1-4742-8644-d49df9b2478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:02.298246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 908/1803] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:02.305549 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abecfbb-397c-4cd7-a02d-57c79e29c115 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.315793 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abecfbb-397c-4cd7-a02d-57c79e29c115 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.320833 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af82de-2636-4ace-aa08-3bf2eda854bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.321630 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af82de-2636-4ace-aa08-3bf2eda854bc admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.321952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af82de-2636-4ace-aa08-3bf2eda854bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.322271 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af82de-2636-4ace-aa08-3bf2eda854bc admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.323181 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af82de-2636-4ace-aa08-3bf2eda854bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:02.323953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af82de-2636-4ace-aa08-3bf2eda854bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.325932 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af82de-2636-4ace-aa08-3bf2eda854bc admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.338208 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 896/1804] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:02.344145 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6c702-ebe1-4742-8644-d49df9b2478b None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.353803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6c702-ebe1-4742-8644-d49df9b2478b None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.359264 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f31ad2-eea8-4c3b-abe9-51bacad6976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.360110 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f31ad2-eea8-4c3b-abe9-51bacad6976b admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.360681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f31ad2-eea8-4c3b-abe9-51bacad6976b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.360959 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f31ad2-eea8-4c3b-abe9-51bacad6976b admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.361798 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f31ad2-eea8-4c3b-abe9-51bacad6976b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.364986 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f31ad2-eea8-4c3b-abe9-51bacad6976b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.396337 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 909/1805] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:02 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:02.401134 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af82de-2636-4ace-aa08-3bf2eda854bc admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.411963 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af82de-2636-4ace-aa08-3bf2eda854bc admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.475724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb740471-64c9-4853-ae84-cb7f884f2c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.476452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb740471-64c9-4853-ae84-cb7f884f2c95 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.476739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb740471-64c9-4853-ae84-cb7f884f2c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.477015 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb740471-64c9-4853-ae84-cb7f884f2c95 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.477715 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb740471-64c9-4853-ae84-cb7f884f2c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.479676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb740471-64c9-4853-ae84-cb7f884f2c95 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.504622 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 897/1806] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:02 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:02.505360 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f31ad2-eea8-4c3b-abe9-51bacad6976b admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.516591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f31ad2-eea8-4c3b-abe9-51bacad6976b admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.522632 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674d7ff-7b17-4469-8ab4-4fe6de57d492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.523376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674d7ff-7b17-4469-8ab4-4fe6de57d492 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.523601 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674d7ff-7b17-4469-8ab4-4fe6de57d492 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.524009 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674d7ff-7b17-4469-8ab4-4fe6de57d492 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.524800 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674d7ff-7b17-4469-8ab4-4fe6de57d492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.526434 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674d7ff-7b17-4469-8ab4-4fe6de57d492 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.538724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 910/1807] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:02.543383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb740471-64c9-4853-ae84-cb7f884f2c95 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.553942 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb740471-64c9-4853-ae84-cb7f884f2c95 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.558564 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c479a3-f9d6-49b1-91c1-d205cbacfeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.559228 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c479a3-f9d6-49b1-91c1-d205cbacfeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.559531 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c479a3-f9d6-49b1-91c1-d205cbacfeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.559801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c479a3-f9d6-49b1-91c1-d205cbacfeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.560561 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c479a3-f9d6-49b1-91c1-d205cbacfeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.562438 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c479a3-f9d6-49b1-91c1-d205cbacfeb6 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.572330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 898/1808] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:02.577437 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674d7ff-7b17-4469-8ab4-4fe6de57d492 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.592097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674d7ff-7b17-4469-8ab4-4fe6de57d492 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.596769 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfdacb-2d21-475e-b73e-18572f50acf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.597669 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfdacb-2d21-475e-b73e-18572f50acf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.597945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfdacb-2d21-475e-b73e-18572f50acf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.598214 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfdacb-2d21-475e-b73e-18572f50acf4 admin admin] PATH_INFO: `/v3/projects/0b3fdac3357b42a39f3b70aaa3857893/users/2a5bd0c2a71e4b489bbfc6616b419b69/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.615627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfdacb-2d21-475e-b73e-18572f50acf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3fdac3357b42a39f3b70aaa3857893, user_id=2a5bd0c2a71e4b489bbfc6616b419b69, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.619832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfdacb-2d21-475e-b73e-18572f50acf4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.635752 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 911/1809] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:02 2022] PUT /identity/v3/projects/0b3fdac3357b42a39f3b70aaa3857893/users/2a5bd0c2a71e4b489bbfc6616b419b69/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:02.649502 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffae0a-aae8-47a0-b7bd-3ead1407c661 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.649783 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffae0a-aae8-47a0-b7bd-3ead1407c661 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.651828 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffae0a-aae8-47a0-b7bd-3ead1407c661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.682145 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-ffffae0a-aae8-47a0-b7bd-3ead1407c661 None None] MFA Rules not processed for user `2a5bd0c2a71e4b489bbfc6616b419b69`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:02.683511 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ffffae0a-aae8-47a0-b7bd-3ead1407c661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:02.755332 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 899/1810] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:02.760612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfdacb-2d21-475e-b73e-18572f50acf4 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.827912 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfdacb-2d21-475e-b73e-18572f50acf4 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.832940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47cb38-7438-4da8-8495-6afe666634b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.833757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47cb38-7438-4da8-8495-6afe666634b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.834046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47cb38-7438-4da8-8495-6afe666634b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.834312 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47cb38-7438-4da8-8495-6afe666634b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.834994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47cb38-7438-4da8-8495-6afe666634b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.837454 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47cb38-7438-4da8-8495-6afe666634b1 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.875164 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 912/1811] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:02 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:02.879535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffae0a-aae8-47a0-b7bd-3ead1407c661 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.890897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffae0a-aae8-47a0-b7bd-3ead1407c661 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.958064 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627cd27-a422-420f-a1b3-b261feddcdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.958855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627cd27-a422-420f-a1b3-b261feddcdfd admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.959219 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627cd27-a422-420f-a1b3-b261feddcdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.959527 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627cd27-a422-420f-a1b3-b261feddcdfd admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.960407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627cd27-a422-420f-a1b3-b261feddcdfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.962583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627cd27-a422-420f-a1b3-b261feddcdfd admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.983079 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 900/1812] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:02 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:02.987428 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47cb38-7438-4da8-8495-6afe666634b1 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.998402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47cb38-7438-4da8-8495-6afe666634b1 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:03.004350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de751b-1bb0-473e-9979-61721b754ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:03.005060 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de751b-1bb0-473e-9979-61721b754ceb admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.005342 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de751b-1bb0-473e-9979-61721b754ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.005616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de751b-1bb0-473e-9979-61721b754ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.006376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de751b-1bb0-473e-9979-61721b754ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:03.007936 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de751b-1bb0-473e-9979-61721b754ceb admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:03.018976 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 913/1813] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:03.023876 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627cd27-a422-420f-a1b3-b261feddcdfd admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:03.034427 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627cd27-a422-420f-a1b3-b261feddcdfd admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:03.039592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65ee9b-8d3d-4206-8aba-f2a2a972c204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:03.040530 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65ee9b-8d3d-4206-8aba-f2a2a972c204 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.040805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65ee9b-8d3d-4206-8aba-f2a2a972c204 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.041074 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65ee9b-8d3d-4206-8aba-f2a2a972c204 admin admin] PATH_INFO: `/v3/projects/496deccf243948e0bb8392ee22c75a0b/users/7f3f001726bc4845a001d412f5956875/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.057060 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65ee9b-8d3d-4206-8aba-f2a2a972c204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496deccf243948e0bb8392ee22c75a0b, user_id=7f3f001726bc4845a001d412f5956875, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:03.060070 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65ee9b-8d3d-4206-8aba-f2a2a972c204 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:03.073732 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 901/1814] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:03 2022] PUT /identity/v3/projects/496deccf243948e0bb8392ee22c75a0b/users/7f3f001726bc4845a001d412f5956875/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:03.077854 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de751b-1bb0-473e-9979-61721b754ceb admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:03.088298 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de751b-1bb0-473e-9979-61721b754ceb admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:03.150139 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ad547-dab0-479b-845a-57bfed5d6dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:03.150901 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ad547-dab0-479b-845a-57bfed5d6dbb admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.151250 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ad547-dab0-479b-845a-57bfed5d6dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.151920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ad547-dab0-479b-845a-57bfed5d6dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.152924 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ad547-dab0-479b-845a-57bfed5d6dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:03.154682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ad547-dab0-479b-845a-57bfed5d6dbb admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:03.172091 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 914/1815] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:03.176403 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65ee9b-8d3d-4206-8aba-f2a2a972c204 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:03.187087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65ee9b-8d3d-4206-8aba-f2a2a972c204 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:03.202394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80a42f-cdd0-4629-8eb6-224d3293e298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:03.202579 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80a42f-cdd0-4629-8eb6-224d3293e298 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.202710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80a42f-cdd0-4629-8eb6-224d3293e298 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.202989 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80a42f-cdd0-4629-8eb6-224d3293e298 admin admin] PATH_INFO: `/v3/projects/496deccf243948e0bb8392ee22c75a0b/users/7f3f001726bc4845a001d412f5956875/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.211350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80a42f-cdd0-4629-8eb6-224d3293e298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496deccf243948e0bb8392ee22c75a0b, user_id=7f3f001726bc4845a001d412f5956875, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:03.218613 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80a42f-cdd0-4629-8eb6-224d3293e298 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:03.237513 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 902/1816] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:03 2022] PUT /identity/v3/projects/496deccf243948e0bb8392ee22c75a0b/users/7f3f001726bc4845a001d412f5956875/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:03.249519 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9e80d-124b-4ef8-a3a4-3ac1ae1d7e55 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.250227 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9e80d-124b-4ef8-a3a4-3ac1ae1d7e55 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.250703 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9e80d-124b-4ef8-a3a4-3ac1ae1d7e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.281631 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-dbf9e80d-124b-4ef8-a3a4-3ac1ae1d7e55 None None] MFA Rules not processed for user `7f3f001726bc4845a001d412f5956875`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:03.283070 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-dbf9e80d-124b-4ef8-a3a4-3ac1ae1d7e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:03.449014 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 915/1817] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:03.488566 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80a42f-cdd0-4629-8eb6-224d3293e298 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:03.496056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5c80a42f-cdd0-4629-8eb6-224d3293e298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:03.594929 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80a42f-cdd0-4629-8eb6-224d3293e298 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:03.600552 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067a144-e76c-4a29-a875-75a683a3e869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:03.601165 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067a144-e76c-4a29-a875-75a683a3e869 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.601442 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067a144-e76c-4a29-a875-75a683a3e869 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.601748 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067a144-e76c-4a29-a875-75a683a3e869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.612669 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067a144-e76c-4a29-a875-75a683a3e869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:03.614573 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067a144-e76c-4a29-a875-75a683a3e869 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:03.628181 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 903/1818] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:03.658069 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9e80d-124b-4ef8-a3a4-3ac1ae1d7e55 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:03.733835 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9e80d-124b-4ef8-a3a4-3ac1ae1d7e55 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:03.742574 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48557fae-f798-4c48-973a-57f9ec70687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:03.743864 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48557fae-f798-4c48-973a-57f9ec70687c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.748292 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48557fae-f798-4c48-973a-57f9ec70687c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.749051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48557fae-f798-4c48-973a-57f9ec70687c admin admin] PATH_INFO: `/v3/users/2a5bd0c2a71e4b489bbfc6616b419b69` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.750381 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48557fae-f798-4c48-973a-57f9ec70687c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5bd0c2a71e4b489bbfc6616b419b69)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:03.756313 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48557fae-f798-4c48-973a-57f9ec70687c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:03.758257 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067a144-e76c-4a29-a875-75a683a3e869 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:03.761897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7067a144-e76c-4a29-a875-75a683a3e869 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:03.784165 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067a144-e76c-4a29-a875-75a683a3e869 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:03.791437 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1981e9-c986-4869-9a4c-3401c6ad8d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:03.792870 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1981e9-c986-4869-9a4c-3401c6ad8d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.793393 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1981e9-c986-4869-9a4c-3401c6ad8d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.793662 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1981e9-c986-4869-9a4c-3401c6ad8d2c admin admin] PATH_INFO: `/v3/users/fea9ab0ee2e94297ae7634e83beee25b` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.794980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1981e9-c986-4869-9a4c-3401c6ad8d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea9ab0ee2e94297ae7634e83beee25b)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:03.797341 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1981e9-c986-4869-9a4c-3401c6ad8d2c admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:03.820403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-48557fae-f798-4c48-973a-57f9ec70687c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5bd0c2a71e4b489bbfc6616b419b69'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:03.822649 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-48557fae-f798-4c48-973a-57f9ec70687c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5bd0c2a71e4b489bbfc6616b419b69'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:03.842650 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-48557fae-f798-4c48-973a-57f9ec70687c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5bd0c2a71e4b489bbfc6616b419b69'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:03.843592 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-48557fae-f798-4c48-973a-57f9ec70687c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5bd0c2a71e4b489bbfc6616b419b69'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:03.855871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-48557fae-f798-4c48-973a-57f9ec70687c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5bd0c2a71e4b489bbfc6616b419b69'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:03.878127 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0e1981e9-c986-4869-9a4c-3401c6ad8d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea9ab0ee2e94297ae7634e83beee25b'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:03.878864 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0e1981e9-c986-4869-9a4c-3401c6ad8d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea9ab0ee2e94297ae7634e83beee25b'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:03.884833 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 916/1819] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:03 2022] DELETE /identity/v3/users/2a5bd0c2a71e4b489bbfc6616b419b69 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:03.896768 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc5a84-9daf-45ae-ba3d-189f7b22fbe4 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.896768 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc5a84-9daf-45ae-ba3d-189f7b22fbe4 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.896768 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc5a84-9daf-45ae-ba3d-189f7b22fbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.897578 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0e1981e9-c986-4869-9a4c-3401c6ad8d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea9ab0ee2e94297ae7634e83beee25b'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:03.898378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0e1981e9-c986-4869-9a4c-3401c6ad8d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea9ab0ee2e94297ae7634e83beee25b'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:03.907862 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0e1981e9-c986-4869-9a4c-3401c6ad8d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea9ab0ee2e94297ae7634e83beee25b'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:03.923684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-04dc5a84-9daf-45ae-ba3d-189f7b22fbe4 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:03.925241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-04dc5a84-9daf-45ae-ba3d-189f7b22fbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:03.927270 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 904/1820] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:03 2022] DELETE /identity/v3/users/fea9ab0ee2e94297ae7634e83beee25b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:03.932495 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d128494-ab7a-49fb-9fd7-b140a966708e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.932495 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d128494-ab7a-49fb-9fd7-b140a966708e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.932495 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d128494-ab7a-49fb-9fd7-b140a966708e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.957639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-6d128494-ab7a-49fb-9fd7-b140a966708e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:03.958955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-6d128494-ab7a-49fb-9fd7-b140a966708e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:04.027034 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 917/1821] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:04.038842 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc5a84-9daf-45ae-ba3d-189f7b22fbe4 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:04.040412 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-04dc5a84-9daf-45ae-ba3d-189f7b22fbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:04.053215 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 905/1822] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:04.065752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d128494-ab7a-49fb-9fd7-b140a966708e None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:04.067173 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-6d128494-ab7a-49fb-9fd7-b140a966708e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:04.125139 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc5a84-9daf-45ae-ba3d-189f7b22fbe4 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:04.131138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c71e9-762f-4570-b1fc-88dec2ea413e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:04.132247 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c71e9-762f-4570-b1fc-88dec2ea413e service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:04.133604 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c71e9-762f-4570-b1fc-88dec2ea413e service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:04.133604 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c71e9-762f-4570-b1fc-88dec2ea413e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:04.141362 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d128494-ab7a-49fb-9fd7-b140a966708e None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:04.146026 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c71e9-762f-4570-b1fc-88dec2ea413e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:04.148031 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c71e9-762f-4570-b1fc-88dec2ea413e service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:04.148150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c93587-be17-46e3-ad8e-1017651bd92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:04.149039 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c93587-be17-46e3-ad8e-1017651bd92e service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:04.150171 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c93587-be17-46e3-ad8e-1017651bd92e service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:04.150171 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c93587-be17-46e3-ad8e-1017651bd92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:04.160725 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c93587-be17-46e3-ad8e-1017651bd92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:04.162583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c93587-be17-46e3-ad8e-1017651bd92e service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:04.174035 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 906/1823] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:04.176393 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 918/1824] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:53:04.842986 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c93587-be17-46e3-ad8e-1017651bd92e service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:04.844907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-08c93587-be17-46e3-ad8e-1017651bd92e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:04.855904 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c71e9-762f-4570-b1fc-88dec2ea413e service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:04.857520 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ad7c71e9-762f-4570-b1fc-88dec2ea413e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:04.889142 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c93587-be17-46e3-ad8e-1017651bd92e service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:04.895089 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:04.896363 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:04.897700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:04.898076 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6 admin admin] PATH_INFO: `/v3/projects/0b3fdac3357b42a39f3b70aaa3857893` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:04.899799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3fdac3357b42a39f3b70aaa3857893)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:04.902255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:04.904166 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c71e9-762f-4570-b1fc-88dec2ea413e service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:04.917522 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:04.919097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:04.919532 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:04.919820 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5 admin admin] PATH_INFO: `/v3/projects/1647093592124a1db08fb07a31be065f` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:04.921227 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1647093592124a1db08fb07a31be065f)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:04.924659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:05.013328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1647093592124a1db08fb07a31be065f', 'request_id': 'req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.014233 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3fdac3357b42a39f3b70aaa3857893', 'request_id': 'req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.027018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1647093592124a1db08fb07a31be065f', 'request_id': 'req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.029396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3fdac3357b42a39f3b70aaa3857893', 'request_id': 'req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.046662 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1647093592124a1db08fb07a31be065f', 'request_id': 'req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.048336 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3fdac3357b42a39f3b70aaa3857893', 'request_id': 'req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.062834 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5 admin admin] The token cache is being invalidate because project 1647093592124a1db08fb07a31be065f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:05.063336 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.064340 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.069562 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 919/1825] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:04 2022] DELETE /identity/v3/projects/1647093592124a1db08fb07a31be065f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:05.070846 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:05.073700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:05.081418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6 admin admin] The token cache is being invalidate because project 0b3fdac3357b42a39f3b70aaa3857893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:05.082118 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.083396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.087863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 907/1826] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:04 2022] DELETE /identity/v3/projects/0b3fdac3357b42a39f3b70aaa3857893 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:05.088804 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:05.092875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:05.156129 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7efa00-493e-4d05-9761-d59a2ae4c9a5 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:05.160450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533dd8f-e490-47cf-a6a2-d8b6ace8e9e6 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:05.161461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45844f-795b-4706-b160-01f6d55efce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:05.162433 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45844f-795b-4706-b160-01f6d55efce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:05.162831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45844f-795b-4706-b160-01f6d55efce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:05.163114 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45844f-795b-4706-b160-01f6d55efce7 admin admin] PATH_INFO: `/v3/users/27c8f1536bcf4c8f842717a4a15a5b0a` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:05.164494 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45844f-795b-4706-b160-01f6d55efce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c8f1536bcf4c8f842717a4a15a5b0a)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:05.165270 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2ee66-fcaa-4b48-8a99-ac7df6fe1aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:05.166145 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2ee66-fcaa-4b48-8a99-ac7df6fe1aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:05.166424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2ee66-fcaa-4b48-8a99-ac7df6fe1aee admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:05.166693 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2ee66-fcaa-4b48-8a99-ac7df6fe1aee admin admin] PATH_INFO: `/v3/users/f9888b783f3849a0beffa7d9c8944942` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:05.166935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45844f-795b-4706-b160-01f6d55efce7 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:05.168020 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2ee66-fcaa-4b48-8a99-ac7df6fe1aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9888b783f3849a0beffa7d9c8944942)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:05.169947 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2ee66-fcaa-4b48-8a99-ac7df6fe1aee admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:05.220845 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ef45844f-795b-4706-b160-01f6d55efce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c8f1536bcf4c8f842717a4a15a5b0a'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.221244 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-18b2ee66-fcaa-4b48-8a99-ac7df6fe1aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9888b783f3849a0beffa7d9c8944942'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.221785 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ef45844f-795b-4706-b160-01f6d55efce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c8f1536bcf4c8f842717a4a15a5b0a'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.221958 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-18b2ee66-fcaa-4b48-8a99-ac7df6fe1aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9888b783f3849a0beffa7d9c8944942'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.235000 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ef45844f-795b-4706-b160-01f6d55efce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c8f1536bcf4c8f842717a4a15a5b0a'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.236627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ef45844f-795b-4706-b160-01f6d55efce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c8f1536bcf4c8f842717a4a15a5b0a'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.244715 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-18b2ee66-fcaa-4b48-8a99-ac7df6fe1aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9888b783f3849a0beffa7d9c8944942'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.245841 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-18b2ee66-fcaa-4b48-8a99-ac7df6fe1aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9888b783f3849a0beffa7d9c8944942'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.246154 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ef45844f-795b-4706-b160-01f6d55efce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c8f1536bcf4c8f842717a4a15a5b0a'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.254522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-18b2ee66-fcaa-4b48-8a99-ac7df6fe1aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9888b783f3849a0beffa7d9c8944942'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.260533 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 920/1827] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:05 2022] DELETE /identity/v3/users/27c8f1536bcf4c8f842717a4a15a5b0a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:05.261683 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45844f-795b-4706-b160-01f6d55efce7 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:05.263591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ef45844f-795b-4706-b160-01f6d55efce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:05.268881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 908/1828] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:05 2022] DELETE /identity/v3/users/f9888b783f3849a0beffa7d9c8944942 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:05.270295 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4e9ee-da72-4d92-b745-a87614efb462 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:05.270583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4e9ee-da72-4d92-b745-a87614efb462 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:05.270859 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4e9ee-da72-4d92-b745-a87614efb462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:05.290551 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-bbd4e9ee-da72-4d92-b745-a87614efb462 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:05.292919 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-bbd4e9ee-da72-4d92-b745-a87614efb462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:05.369202 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 909/1829] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:05.372601 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45844f-795b-4706-b160-01f6d55efce7 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:05.378972 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241623b-1dfc-4855-bc2e-ffd09e1013ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:05.379892 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241623b-1dfc-4855-bc2e-ffd09e1013ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:05.380454 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241623b-1dfc-4855-bc2e-ffd09e1013ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:05.380736 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241623b-1dfc-4855-bc2e-ffd09e1013ea admin admin] PATH_INFO: `/v3/users/7f3f001726bc4845a001d412f5956875` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:05.382046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241623b-1dfc-4855-bc2e-ffd09e1013ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3f001726bc4845a001d412f5956875)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:05.384106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241623b-1dfc-4855-bc2e-ffd09e1013ea admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:05.407057 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4e9ee-da72-4d92-b745-a87614efb462 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:05.408632 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-bbd4e9ee-da72-4d92-b745-a87614efb462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:05.449680 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6241623b-1dfc-4855-bc2e-ffd09e1013ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3f001726bc4845a001d412f5956875'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.453789 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6241623b-1dfc-4855-bc2e-ffd09e1013ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3f001726bc4845a001d412f5956875'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.501373 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6241623b-1dfc-4855-bc2e-ffd09e1013ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3f001726bc4845a001d412f5956875'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.502135 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6241623b-1dfc-4855-bc2e-ffd09e1013ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3f001726bc4845a001d412f5956875'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.517191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6241623b-1dfc-4855-bc2e-ffd09e1013ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3f001726bc4845a001d412f5956875'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.532299 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4e9ee-da72-4d92-b745-a87614efb462 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:05.534615 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 921/1830] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:05 2022] DELETE /identity/v3/users/7f3f001726bc4845a001d412f5956875 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:05.538352 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ec381-ac2b-42b0-aeae-8b90d7ea9f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:05.538981 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ec381-ac2b-42b0-aeae-8b90d7ea9f06 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:05.539335 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ec381-ac2b-42b0-aeae-8b90d7ea9f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:05.539708 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ec381-ac2b-42b0-aeae-8b90d7ea9f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:05.541706 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7d5ec381-ac2b-42b0-aeae-8b90d7ea9f06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:05.556559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ec381-ac2b-42b0-aeae-8b90d7ea9f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:05.558203 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ec381-ac2b-42b0-aeae-8b90d7ea9f06 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:05.571171 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 910/1831] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:53:06.138633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241623b-1dfc-4855-bc2e-ffd09e1013ea admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:06.143064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6241623b-1dfc-4855-bc2e-ffd09e1013ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:06.160575 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ec381-ac2b-42b0-aeae-8b90d7ea9f06 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:06.162164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7d5ec381-ac2b-42b0-aeae-8b90d7ea9f06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:06.176068 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ec381-ac2b-42b0-aeae-8b90d7ea9f06 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:06.248357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:06.249355 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:06.249741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:06.250234 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f admin admin] PATH_INFO: `/v3/projects/f551ebd538484329b744fb96626c1ad3` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:06.252111 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f551ebd538484329b744fb96626c1ad3)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:06.254311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:06.319512 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241623b-1dfc-4855-bc2e-ffd09e1013ea admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:06.333978 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f551ebd538484329b744fb96626c1ad3', 'request_id': 'req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.344635 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f551ebd538484329b744fb96626c1ad3', 'request_id': 'req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.352602 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f551ebd538484329b744fb96626c1ad3', 'request_id': 'req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.380539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f admin admin] The token cache is being invalidate because project f551ebd538484329b744fb96626c1ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:06.380846 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.381512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.383605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 911/1832] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:06 2022] DELETE /identity/v3/projects/f551ebd538484329b744fb96626c1ad3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:06.395013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:06.396954 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:06.406094 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76203bbc-f8d1-49b3-b6df-ffd54710e075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:06.408154 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76203bbc-f8d1-49b3-b6df-ffd54710e075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:06.408757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76203bbc-f8d1-49b3-b6df-ffd54710e075 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:06.409327 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76203bbc-f8d1-49b3-b6df-ffd54710e075 admin admin] PATH_INFO: `/v3/projects/496deccf243948e0bb8392ee22c75a0b` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:06.410817 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76203bbc-f8d1-49b3-b6df-ffd54710e075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=496deccf243948e0bb8392ee22c75a0b)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:06.412960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76203bbc-f8d1-49b3-b6df-ffd54710e075 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:06.473938 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-76203bbc-f8d1-49b3-b6df-ffd54710e075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496deccf243948e0bb8392ee22c75a0b', 'request_id': 'req-76203bbc-f8d1-49b3-b6df-ffd54710e075'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.484354 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-76203bbc-f8d1-49b3-b6df-ffd54710e075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496deccf243948e0bb8392ee22c75a0b', 'request_id': 'req-76203bbc-f8d1-49b3-b6df-ffd54710e075'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.487288 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3da3a-f1fe-4bd7-8693-1e6533504d0f admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:06.493211 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-76203bbc-f8d1-49b3-b6df-ffd54710e075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496deccf243948e0bb8392ee22c75a0b', 'request_id': 'req-76203bbc-f8d1-49b3-b6df-ffd54710e075'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.536255 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-76203bbc-f8d1-49b3-b6df-ffd54710e075 admin admin] The token cache is being invalidate because project 496deccf243948e0bb8392ee22c75a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:06.536746 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-76203bbc-f8d1-49b3-b6df-ffd54710e075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.537602 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-76203bbc-f8d1-49b3-b6df-ffd54710e075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.543402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 922/1833] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:06 2022] DELETE /identity/v3/projects/496deccf243948e0bb8392ee22c75a0b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:06.545100 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f0924-e2e0-48cd-bfd6-58ad73857b3a None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:06.545561 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f0924-e2e0-48cd-bfd6-58ad73857b3a None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:06.545994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f0924-e2e0-48cd-bfd6-58ad73857b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:06.567237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-c16f0924-e2e0-48cd-bfd6-58ad73857b3a None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:06.568979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-c16f0924-e2e0-48cd-bfd6-58ad73857b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:06.591426 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06de92a-84e9-4fcf-81a4-02e6dbe0ce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:06.592383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06de92a-84e9-4fcf-81a4-02e6dbe0ce60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:06.594340 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06de92a-84e9-4fcf-81a4-02e6dbe0ce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:06.595339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06de92a-84e9-4fcf-81a4-02e6dbe0ce60 admin admin] PATH_INFO: `/v3/projects/f7fd04930e634d01b17ae381bcfc5d46` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:06.596171 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06de92a-84e9-4fcf-81a4-02e6dbe0ce60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7fd04930e634d01b17ae381bcfc5d46)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:06.601043 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06de92a-84e9-4fcf-81a4-02e6dbe0ce60 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:06.656856 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 923/1834] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:06.658215 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e6b47-32dd-4215-896a-45814dfbba4e None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:06.658499 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e6b47-32dd-4215-896a-45814dfbba4e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:06.658773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e6b47-32dd-4215-896a-45814dfbba4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:06.671034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c06de92a-84e9-4fcf-81a4-02e6dbe0ce60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7fd04930e634d01b17ae381bcfc5d46', 'request_id': 'req-c06de92a-84e9-4fcf-81a4-02e6dbe0ce60'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.677525 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-c43e6b47-32dd-4215-896a-45814dfbba4e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:06.678896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-c43e6b47-32dd-4215-896a-45814dfbba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:06.682816 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c06de92a-84e9-4fcf-81a4-02e6dbe0ce60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7fd04930e634d01b17ae381bcfc5d46', 'request_id': 'req-c06de92a-84e9-4fcf-81a4-02e6dbe0ce60'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.689139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c06de92a-84e9-4fcf-81a4-02e6dbe0ce60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7fd04930e634d01b17ae381bcfc5d46', 'request_id': 'req-c06de92a-84e9-4fcf-81a4-02e6dbe0ce60'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.701618 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c06de92a-84e9-4fcf-81a4-02e6dbe0ce60 admin admin] The token cache is being invalidate because project f7fd04930e634d01b17ae381bcfc5d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:06.701875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c06de92a-84e9-4fcf-81a4-02e6dbe0ce60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.702511 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c06de92a-84e9-4fcf-81a4-02e6dbe0ce60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.704256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 912/1835] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:06 2022] DELETE /identity/v3/projects/f7fd04930e634d01b17ae381bcfc5d46 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:06.705520 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8ec8b-af20-4733-8966-ee8534a48953 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:06.705802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8ec8b-af20-4733-8966-ee8534a48953 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:06.706080 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8ec8b-af20-4733-8966-ee8534a48953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:06.724875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-f1f8ec8b-af20-4733-8966-ee8534a48953 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:06.726554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f1f8ec8b-af20-4733-8966-ee8534a48953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:06.740160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 924/1836] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:06.740160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e6b47-32dd-4215-896a-45814dfbba4e None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:06.740160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-c43e6b47-32dd-4215-896a-45814dfbba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:06.754685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e6b47-32dd-4215-896a-45814dfbba4e None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:06.759610 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a7d04-a845-4812-871e-c17d807a59e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:06.760535 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a7d04-a845-4812-871e-c17d807a59e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:06.760862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a7d04-a845-4812-871e-c17d807a59e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:06.761325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a7d04-a845-4812-871e-c17d807a59e1 admin admin] PATH_INFO: `/v3/users/7a05f93178384c24b1174acbc064a59e` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:06.762528 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a7d04-a845-4812-871e-c17d807a59e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a05f93178384c24b1174acbc064a59e)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:06.764540 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a7d04-a845-4812-871e-c17d807a59e1 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:06.803105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 913/1837] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:06.804623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed8612-9217-4251-9ae4-69e09dbc2b44 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:06.804915 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed8612-9217-4251-9ae4-69e09dbc2b44 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:06.805267 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed8612-9217-4251-9ae4-69e09dbc2b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:06.818297 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6c9a7d04-a845-4812-871e-c17d807a59e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a05f93178384c24b1174acbc064a59e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.818991 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6c9a7d04-a845-4812-871e-c17d807a59e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a05f93178384c24b1174acbc064a59e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.824924 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-74ed8612-9217-4251-9ae4-69e09dbc2b44 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:06.826164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-74ed8612-9217-4251-9ae4-69e09dbc2b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:06.832229 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6c9a7d04-a845-4812-871e-c17d807a59e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a05f93178384c24b1174acbc064a59e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.833108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6c9a7d04-a845-4812-871e-c17d807a59e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a05f93178384c24b1174acbc064a59e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.834401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 914/1838] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:06.835022 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed8612-9217-4251-9ae4-69e09dbc2b44 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:06.842493 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6c9a7d04-a845-4812-871e-c17d807a59e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a05f93178384c24b1174acbc064a59e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.846710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed8612-9217-4251-9ae4-69e09dbc2b44 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:06.851402 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08475819-5422-4125-a492-f0600997f1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:06.852262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08475819-5422-4125-a492-f0600997f1bd admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:06.852658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08475819-5422-4125-a492-f0600997f1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:06.852859 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08475819-5422-4125-a492-f0600997f1bd admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:06.853628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08475819-5422-4125-a492-f0600997f1bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:06.854036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08475819-5422-4125-a492-f0600997f1bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:06.855692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08475819-5422-4125-a492-f0600997f1bd admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:06.856042 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 925/1839] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:06 2022] DELETE /identity/v3/users/7a05f93178384c24b1174acbc064a59e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:06.856991 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a7d04-a845-4812-871e-c17d807a59e1 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:06.858564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6c9a7d04-a845-4812-871e-c17d807a59e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:06.870496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 915/1840] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:06.874757 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08475819-5422-4125-a492-f0600997f1bd admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:06.877413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-08475819-5422-4125-a492-f0600997f1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:06.891213 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08475819-5422-4125-a492-f0600997f1bd admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:06.931264 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a7d04-a845-4812-871e-c17d807a59e1 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:06.936177 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81b8c9-256f-4551-896f-55b1652715d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:06.936881 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81b8c9-256f-4551-896f-55b1652715d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:06.937162 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81b8c9-256f-4551-896f-55b1652715d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:06.937436 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81b8c9-256f-4551-896f-55b1652715d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:06.938164 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81b8c9-256f-4551-896f-55b1652715d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:06.938468 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81b8c9-256f-4551-896f-55b1652715d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:06.940086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81b8c9-256f-4551-896f-55b1652715d3 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:06.955082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 926/1841] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:06.958837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110906ec-2191-42c2-96a8-dfca7867b3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:06.959079 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81b8c9-256f-4551-896f-55b1652715d3 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:06.959504 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110906ec-2191-42c2-96a8-dfca7867b3fa admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:06.959791 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110906ec-2191-42c2-96a8-dfca7867b3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:06.960077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110906ec-2191-42c2-96a8-dfca7867b3fa admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:06.960802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110906ec-2191-42c2-96a8-dfca7867b3fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:06.963206 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110906ec-2191-42c2-96a8-dfca7867b3fa admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:06.971651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81b8c9-256f-4551-896f-55b1652715d3 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:06.983447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8efbbc-9373-4f5b-b71a-b2edd2650d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:06.984229 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8efbbc-9373-4f5b-b71a-b2edd2650d5b admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:06.984774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8efbbc-9373-4f5b-b71a-b2edd2650d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:06.984774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8efbbc-9373-4f5b-b71a-b2edd2650d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:06.985468 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8efbbc-9373-4f5b-b71a-b2edd2650d5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:06.987763 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8efbbc-9373-4f5b-b71a-b2edd2650d5b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.001208 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 916/1842] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:06 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:07.005903 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110906ec-2191-42c2-96a8-dfca7867b3fa admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.021210 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 927/1843] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:06 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:07.025497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8efbbc-9373-4f5b-b71a-b2edd2650d5b admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.081289 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110906ec-2191-42c2-96a8-dfca7867b3fa admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:07.122951 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8efbbc-9373-4f5b-b71a-b2edd2650d5b admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:07.129839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118ace4-83f5-43b2-a7b8-c12c2faae6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:07.130542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118ace4-83f5-43b2-a7b8-c12c2faae6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.130819 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118ace4-83f5-43b2-a7b8-c12c2faae6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.131086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118ace4-83f5-43b2-a7b8-c12c2faae6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.131850 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118ace4-83f5-43b2-a7b8-c12c2faae6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:07.133773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118ace4-83f5-43b2-a7b8-c12c2faae6e2 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.160361 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 928/1844] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:07 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:07.165660 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118ace4-83f5-43b2-a7b8-c12c2faae6e2 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.172041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c2b5f-a68a-495e-8add-54ee87c61282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:07.173420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c2b5f-a68a-495e-8add-54ee87c61282 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.173729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c2b5f-a68a-495e-8add-54ee87c61282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.173999 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c2b5f-a68a-495e-8add-54ee87c61282 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.174721 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c2b5f-a68a-495e-8add-54ee87c61282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:07.176950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c2b5f-a68a-495e-8add-54ee87c61282 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.190896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118ace4-83f5-43b2-a7b8-c12c2faae6e2 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:07.198932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549055dc-2fa2-44ef-b796-4773cbebd606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:07.199993 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549055dc-2fa2-44ef-b796-4773cbebd606 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.200563 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549055dc-2fa2-44ef-b796-4773cbebd606 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.202981 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 917/1845] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:07 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:07.203856 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c2b5f-a68a-495e-8add-54ee87c61282 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.206027 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-024c2b5f-a68a-495e-8add-54ee87c61282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:07.208233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549055dc-2fa2-44ef-b796-4773cbebd606 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.209052 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549055dc-2fa2-44ef-b796-4773cbebd606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:07.210715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549055dc-2fa2-44ef-b796-4773cbebd606 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.218769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c2b5f-a68a-495e-8add-54ee87c61282 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:07.224407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:07.225297 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.225693 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.225966 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1 admin admin] PATH_INFO: `/v3/projects/d51fbe4c7b3d4beeafda4d9d8b058edf` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.226913 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 929/1846] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:07.227838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549055dc-2fa2-44ef-b796-4773cbebd606 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.230633 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51fbe4c7b3d4beeafda4d9d8b058edf)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:07.232624 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.241144 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549055dc-2fa2-44ef-b796-4773cbebd606 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:07.246654 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7847338-b07e-4538-a26a-c8a7e243f264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:07.247400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7847338-b07e-4538-a26a-c8a7e243f264 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.247754 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7847338-b07e-4538-a26a-c8a7e243f264 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.248099 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7847338-b07e-4538-a26a-c8a7e243f264 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.248954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7847338-b07e-4538-a26a-c8a7e243f264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:07.250942 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7847338-b07e-4538-a26a-c8a7e243f264 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.263740 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 930/1847] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:07.264642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7847338-b07e-4538-a26a-c8a7e243f264 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.275001 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7847338-b07e-4538-a26a-c8a7e243f264 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:07.296321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51fbe4c7b3d4beeafda4d9d8b058edf', 'request_id': 'req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.305924 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51fbe4c7b3d4beeafda4d9d8b058edf', 'request_id': 'req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.312699 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51fbe4c7b3d4beeafda4d9d8b058edf', 'request_id': 'req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.327007 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1 admin admin] The token cache is being invalidate because project d51fbe4c7b3d4beeafda4d9d8b058edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:07.327451 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.328138 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.332613 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 918/1848] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:07 2022] DELETE /identity/v3/projects/d51fbe4c7b3d4beeafda4d9d8b058edf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:07.332613 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.332613 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:07.336802 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61b42a-db18-483d-b773-bfa71145343d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:07.337505 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61b42a-db18-483d-b773-bfa71145343d admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.337787 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61b42a-db18-483d-b773-bfa71145343d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.338115 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61b42a-db18-483d-b773-bfa71145343d admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.338859 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61b42a-db18-483d-b773-bfa71145343d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:07.340595 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61b42a-db18-483d-b773-bfa71145343d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.344673 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff489e35-c8cd-4dea-8eb7-1a3f889a4ef1 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:07.349666 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2b603-5e1f-4f98-ab21-e71b45b36f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:07.350513 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2b603-5e1f-4f98-ab21-e71b45b36f94 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.350804 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2b603-5e1f-4f98-ab21-e71b45b36f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.351087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2b603-5e1f-4f98-ab21-e71b45b36f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.351824 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2b603-5e1f-4f98-ab21-e71b45b36f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:07.355899 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 931/1849] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:07.355899 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61b42a-db18-483d-b773-bfa71145343d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.356100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2b603-5e1f-4f98-ab21-e71b45b36f94 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.356182 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-3a61b42a-db18-483d-b773-bfa71145343d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:07.366294 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 919/1850] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:07.367262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2b603-5e1f-4f98-ab21-e71b45b36f94 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.371164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-10b2b603-5e1f-4f98-ab21-e71b45b36f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:07.372243 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61b42a-db18-483d-b773-bfa71145343d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:07.376593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e43827-2498-4062-8cd1-a4ebb6b885c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:07.377479 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e43827-2498-4062-8cd1-a4ebb6b885c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.377762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e43827-2498-4062-8cd1-a4ebb6b885c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.378590 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e43827-2498-4062-8cd1-a4ebb6b885c8 admin admin] PATH_INFO: `/v3/users/192830918ce54d0d9a824511e3bec64d` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.379273 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e43827-2498-4062-8cd1-a4ebb6b885c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=192830918ce54d0d9a824511e3bec64d)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:07.381260 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e43827-2498-4062-8cd1-a4ebb6b885c8 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.387899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2b603-5e1f-4f98-ab21-e71b45b36f94 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:07.396752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b84972-049b-428e-83d8-cbf379ff41d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:07.397677 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b84972-049b-428e-83d8-cbf379ff41d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.397952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b84972-049b-428e-83d8-cbf379ff41d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.398274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b84972-049b-428e-83d8-cbf379ff41d9 admin admin] PATH_INFO: `/v3/projects/2a45ec60c47e47a8a79326a9917a20aa/users/030c1d90be31408ebcc0fb9e0bfb9c9e/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.415505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b84972-049b-428e-83d8-cbf379ff41d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a45ec60c47e47a8a79326a9917a20aa, user_id=030c1d90be31408ebcc0fb9e0bfb9c9e, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:07.418475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b84972-049b-428e-83d8-cbf379ff41d9 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.436033 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 920/1851] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:07 2022] PUT /identity/v3/projects/2a45ec60c47e47a8a79326a9917a20aa/users/030c1d90be31408ebcc0fb9e0bfb9c9e/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:07.436624 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b84972-049b-428e-83d8-cbf379ff41d9 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.445115 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-63e43827-2498-4062-8cd1-a4ebb6b885c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '192830918ce54d0d9a824511e3bec64d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.445798 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-63e43827-2498-4062-8cd1-a4ebb6b885c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '192830918ce54d0d9a824511e3bec64d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.458747 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-63e43827-2498-4062-8cd1-a4ebb6b885c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '192830918ce54d0d9a824511e3bec64d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.459372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-63e43827-2498-4062-8cd1-a4ebb6b885c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '192830918ce54d0d9a824511e3bec64d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.471139 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-63e43827-2498-4062-8cd1-a4ebb6b885c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '192830918ce54d0d9a824511e3bec64d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.487231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 932/1852] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:07 2022] DELETE /identity/v3/users/192830918ce54d0d9a824511e3bec64d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:07.491817 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd08b3b-bad4-480a-a826-a5c17996f67e None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.492122 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd08b3b-bad4-480a-a826-a5c17996f67e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.492533 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd08b3b-bad4-480a-a826-a5c17996f67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.514472 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b84972-049b-428e-83d8-cbf379ff41d9 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:07.526765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-8fd08b3b-bad4-480a-a826-a5c17996f67e None None] MFA Rules not processed for user `030c1d90be31408ebcc0fb9e0bfb9c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:07.528024 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8fd08b3b-bad4-480a-a826-a5c17996f67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:07.594936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe6b1c-7f52-4bab-80ec-5f98bf8c6c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:07.596092 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe6b1c-7f52-4bab-80ec-5f98bf8c6c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.596496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe6b1c-7f52-4bab-80ec-5f98bf8c6c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.596866 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe6b1c-7f52-4bab-80ec-5f98bf8c6c53 admin admin] PATH_INFO: `/v3/projects/4efbfab0840f43f98cae3b644d043843/users/7ea574ff84fa46c99fbf77e44aa3aca7/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.617003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe6b1c-7f52-4bab-80ec-5f98bf8c6c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4efbfab0840f43f98cae3b644d043843, user_id=7ea574ff84fa46c99fbf77e44aa3aca7, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:07.619896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe6b1c-7f52-4bab-80ec-5f98bf8c6c53 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.646035 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 921/1853] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:07 2022] PUT /identity/v3/projects/4efbfab0840f43f98cae3b644d043843/users/7ea574ff84fa46c99fbf77e44aa3aca7/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:07.649125 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 933/1854] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:07.654008 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe6b1c-7f52-4bab-80ec-5f98bf8c6c53 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.656109 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4efe6b1c-7f52-4bab-80ec-5f98bf8c6c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:07.657929 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2ea45-64ed-49d1-8ebe-6b249d60a39f None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.658327 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2ea45-64ed-49d1-8ebe-6b249d60a39f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.658619 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2ea45-64ed-49d1-8ebe-6b249d60a39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.702304 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-f3d2ea45-64ed-49d1-8ebe-6b249d60a39f None None] MFA Rules not processed for user `7ea574ff84fa46c99fbf77e44aa3aca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:07.703650 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f3d2ea45-64ed-49d1-8ebe-6b249d60a39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:07.742817 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe6b1c-7f52-4bab-80ec-5f98bf8c6c53 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:07.748949 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760966c-006c-41c1-8de2-14330a418abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:07.749619 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760966c-006c-41c1-8de2-14330a418abb admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.749896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760966c-006c-41c1-8de2-14330a418abb admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.750167 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760966c-006c-41c1-8de2-14330a418abb admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.751335 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760966c-006c-41c1-8de2-14330a418abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:07.754065 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760966c-006c-41c1-8de2-14330a418abb admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.782332 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 934/1855] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:07.786870 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2ea45-64ed-49d1-8ebe-6b249d60a39f None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.788853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f3d2ea45-64ed-49d1-8ebe-6b249d60a39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:07.792154 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 922/1856] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:07 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:07.793784 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760966c-006c-41c1-8de2-14330a418abb admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.810738 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2ea45-64ed-49d1-8ebe-6b249d60a39f None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:07.888525 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f2429-8afc-4ae3-8319-f3892c76f624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:07.890229 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f2429-8afc-4ae3-8319-f3892c76f624 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.890861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f2429-8afc-4ae3-8319-f3892c76f624 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.890999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f2429-8afc-4ae3-8319-f3892c76f624 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.892409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f2429-8afc-4ae3-8319-f3892c76f624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:07.894588 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f2429-8afc-4ae3-8319-f3892c76f624 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.904743 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760966c-006c-41c1-8de2-14330a418abb admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:07.917596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56881944-5a62-4ca7-9745-1cb3a00b64a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:07.918343 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56881944-5a62-4ca7-9745-1cb3a00b64a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.918679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56881944-5a62-4ca7-9745-1cb3a00b64a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.918890 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56881944-5a62-4ca7-9745-1cb3a00b64a2 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.919611 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56881944-5a62-4ca7-9745-1cb3a00b64a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:07.921617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56881944-5a62-4ca7-9745-1cb3a00b64a2 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.927320 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 935/1857] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:07 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:07.928158 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f2429-8afc-4ae3-8319-f3892c76f624 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.929779 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-627f2429-8afc-4ae3-8319-f3892c76f624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:07.949399 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 923/1858] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:07 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:07.950173 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56881944-5a62-4ca7-9745-1cb3a00b64a2 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.961058 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56881944-5a62-4ca7-9745-1cb3a00b64a2 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.009492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f2429-8afc-4ae3-8319-f3892c76f624 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.014460 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d2e81-ebe1-49e8-a6cc-56eae09a6515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.015395 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d2e81-ebe1-49e8-a6cc-56eae09a6515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.015674 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d2e81-ebe1-49e8-a6cc-56eae09a6515 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.015947 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d2e81-ebe1-49e8-a6cc-56eae09a6515 admin admin] PATH_INFO: `/v3/projects/39b83a7be01e498089c5e92661766edd` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.017213 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d2e81-ebe1-49e8-a6cc-56eae09a6515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b83a7be01e498089c5e92661766edd)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.017528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34395cbf-d985-45dc-a402-515595af3700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.018212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34395cbf-d985-45dc-a402-515595af3700 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.018494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34395cbf-d985-45dc-a402-515595af3700 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.018773 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34395cbf-d985-45dc-a402-515595af3700 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.019180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d2e81-ebe1-49e8-a6cc-56eae09a6515 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.019492 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34395cbf-d985-45dc-a402-515595af3700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.021799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34395cbf-d985-45dc-a402-515595af3700 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.044008 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 924/1859] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:07 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:08.045107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34395cbf-d985-45dc-a402-515595af3700 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.056356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34395cbf-d985-45dc-a402-515595af3700 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.061303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccfbbe-1129-45bb-aba0-ec6aa40cd3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.061988 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccfbbe-1129-45bb-aba0-ec6aa40cd3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.062253 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccfbbe-1129-45bb-aba0-ec6aa40cd3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.062754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccfbbe-1129-45bb-aba0-ec6aa40cd3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.063489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccfbbe-1129-45bb-aba0-ec6aa40cd3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.065233 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccfbbe-1129-45bb-aba0-ec6aa40cd3f9 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.072425 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-926d2e81-ebe1-49e8-a6cc-56eae09a6515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b83a7be01e498089c5e92661766edd', 'request_id': 'req-926d2e81-ebe1-49e8-a6cc-56eae09a6515'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.076509 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 925/1860] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:08.077714 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccfbbe-1129-45bb-aba0-ec6aa40cd3f9 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.084417 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-926d2e81-ebe1-49e8-a6cc-56eae09a6515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b83a7be01e498089c5e92661766edd', 'request_id': 'req-926d2e81-ebe1-49e8-a6cc-56eae09a6515'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.089429 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccfbbe-1129-45bb-aba0-ec6aa40cd3f9 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.095814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-926d2e81-ebe1-49e8-a6cc-56eae09a6515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b83a7be01e498089c5e92661766edd', 'request_id': 'req-926d2e81-ebe1-49e8-a6cc-56eae09a6515'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.107727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-926d2e81-ebe1-49e8-a6cc-56eae09a6515 admin admin] The token cache is being invalidate because project 39b83a7be01e498089c5e92661766edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:08.108369 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-926d2e81-ebe1-49e8-a6cc-56eae09a6515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.109117 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-926d2e81-ebe1-49e8-a6cc-56eae09a6515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.111246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 936/1861] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:07 2022] DELETE /identity/v3/projects/39b83a7be01e498089c5e92661766edd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:08.112276 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d2e81-ebe1-49e8-a6cc-56eae09a6515 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.113696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-926d2e81-ebe1-49e8-a6cc-56eae09a6515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:08.153751 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ec638-504a-4a96-8e0f-8fd2005a0d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.154440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ec638-504a-4a96-8e0f-8fd2005a0d1a admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.154722 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ec638-504a-4a96-8e0f-8fd2005a0d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.154995 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ec638-504a-4a96-8e0f-8fd2005a0d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.155740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ec638-504a-4a96-8e0f-8fd2005a0d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.157429 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ec638-504a-4a96-8e0f-8fd2005a0d1a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.171752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 926/1862] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:08.171752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250208bd-3909-46c3-b51a-b7a69b17bed5 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.171752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250208bd-3909-46c3-b51a-b7a69b17bed5 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.171752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250208bd-3909-46c3-b51a-b7a69b17bed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.179103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d2e81-ebe1-49e8-a6cc-56eae09a6515 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.183838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efddf6b-4020-4f61-84a2-f3879d619428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.184555 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efddf6b-4020-4f61-84a2-f3879d619428 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.184836 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efddf6b-4020-4f61-84a2-f3879d619428 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.185110 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efddf6b-4020-4f61-84a2-f3879d619428 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.185854 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efddf6b-4020-4f61-84a2-f3879d619428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.187489 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efddf6b-4020-4f61-84a2-f3879d619428 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.189379 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-250208bd-3909-46c3-b51a-b7a69b17bed5 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:08.190580 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-250208bd-3909-46c3-b51a-b7a69b17bed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:08.198938 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 937/1863] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:08.199581 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efddf6b-4020-4f61-84a2-f3879d619428 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.201912 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0efddf6b-4020-4f61-84a2-f3879d619428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:08.202400 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 927/1864] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:08.203200 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250208bd-3909-46c3-b51a-b7a69b17bed5 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.213841 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250208bd-3909-46c3-b51a-b7a69b17bed5 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.218710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d73690-57ad-45b3-ad9b-fe7e04fe0491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.219805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d73690-57ad-45b3-ad9b-fe7e04fe0491 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.220292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d73690-57ad-45b3-ad9b-fe7e04fe0491 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.220598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d73690-57ad-45b3-ad9b-fe7e04fe0491 admin admin] PATH_INFO: `/v3/projects/be4c1f640f0b4073ab3a0b6b7a25cf3c/users/134c1b43c3394f2d9a08a56ea9fc7119/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.222621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efddf6b-4020-4f61-84a2-f3879d619428 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.227430 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0ec70-26e3-4a6f-b8cb-43fb815b280c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.228404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0ec70-26e3-4a6f-b8cb-43fb815b280c admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.228696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0ec70-26e3-4a6f-b8cb-43fb815b280c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.228971 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0ec70-26e3-4a6f-b8cb-43fb815b280c admin admin] PATH_INFO: `/v3/projects/317bb8ab5576495797662b6349d2f3c5/users/8299c9a39fc849528d066c48d1e45043/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.238484 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d73690-57ad-45b3-ad9b-fe7e04fe0491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4c1f640f0b4073ab3a0b6b7a25cf3c, user_id=134c1b43c3394f2d9a08a56ea9fc7119, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.242578 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d73690-57ad-45b3-ad9b-fe7e04fe0491 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.248685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0ec70-26e3-4a6f-b8cb-43fb815b280c admin admin] RBAC: Authorizing `identity:create_grant(project_id=317bb8ab5576495797662b6349d2f3c5, user_id=8299c9a39fc849528d066c48d1e45043, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.251834 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0ec70-26e3-4a6f-b8cb-43fb815b280c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.268378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 928/1865] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:08 2022] PUT /identity/v3/projects/be4c1f640f0b4073ab3a0b6b7a25cf3c/users/134c1b43c3394f2d9a08a56ea9fc7119/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:08.270467 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc2323-aaab-4725-a596-aab90f655973 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.270892 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc2323-aaab-4725-a596-aab90f655973 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.271178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc2323-aaab-4725-a596-aab90f655973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.287409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 938/1866] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:08 2022] PUT /identity/v3/projects/317bb8ab5576495797662b6349d2f3c5/users/8299c9a39fc849528d066c48d1e45043/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:08.291046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85267092-dc05-4821-8dc7-c19a750c8224 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.291355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85267092-dc05-4821-8dc7-c19a750c8224 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.291791 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85267092-dc05-4821-8dc7-c19a750c8224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.318557 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-2cfc2323-aaab-4725-a596-aab90f655973 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:08.321114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-2cfc2323-aaab-4725-a596-aab90f655973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:08.322257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-85267092-dc05-4821-8dc7-c19a750c8224 None None] MFA Rules not processed for user `134c1b43c3394f2d9a08a56ea9fc7119`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:08.325164 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-85267092-dc05-4821-8dc7-c19a750c8224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:08.395405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 939/1867] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:08.397660 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85267092-dc05-4821-8dc7-c19a750c8224 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.402648 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 929/1868] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:08.403911 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc2323-aaab-4725-a596-aab90f655973 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.411581 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85267092-dc05-4821-8dc7-c19a750c8224 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.413515 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc2323-aaab-4725-a596-aab90f655973 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.418440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea115503-e67a-400e-b2f7-3905864f41a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.418599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b06a0e-e24d-4dc1-be7a-cdf04734176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.419270 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115503-e67a-400e-b2f7-3905864f41a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.419384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b06a0e-e24d-4dc1-be7a-cdf04734176b admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.419971 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115503-e67a-400e-b2f7-3905864f41a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.420104 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b06a0e-e24d-4dc1-be7a-cdf04734176b admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.420193 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115503-e67a-400e-b2f7-3905864f41a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.420328 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b06a0e-e24d-4dc1-be7a-cdf04734176b admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.420960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea115503-e67a-400e-b2f7-3905864f41a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.421067 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b06a0e-e24d-4dc1-be7a-cdf04734176b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.423156 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b06a0e-e24d-4dc1-be7a-cdf04734176b admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.423377 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea115503-e67a-400e-b2f7-3905864f41a2 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.435323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 940/1869] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:08.436557 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea115503-e67a-400e-b2f7-3905864f41a2 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.447468 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea115503-e67a-400e-b2f7-3905864f41a2 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.455316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950d55d-59da-4d9a-a33f-622e4b3141c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.455316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d55d-59da-4d9a-a33f-622e4b3141c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.455316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d55d-59da-4d9a-a33f-622e4b3141c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.455316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d55d-59da-4d9a-a33f-622e4b3141c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.456119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950d55d-59da-4d9a-a33f-622e4b3141c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:08.456584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950d55d-59da-4d9a-a33f-622e4b3141c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.458318 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950d55d-59da-4d9a-a33f-622e4b3141c3 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.468861 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 930/1870] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:08 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:08.469768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b06a0e-e24d-4dc1-be7a-cdf04734176b admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.478218 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 941/1871] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:08.479075 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950d55d-59da-4d9a-a33f-622e4b3141c3 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.493565 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950d55d-59da-4d9a-a33f-622e4b3141c3 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.579971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b06a0e-e24d-4dc1-be7a-cdf04734176b admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.585047 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d57033-d2de-48b3-a2b7-73dbf5c19e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.586293 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d57033-d2de-48b3-a2b7-73dbf5c19e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.586676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d57033-d2de-48b3-a2b7-73dbf5c19e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.587162 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d57033-d2de-48b3-a2b7-73dbf5c19e90 admin admin] PATH_INFO: `/v3/projects/317bb8ab5576495797662b6349d2f3c5/users/8299c9a39fc849528d066c48d1e45043/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.589828 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d57033-d2de-48b3-a2b7-73dbf5c19e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=317bb8ab5576495797662b6349d2f3c5, user_id=8299c9a39fc849528d066c48d1e45043, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.592660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d57033-d2de-48b3-a2b7-73dbf5c19e90 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.599514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec72330-8f1a-4510-9941-ba1f56979c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.600651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec72330-8f1a-4510-9941-ba1f56979c7d admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.600945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec72330-8f1a-4510-9941-ba1f56979c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.601397 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec72330-8f1a-4510-9941-ba1f56979c7d admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.602127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec72330-8f1a-4510-9941-ba1f56979c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.605550 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec72330-8f1a-4510-9941-ba1f56979c7d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.606093 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 931/1872] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:08 2022] PUT /identity/v3/projects/317bb8ab5576495797662b6349d2f3c5/users/8299c9a39fc849528d066c48d1e45043/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:08.607118 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d57033-d2de-48b3-a2b7-73dbf5c19e90 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.635267 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 942/1873] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:08 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:08.640765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26168981-605d-4ca6-a84b-6d2136f2d3b5 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.641143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26168981-605d-4ca6-a84b-6d2136f2d3b5 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.641491 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26168981-605d-4ca6-a84b-6d2136f2d3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.732065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-26168981-605d-4ca6-a84b-6d2136f2d3b5 None None] MFA Rules not processed for user `8299c9a39fc849528d066c48d1e45043`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:08.733523 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-26168981-605d-4ca6-a84b-6d2136f2d3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:08.758975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d57033-d2de-48b3-a2b7-73dbf5c19e90 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.769521 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f66935-fd0e-4d69-b139-add864cbd9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.770030 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f66935-fd0e-4d69-b139-add864cbd9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.770306 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f66935-fd0e-4d69-b139-add864cbd9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.770572 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f66935-fd0e-4d69-b139-add864cbd9f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.771619 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f66935-fd0e-4d69-b139-add864cbd9f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.774725 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f66935-fd0e-4d69-b139-add864cbd9f2 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.814991 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 932/1874] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:08 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:08.816106 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f66935-fd0e-4d69-b139-add864cbd9f2 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.830928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 943/1875] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:08.832015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26168981-605d-4ca6-a84b-6d2136f2d3b5 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.843614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26168981-605d-4ca6-a84b-6d2136f2d3b5 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.906427 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f66935-fd0e-4d69-b139-add864cbd9f2 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.912087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f2890-bb6c-4d6a-bc15-fdc43c71d0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.913009 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f2890-bb6c-4d6a-bc15-fdc43c71d0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.913301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f2890-bb6c-4d6a-bc15-fdc43c71d0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.913577 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f2890-bb6c-4d6a-bc15-fdc43c71d0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.914384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f2890-bb6c-4d6a-bc15-fdc43c71d0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.916148 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f2890-bb6c-4d6a-bc15-fdc43c71d0b3 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.931185 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 933/1876] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:08.931185 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f2890-bb6c-4d6a-bc15-fdc43c71d0b3 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.932374 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ee6f2890-bb6c-4d6a-bc15-fdc43c71d0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:08.934526 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413a9ed-9d41-4277-afcc-c546dfbe9a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.936007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413a9ed-9d41-4277-afcc-c546dfbe9a53 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.936507 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413a9ed-9d41-4277-afcc-c546dfbe9a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.937100 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413a9ed-9d41-4277-afcc-c546dfbe9a53 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.938265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413a9ed-9d41-4277-afcc-c546dfbe9a53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.940475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413a9ed-9d41-4277-afcc-c546dfbe9a53 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.973802 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 944/1877] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:08 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:08.974956 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413a9ed-9d41-4277-afcc-c546dfbe9a53 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.987003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413a9ed-9d41-4277-afcc-c546dfbe9a53 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.000972 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc2e04-d8cb-4e7f-b745-484b53c30a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.001987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc2e04-d8cb-4e7f-b745-484b53c30a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.002329 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc2e04-d8cb-4e7f-b745-484b53c30a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.002675 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc2e04-d8cb-4e7f-b745-484b53c30a08 admin admin] PATH_INFO: `/v3/projects/ecaccd20ae0f49d3b5a50d801c311779/users/232f104520dc4fb4bc1867cef555140b/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.018884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f2890-bb6c-4d6a-bc15-fdc43c71d0b3 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.023018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc2e04-d8cb-4e7f-b745-484b53c30a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecaccd20ae0f49d3b5a50d801c311779, user_id=232f104520dc4fb4bc1867cef555140b, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.024016 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b94a37-3b75-49fe-bb50-d07707df9681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.025182 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b94a37-3b75-49fe-bb50-d07707df9681 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.025674 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b94a37-3b75-49fe-bb50-d07707df9681 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.026117 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b94a37-3b75-49fe-bb50-d07707df9681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.026625 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc2e04-d8cb-4e7f-b745-484b53c30a08 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.049857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 945/1878] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:08 2022] PUT /identity/v3/projects/ecaccd20ae0f49d3b5a50d801c311779/users/232f104520dc4fb4bc1867cef555140b/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:09.053498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc2e04-d8cb-4e7f-b745-484b53c30a08 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.141889 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b94a37-3b75-49fe-bb50-d07707df9681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.143724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b94a37-3b75-49fe-bb50-d07707df9681 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.173585 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 934/1879] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:09.175754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b94a37-3b75-49fe-bb50-d07707df9681 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.205334 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b94a37-3b75-49fe-bb50-d07707df9681 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.215995 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc2e04-d8cb-4e7f-b745-484b53c30a08 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.220638 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f4212-e28a-4442-a55e-83c964c9a93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.221392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f4212-e28a-4442-a55e-83c964c9a93f admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.221678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f4212-e28a-4442-a55e-83c964c9a93f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.221950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f4212-e28a-4442-a55e-83c964c9a93f admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.235833 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c7385-d98b-4300-bcb6-3802bb4c11cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.236712 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c7385-d98b-4300-bcb6-3802bb4c11cf admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.237848 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f4212-e28a-4442-a55e-83c964c9a93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.238234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c7385-d98b-4300-bcb6-3802bb4c11cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.238609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c7385-d98b-4300-bcb6-3802bb4c11cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.239615 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c7385-d98b-4300-bcb6-3802bb4c11cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.239959 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f4212-e28a-4442-a55e-83c964c9a93f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.242870 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c7385-d98b-4300-bcb6-3802bb4c11cf admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.262250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 935/1880] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:09.267919 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f4212-e28a-4442-a55e-83c964c9a93f admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.273398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 946/1881] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:09.274722 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c7385-d98b-4300-bcb6-3802bb4c11cf admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.280793 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f4212-e28a-4442-a55e-83c964c9a93f admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.287968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de49b97-8036-4bcb-9a49-7d368b69a795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.288874 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c7385-d98b-4300-bcb6-3802bb4c11cf admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.289009 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de49b97-8036-4bcb-9a49-7d368b69a795 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.289268 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de49b97-8036-4bcb-9a49-7d368b69a795 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.289580 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de49b97-8036-4bcb-9a49-7d368b69a795 admin admin] PATH_INFO: `/v3/projects/ecaccd20ae0f49d3b5a50d801c311779/users/232f104520dc4fb4bc1867cef555140b/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.291710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de49b97-8036-4bcb-9a49-7d368b69a795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecaccd20ae0f49d3b5a50d801c311779, user_id=232f104520dc4fb4bc1867cef555140b, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.294428 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de49b97-8036-4bcb-9a49-7d368b69a795 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.295261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22eb90f-f18a-4e27-b07f-b0d267d6ba37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.296299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eb90f-f18a-4e27-b07f-b0d267d6ba37 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.296482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eb90f-f18a-4e27-b07f-b0d267d6ba37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.296885 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eb90f-f18a-4e27-b07f-b0d267d6ba37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.298593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22eb90f-f18a-4e27-b07f-b0d267d6ba37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.307466 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22eb90f-f18a-4e27-b07f-b0d267d6ba37 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.308400 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 936/1882] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:09 2022] PUT /identity/v3/projects/ecaccd20ae0f49d3b5a50d801c311779/users/232f104520dc4fb4bc1867cef555140b/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:09.326208 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc7b0a-fc60-4992-a581-9569addb23b2 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.327580 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc7b0a-fc60-4992-a581-9569addb23b2 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.330343 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc7b0a-fc60-4992-a581-9569addb23b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.331955 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 947/1883] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:09.337044 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22eb90f-f18a-4e27-b07f-b0d267d6ba37 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.352024 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22eb90f-f18a-4e27-b07f-b0d267d6ba37 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.390845 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-7dcc7b0a-fc60-4992-a581-9569addb23b2 None None] MFA Rules not processed for user `232f104520dc4fb4bc1867cef555140b`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:09.392069 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7dcc7b0a-fc60-4992-a581-9569addb23b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:09.432036 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b90e4-9b64-45fb-86e7-648f4a169f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.433519 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b90e4-9b64-45fb-86e7-648f4a169f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.434274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b90e4-9b64-45fb-86e7-648f4a169f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.434274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b90e4-9b64-45fb-86e7-648f4a169f21 admin admin] PATH_INFO: `/v3/projects/e3434bd8b17945659174229fc861bc29/users/2a2b78b185624c21a18d9d55c42371c5/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.456140 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b90e4-9b64-45fb-86e7-648f4a169f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3434bd8b17945659174229fc861bc29, user_id=2a2b78b185624c21a18d9d55c42371c5, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.458869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b90e4-9b64-45fb-86e7-648f4a169f21 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.494369 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 948/1884] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:09 2022] PUT /identity/v3/projects/e3434bd8b17945659174229fc861bc29/users/2a2b78b185624c21a18d9d55c42371c5/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:09.496766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 937/1885] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:09.512669 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc7b0a-fc60-4992-a581-9569addb23b2 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.513111 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ad0f4-6e8e-488c-b94d-259a7218362e None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.513266 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ad0f4-6e8e-488c-b94d-259a7218362e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.513583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ad0f4-6e8e-488c-b94d-259a7218362e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.545242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-5c6ad0f4-6e8e-488c-b94d-259a7218362e None None] MFA Rules not processed for user `2a2b78b185624c21a18d9d55c42371c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:09.546454 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5c6ad0f4-6e8e-488c-b94d-259a7218362e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:09.577988 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc7b0a-fc60-4992-a581-9569addb23b2 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.623982 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 949/1886] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:09.633682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ad0f4-6e8e-488c-b94d-259a7218362e None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.641066 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e6949-dfc3-4d91-9432-858542711cf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.642209 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e6949-dfc3-4d91-9432-858542711cf9 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.642477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e6949-dfc3-4d91-9432-858542711cf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.642845 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e6949-dfc3-4d91-9432-858542711cf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.645180 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-898e6949-dfc3-4d91-9432-858542711cf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:09.715053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ad0f4-6e8e-488c-b94d-259a7218362e None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.727203 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3dc8c-385f-4fe3-ac9e-c282cab06fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.728773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3dc8c-385f-4fe3-ac9e-c282cab06fac admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.729345 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3dc8c-385f-4fe3-ac9e-c282cab06fac admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.729449 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e6949-dfc3-4d91-9432-858542711cf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.729790 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3dc8c-385f-4fe3-ac9e-c282cab06fac admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.730619 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3dc8c-385f-4fe3-ac9e-c282cab06fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.731236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e6949-dfc3-4d91-9432-858542711cf9 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.732958 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3dc8c-385f-4fe3-ac9e-c282cab06fac admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.746276 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 938/1887] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:53:09.747157 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e6949-dfc3-4d91-9432-858542711cf9 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.773138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 950/1888] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:09 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:09.776685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3dc8c-385f-4fe3-ac9e-c282cab06fac admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.849009 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e6949-dfc3-4d91-9432-858542711cf9 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.866400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3dc8c-385f-4fe3-ac9e-c282cab06fac admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.872919 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a280136-ce63-4bd3-ab5b-68b144a69f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.874085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a280136-ce63-4bd3-ab5b-68b144a69f59 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.874457 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a280136-ce63-4bd3-ab5b-68b144a69f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.874731 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a280136-ce63-4bd3-ab5b-68b144a69f59 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.875846 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a280136-ce63-4bd3-ab5b-68b144a69f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.878125 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a280136-ce63-4bd3-ab5b-68b144a69f59 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.910920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 951/1889] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:09 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:09.914997 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a280136-ce63-4bd3-ab5b-68b144a69f59 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.928255 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a280136-ce63-4bd3-ab5b-68b144a69f59 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.928431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b73f2b-b691-4085-a053-08f95919d421 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8299c9a39fc849528d066c48d1e45043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317bb8ab5576495797662b6349d2f3c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.928858 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b73f2b-b691-4085-a053-08f95919d421 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.932280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b73f2b-b691-4085-a053-08f95919d421 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.932280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b73f2b-b691-4085-a053-08f95919d421 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.932280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b73f2b-b691-4085-a053-08f95919d421 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:09.932280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b73f2b-b691-4085-a053-08f95919d421 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.933329 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b73f2b-b691-4085-a053-08f95919d421 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.935019 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9992057-e633-42fc-8831-d179643bf492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.935019 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9992057-e633-42fc-8831-d179643bf492 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.935209 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9992057-e633-42fc-8831-d179643bf492 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.935541 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9992057-e633-42fc-8831-d179643bf492 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.936358 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9992057-e633-42fc-8831-d179643bf492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.938028 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9992057-e633-42fc-8831-d179643bf492 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.947087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 939/1890] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:09.951530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 952/1891] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:09.951653 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b73f2b-b691-4085-a053-08f95919d421 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.952669 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9992057-e633-42fc-8831-d179643bf492 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.961978 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b73f2b-b691-4085-a053-08f95919d421 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.962844 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9992057-e633-42fc-8831-d179643bf492 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.966953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789620a-c997-4274-a0a1-c12029fc7819 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8299c9a39fc849528d066c48d1e45043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317bb8ab5576495797662b6349d2f3c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.967632 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789620a-c997-4274-a0a1-c12029fc7819 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.967819 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58395dba-2f1b-4455-bba7-434ff5235761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.967945 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789620a-c997-4274-a0a1-c12029fc7819 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.968180 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789620a-c997-4274-a0a1-c12029fc7819 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.968547 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58395dba-2f1b-4455-bba7-434ff5235761 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.968828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58395dba-2f1b-4455-bba7-434ff5235761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.968971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789620a-c997-4274-a0a1-c12029fc7819 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.969077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58395dba-2f1b-4455-bba7-434ff5235761 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.969857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58395dba-2f1b-4455-bba7-434ff5235761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.970903 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789620a-c997-4274-a0a1-c12029fc7819 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.971479 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58395dba-2f1b-4455-bba7-434ff5235761 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.983127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 953/1892] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:09.986820 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58395dba-2f1b-4455-bba7-434ff5235761 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.996954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58395dba-2f1b-4455-bba7-434ff5235761 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.002147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9062c7-cdf8-4cb6-8956-a3c1359eee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.002996 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9062c7-cdf8-4cb6-8956-a3c1359eee42 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.003275 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9062c7-cdf8-4cb6-8956-a3c1359eee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.003548 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9062c7-cdf8-4cb6-8956-a3c1359eee42 admin admin] PATH_INFO: `/v3/projects/30778990585b40d78b93d4c91509c514/users/7aaa4e29f2e4491da6a2fe5fce804e1a/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.006841 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 940/1893] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:09 2022] POST /identity/v3/projects => generated 355 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:10.007732 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789620a-c997-4274-a0a1-c12029fc7819 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.022343 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9062c7-cdf8-4cb6-8956-a3c1359eee42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30778990585b40d78b93d4c91509c514, user_id=7aaa4e29f2e4491da6a2fe5fce804e1a, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.025177 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9062c7-cdf8-4cb6-8956-a3c1359eee42 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.053735 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 954/1894] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:09 2022] PUT /identity/v3/projects/30778990585b40d78b93d4c91509c514/users/7aaa4e29f2e4491da6a2fe5fce804e1a/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:10.065761 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba0ee1-5442-4e0b-8ef1-748143ed6a56 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.066051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba0ee1-5442-4e0b-8ef1-748143ed6a56 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.066431 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba0ee1-5442-4e0b-8ef1-748143ed6a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.093768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789620a-c997-4274-a0a1-c12029fc7819 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.106350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-c2ba0ee1-5442-4e0b-8ef1-748143ed6a56 None None] MFA Rules not processed for user `7aaa4e29f2e4491da6a2fe5fce804e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:10.107587 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-c2ba0ee1-5442-4e0b-8ef1-748143ed6a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:10.161485 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01372b-126d-4cc1-a11f-5b4c20a49495 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8299c9a39fc849528d066c48d1e45043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317bb8ab5576495797662b6349d2f3c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.162311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01372b-126d-4cc1-a11f-5b4c20a49495 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.162599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01372b-126d-4cc1-a11f-5b4c20a49495 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.162879 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01372b-126d-4cc1-a11f-5b4c20a49495 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.163724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01372b-126d-4cc1-a11f-5b4c20a49495 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:10.164032 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01372b-126d-4cc1-a11f-5b4c20a49495 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.165761 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01372b-126d-4cc1-a11f-5b4c20a49495 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.181307 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 941/1895] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:10.181955 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 955/1896] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:10.185132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01372b-126d-4cc1-a11f-5b4c20a49495 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.225034 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba0ee1-5442-4e0b-8ef1-748143ed6a56 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.236977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba0ee1-5442-4e0b-8ef1-748143ed6a56 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.241982 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69c535-0d2f-49ec-b3aa-b982433edad2 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8299c9a39fc849528d066c48d1e45043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '317bb8ab5576495797662b6349d2f3c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.242995 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69c535-0d2f-49ec-b3aa-b982433edad2 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.243396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69c535-0d2f-49ec-b3aa-b982433edad2 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.243777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69c535-0d2f-49ec-b3aa-b982433edad2 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] PATH_INFO: `/v3/projects/1f6a2e00ce1345cc92bb38a28412bad9` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.245825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69c535-0d2f-49ec-b3aa-b982433edad2 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1f6a2e00ce1345cc92bb38a28412bad9)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.247684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69c535-0d2f-49ec-b3aa-b982433edad2 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.254894 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01372b-126d-4cc1-a11f-5b4c20a49495 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.260742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cecd87-f9ff-4a33-9fbf-48ed6662bba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.261645 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cecd87-f9ff-4a33-9fbf-48ed6662bba2 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.261993 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cecd87-f9ff-4a33-9fbf-48ed6662bba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.262434 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cecd87-f9ff-4a33-9fbf-48ed6662bba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.263224 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cecd87-f9ff-4a33-9fbf-48ed6662bba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.266050 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cecd87-f9ff-4a33-9fbf-48ed6662bba2 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.303689 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 942/1897] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:10 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:10.306078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5b69c535-0d2f-49ec-b3aa-b982433edad2 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6a2e00ce1345cc92bb38a28412bad9', 'request_id': 'req-5b69c535-0d2f-49ec-b3aa-b982433edad2'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:10.309390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cecd87-f9ff-4a33-9fbf-48ed6662bba2 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.329119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5b69c535-0d2f-49ec-b3aa-b982433edad2 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6a2e00ce1345cc92bb38a28412bad9', 'request_id': 'req-5b69c535-0d2f-49ec-b3aa-b982433edad2'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:10.340620 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5b69c535-0d2f-49ec-b3aa-b982433edad2 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6a2e00ce1345cc92bb38a28412bad9', 'request_id': 'req-5b69c535-0d2f-49ec-b3aa-b982433edad2'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:10.355410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5b69c535-0d2f-49ec-b3aa-b982433edad2 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] The token cache is being invalidate because project 1f6a2e00ce1345cc92bb38a28412bad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:10.355967 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5b69c535-0d2f-49ec-b3aa-b982433edad2 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:10.358053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5b69c535-0d2f-49ec-b3aa-b982433edad2 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:10.360423 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 956/1898] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:10 2022] DELETE /identity/v3/projects/1f6a2e00ce1345cc92bb38a28412bad9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:10.389216 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cecd87-f9ff-4a33-9fbf-48ed6662bba2 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.395190 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efe05a-fee7-41c8-baa8-3e151cc473e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.395964 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efe05a-fee7-41c8-baa8-3e151cc473e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.396750 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efe05a-fee7-41c8-baa8-3e151cc473e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.397095 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efe05a-fee7-41c8-baa8-3e151cc473e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.397887 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efe05a-fee7-41c8-baa8-3e151cc473e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.400290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efe05a-fee7-41c8-baa8-3e151cc473e2 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.426064 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 943/1899] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:10 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:10.427549 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69c535-0d2f-49ec-b3aa-b982433edad2 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.429134 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5b69c535-0d2f-49ec-b3aa-b982433edad2 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:10.502290 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69c535-0d2f-49ec-b3aa-b982433edad2 tempest-VolumeQuotaClassesTest-785126067 tempest-VolumeQuotaClassesTest-785126067-project-admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.507746 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1bce3-e4b4-4386-972d-a757135d92aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.508982 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1bce3-e4b4-4386-972d-a757135d92aa admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.509396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1bce3-e4b4-4386-972d-a757135d92aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.509850 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1bce3-e4b4-4386-972d-a757135d92aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.510664 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1bce3-e4b4-4386-972d-a757135d92aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.512588 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1bce3-e4b4-4386-972d-a757135d92aa admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.525474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 957/1900] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:10.530611 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efe05a-fee7-41c8-baa8-3e151cc473e2 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.541452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efe05a-fee7-41c8-baa8-3e151cc473e2 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.546386 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20374c-f8af-4b02-ae7e-ed69dab30bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.547383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20374c-f8af-4b02-ae7e-ed69dab30bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.548337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20374c-f8af-4b02-ae7e-ed69dab30bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.548337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20374c-f8af-4b02-ae7e-ed69dab30bf3 admin admin] PATH_INFO: `/v3/projects/4d108b2e745a4998972e6127e09b31f2/users/d9f8931fda3148928b132a51bc05d052/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.569867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20374c-f8af-4b02-ae7e-ed69dab30bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d108b2e745a4998972e6127e09b31f2, user_id=d9f8931fda3148928b132a51bc05d052, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.572590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20374c-f8af-4b02-ae7e-ed69dab30bf3 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.582067 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1bce3-e4b4-4386-972d-a757135d92aa admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.583902 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-cad1bce3-e4b4-4386-972d-a757135d92aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:10.588135 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 944/1901] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:10 2022] PUT /identity/v3/projects/4d108b2e745a4998972e6127e09b31f2/users/d9f8931fda3148928b132a51bc05d052/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:10.592110 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20374c-f8af-4b02-ae7e-ed69dab30bf3 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.600488 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1bce3-e4b4-4386-972d-a757135d92aa admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.666170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20374c-f8af-4b02-ae7e-ed69dab30bf3 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.667666 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b82f04-18d1-4360-8bfd-569e8ad74511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.668594 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b82f04-18d1-4360-8bfd-569e8ad74511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.668871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b82f04-18d1-4360-8bfd-569e8ad74511 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.669138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b82f04-18d1-4360-8bfd-569e8ad74511 admin admin] PATH_INFO: `/v3/users/7ea574ff84fa46c99fbf77e44aa3aca7` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.670030 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf542406-935e-4b33-a371-9ccf60337716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.670332 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b82f04-18d1-4360-8bfd-569e8ad74511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea574ff84fa46c99fbf77e44aa3aca7)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.670743 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf542406-935e-4b33-a371-9ccf60337716 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.671117 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf542406-935e-4b33-a371-9ccf60337716 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.671417 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf542406-935e-4b33-a371-9ccf60337716 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.672292 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b82f04-18d1-4360-8bfd-569e8ad74511 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.672394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf542406-935e-4b33-a371-9ccf60337716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.674087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf542406-935e-4b33-a371-9ccf60337716 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.684779 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 945/1902] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:10.689142 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf542406-935e-4b33-a371-9ccf60337716 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.699603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf542406-935e-4b33-a371-9ccf60337716 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.704479 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfee41-cff9-48a1-bc2f-e4454998ee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.705590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfee41-cff9-48a1-bc2f-e4454998ee49 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.705737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfee41-cff9-48a1-bc2f-e4454998ee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.706019 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfee41-cff9-48a1-bc2f-e4454998ee49 admin admin] PATH_INFO: `/v3/projects/4d108b2e745a4998972e6127e09b31f2/users/d9f8931fda3148928b132a51bc05d052/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.708195 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfee41-cff9-48a1-bc2f-e4454998ee49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d108b2e745a4998972e6127e09b31f2, user_id=d9f8931fda3148928b132a51bc05d052, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.712349 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfee41-cff9-48a1-bc2f-e4454998ee49 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.723544 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 946/1903] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:10 2022] PUT /identity/v3/projects/4d108b2e745a4998972e6127e09b31f2/users/d9f8931fda3148928b132a51bc05d052/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:10.723694 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-84b82f04-18d1-4360-8bfd-569e8ad74511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea574ff84fa46c99fbf77e44aa3aca7'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:10.724224 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-84b82f04-18d1-4360-8bfd-569e8ad74511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea574ff84fa46c99fbf77e44aa3aca7'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:10.734923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a5d63-6b3d-4ea7-8ce6-473aa03d7e73 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.735217 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a5d63-6b3d-4ea7-8ce6-473aa03d7e73 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.735502 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a5d63-6b3d-4ea7-8ce6-473aa03d7e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.736839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-84b82f04-18d1-4360-8bfd-569e8ad74511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea574ff84fa46c99fbf77e44aa3aca7'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:10.737491 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-84b82f04-18d1-4360-8bfd-569e8ad74511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea574ff84fa46c99fbf77e44aa3aca7'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:10.746773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-84b82f04-18d1-4360-8bfd-569e8ad74511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea574ff84fa46c99fbf77e44aa3aca7'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:10.759488 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 958/1904] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:10 2022] DELETE /identity/v3/users/7ea574ff84fa46c99fbf77e44aa3aca7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:10.763714 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-427a5d63-6b3d-4ea7-8ce6-473aa03d7e73 None None] MFA Rules not processed for user `d9f8931fda3148928b132a51bc05d052`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:10.764183 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39735bb0-77ce-424a-bbbe-a5254b74f82d None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.764622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39735bb0-77ce-424a-bbbe-a5254b74f82d None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.764950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-427a5d63-6b3d-4ea7-8ce6-473aa03d7e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:10.765064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39735bb0-77ce-424a-bbbe-a5254b74f82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.783625 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-39735bb0-77ce-424a-bbbe-a5254b74f82d None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:10.785124 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-39735bb0-77ce-424a-bbbe-a5254b74f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:10.839891 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 947/1905] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:10.851504 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a5d63-6b3d-4ea7-8ce6-473aa03d7e73 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.852348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 959/1906] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:10.852870 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-427a5d63-6b3d-4ea7-8ce6-473aa03d7e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:10.862269 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39735bb0-77ce-424a-bbbe-a5254b74f82d None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.863706 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-39735bb0-77ce-424a-bbbe-a5254b74f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:10.908697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a5d63-6b3d-4ea7-8ce6-473aa03d7e73 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.912343 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f73fc-8adc-4915-940f-2f3ab58cec03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.913016 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f73fc-8adc-4915-940f-2f3ab58cec03 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.913295 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f73fc-8adc-4915-940f-2f3ab58cec03 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.913569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f73fc-8adc-4915-940f-2f3ab58cec03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.915535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ce8f73fc-8adc-4915-940f-2f3ab58cec03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:10.919925 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39735bb0-77ce-424a-bbbe-a5254b74f82d None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.923826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976e110-7b7d-4044-9622-0634066bc9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.924505 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976e110-7b7d-4044-9622-0634066bc9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.924786 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976e110-7b7d-4044-9622-0634066bc9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.925058 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976e110-7b7d-4044-9622-0634066bc9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.934490 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976e110-7b7d-4044-9622-0634066bc9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.935941 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976e110-7b7d-4044-9622-0634066bc9d8 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.946389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 960/1907] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:53:10.978339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f73fc-8adc-4915-940f-2f3ab58cec03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.979929 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f73fc-8adc-4915-940f-2f3ab58cec03 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.989534 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 948/1908] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:53:11.318911 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976e110-7b7d-4044-9622-0634066bc9d8 service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:11.320795 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8976e110-7b7d-4044-9622-0634066bc9d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:11.344112 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976e110-7b7d-4044-9622-0634066bc9d8 service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:11.357824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccd83c-0be8-4e27-90d1-fc1912964eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:11.358743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccd83c-0be8-4e27-90d1-fc1912964eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:11.359016 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccd83c-0be8-4e27-90d1-fc1912964eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:11.359222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccd83c-0be8-4e27-90d1-fc1912964eb4 admin admin] PATH_INFO: `/v3/projects/4efbfab0840f43f98cae3b644d043843` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:11.360631 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccd83c-0be8-4e27-90d1-fc1912964eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4efbfab0840f43f98cae3b644d043843)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:11.362578 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccd83c-0be8-4e27-90d1-fc1912964eb4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:11.410333 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-53ccd83c-0be8-4e27-90d1-fc1912964eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4efbfab0840f43f98cae3b644d043843', 'request_id': 'req-53ccd83c-0be8-4e27-90d1-fc1912964eb4'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:11.418533 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-53ccd83c-0be8-4e27-90d1-fc1912964eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4efbfab0840f43f98cae3b644d043843', 'request_id': 'req-53ccd83c-0be8-4e27-90d1-fc1912964eb4'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:11.425112 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-53ccd83c-0be8-4e27-90d1-fc1912964eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4efbfab0840f43f98cae3b644d043843', 'request_id': 'req-53ccd83c-0be8-4e27-90d1-fc1912964eb4'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:11.436439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-53ccd83c-0be8-4e27-90d1-fc1912964eb4 admin admin] The token cache is being invalidate because project 4efbfab0840f43f98cae3b644d043843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:11.436838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-53ccd83c-0be8-4e27-90d1-fc1912964eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:11.437486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-53ccd83c-0be8-4e27-90d1-fc1912964eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:11.439036 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 961/1909] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:11 2022] DELETE /identity/v3/projects/4efbfab0840f43f98cae3b644d043843 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:11.443107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f73fc-8adc-4915-940f-2f3ab58cec03 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:11.454629 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f73fc-8adc-4915-940f-2f3ab58cec03 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:11.526003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0393be-8d15-4f3c-bac4-5d5e218c6fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:11.527120 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0393be-8d15-4f3c-bac4-5d5e218c6fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:11.527498 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0393be-8d15-4f3c-bac4-5d5e218c6fec admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:11.527872 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0393be-8d15-4f3c-bac4-5d5e218c6fec admin admin] PATH_INFO: `/v3/users/8299c9a39fc849528d066c48d1e45043` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:11.529592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0393be-8d15-4f3c-bac4-5d5e218c6fec admin admin] RBAC: Authorizing `identity:delete_user(user_id=8299c9a39fc849528d066c48d1e45043)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:11.531916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0393be-8d15-4f3c-bac4-5d5e218c6fec admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:11.578623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-de0393be-8d15-4f3c-bac4-5d5e218c6fec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8299c9a39fc849528d066c48d1e45043'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:11.579198 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-de0393be-8d15-4f3c-bac4-5d5e218c6fec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8299c9a39fc849528d066c48d1e45043'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:11.590745 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-de0393be-8d15-4f3c-bac4-5d5e218c6fec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8299c9a39fc849528d066c48d1e45043'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:11.591411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-de0393be-8d15-4f3c-bac4-5d5e218c6fec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8299c9a39fc849528d066c48d1e45043'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:11.600730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-de0393be-8d15-4f3c-bac4-5d5e218c6fec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8299c9a39fc849528d066c48d1e45043'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:11.613363 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 949/1910] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:11 2022] DELETE /identity/v3/users/8299c9a39fc849528d066c48d1e45043 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:11.890755 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccd83c-0be8-4e27-90d1-fc1912964eb4 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:11.892176 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-53ccd83c-0be8-4e27-90d1-fc1912964eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:11.908068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccd83c-0be8-4e27-90d1-fc1912964eb4 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:11.975715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90f993-f5ca-4c7d-bd7a-6bb354c71a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:11.976896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90f993-f5ca-4c7d-bd7a-6bb354c71a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:11.977259 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90f993-f5ca-4c7d-bd7a-6bb354c71a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:11.977615 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90f993-f5ca-4c7d-bd7a-6bb354c71a35 admin admin] PATH_INFO: `/v3/projects/317bb8ab5576495797662b6349d2f3c5` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:11.979228 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90f993-f5ca-4c7d-bd7a-6bb354c71a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=317bb8ab5576495797662b6349d2f3c5)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:11.981350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90f993-f5ca-4c7d-bd7a-6bb354c71a35 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.029588 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ca90f993-f5ca-4c7d-bd7a-6bb354c71a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '317bb8ab5576495797662b6349d2f3c5', 'request_id': 'req-ca90f993-f5ca-4c7d-bd7a-6bb354c71a35'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:12.040109 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ca90f993-f5ca-4c7d-bd7a-6bb354c71a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '317bb8ab5576495797662b6349d2f3c5', 'request_id': 'req-ca90f993-f5ca-4c7d-bd7a-6bb354c71a35'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:12.046518 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ca90f993-f5ca-4c7d-bd7a-6bb354c71a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '317bb8ab5576495797662b6349d2f3c5', 'request_id': 'req-ca90f993-f5ca-4c7d-bd7a-6bb354c71a35'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:12.056934 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ca90f993-f5ca-4c7d-bd7a-6bb354c71a35 admin admin] The token cache is being invalidate because project 317bb8ab5576495797662b6349d2f3c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:12.057215 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ca90f993-f5ca-4c7d-bd7a-6bb354c71a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:12.058004 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ca90f993-f5ca-4c7d-bd7a-6bb354c71a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:12.059532 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 962/1911] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:11 2022] DELETE /identity/v3/projects/317bb8ab5576495797662b6349d2f3c5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:12.065494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b13d48-31f9-43e1-9e0e-7dc40ea29554 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.065844 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b13d48-31f9-43e1-9e0e-7dc40ea29554 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.066168 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b13d48-31f9-43e1-9e0e-7dc40ea29554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.086315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-c5b13d48-31f9-43e1-9e0e-7dc40ea29554 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:12.087416 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c5b13d48-31f9-43e1-9e0e-7dc40ea29554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:12.149034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 950/1912] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:12.157303 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502efafa-6f88-4971-bb26-6e5a6c44c4db None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.157683 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502efafa-6f88-4971-bb26-6e5a6c44c4db None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.157963 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502efafa-6f88-4971-bb26-6e5a6c44c4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.179279 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-502efafa-6f88-4971-bb26-6e5a6c44c4db None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:12.180667 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-502efafa-6f88-4971-bb26-6e5a6c44c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:12.190248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 963/1913] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:12.194643 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b13d48-31f9-43e1-9e0e-7dc40ea29554 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.204764 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b13d48-31f9-43e1-9e0e-7dc40ea29554 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:12.209935 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbf222-40d6-4883-a9b5-f8279497c945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:12.210607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbf222-40d6-4883-a9b5-f8279497c945 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.210886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbf222-40d6-4883-a9b5-f8279497c945 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.211159 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbf222-40d6-4883-a9b5-f8279497c945 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.211896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbf222-40d6-4883-a9b5-f8279497c945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:12.212221 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbf222-40d6-4883-a9b5-f8279497c945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.213821 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbf222-40d6-4883-a9b5-f8279497c945 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.225966 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 951/1914] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:12.231044 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502efafa-6f88-4971-bb26-6e5a6c44c4db None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.240762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502efafa-6f88-4971-bb26-6e5a6c44c4db None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:12.246284 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b950455-c294-436d-8ddd-f9a58c8502e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:12.247163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b950455-c294-436d-8ddd-f9a58c8502e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.247418 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b950455-c294-436d-8ddd-f9a58c8502e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.247714 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b950455-c294-436d-8ddd-f9a58c8502e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.248445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b950455-c294-436d-8ddd-f9a58c8502e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.250343 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b950455-c294-436d-8ddd-f9a58c8502e3 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.279382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 964/1915] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:12 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:12.283261 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbf222-40d6-4883-a9b5-f8279497c945 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.293528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbf222-40d6-4883-a9b5-f8279497c945 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:12.356296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749a299-dfe2-431e-ab02-05a7e67f29e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:12.356992 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749a299-dfe2-431e-ab02-05a7e67f29e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.357273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749a299-dfe2-431e-ab02-05a7e67f29e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.357555 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749a299-dfe2-431e-ab02-05a7e67f29e9 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.358316 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749a299-dfe2-431e-ab02-05a7e67f29e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.360237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749a299-dfe2-431e-ab02-05a7e67f29e9 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.382069 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 952/1916] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:12 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:12.386119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b950455-c294-436d-8ddd-f9a58c8502e3 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.397319 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b950455-c294-436d-8ddd-f9a58c8502e3 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:12.402190 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde15dd3-e712-43dd-967c-2d3dd34c05a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:12.402958 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde15dd3-e712-43dd-967c-2d3dd34c05a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.403248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde15dd3-e712-43dd-967c-2d3dd34c05a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.403523 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde15dd3-e712-43dd-967c-2d3dd34c05a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.404300 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde15dd3-e712-43dd-967c-2d3dd34c05a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.405928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde15dd3-e712-43dd-967c-2d3dd34c05a3 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.416573 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 965/1917] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:12.420816 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749a299-dfe2-431e-ab02-05a7e67f29e9 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.431065 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749a299-dfe2-431e-ab02-05a7e67f29e9 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:12.436054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9fe8b-2fd3-4112-9ee9-979a185d5223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:12.436759 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9fe8b-2fd3-4112-9ee9-979a185d5223 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.437039 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9fe8b-2fd3-4112-9ee9-979a185d5223 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.437317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9fe8b-2fd3-4112-9ee9-979a185d5223 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.438044 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9fe8b-2fd3-4112-9ee9-979a185d5223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.439680 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9fe8b-2fd3-4112-9ee9-979a185d5223 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.449949 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 953/1918] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:12.456635 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde15dd3-e712-43dd-967c-2d3dd34c05a3 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.470552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde15dd3-e712-43dd-967c-2d3dd34c05a3 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:12.479177 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc05451-5fc2-4a4a-a28d-601c725d352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:12.480412 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc05451-5fc2-4a4a-a28d-601c725d352f admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.480687 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc05451-5fc2-4a4a-a28d-601c725d352f admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.480956 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc05451-5fc2-4a4a-a28d-601c725d352f admin admin] PATH_INFO: `/v3/projects/1f6f48d16b98469891d5240f5e451071/users/9eef26fa947f4ca39b515ce178bd26fd/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.496025 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc05451-5fc2-4a4a-a28d-601c725d352f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6f48d16b98469891d5240f5e451071, user_id=9eef26fa947f4ca39b515ce178bd26fd, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.498730 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc05451-5fc2-4a4a-a28d-601c725d352f admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.512496 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 966/1919] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:12 2022] PUT /identity/v3/projects/1f6f48d16b98469891d5240f5e451071/users/9eef26fa947f4ca39b515ce178bd26fd/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:12.524321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193be738-0067-4f63-a870-8de2666456f5 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.524663 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193be738-0067-4f63-a870-8de2666456f5 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.524943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193be738-0067-4f63-a870-8de2666456f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.554559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-193be738-0067-4f63-a870-8de2666456f5 None None] MFA Rules not processed for user `9eef26fa947f4ca39b515ce178bd26fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:12.556749 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-193be738-0067-4f63-a870-8de2666456f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:12.625079 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 954/1920] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:12.626377 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc05451-5fc2-4a4a-a28d-601c725d352f admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.702928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc05451-5fc2-4a4a-a28d-601c725d352f admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:12.709571 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc4087-bbf1-4f40-9cca-9144d1e17827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:12.710238 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc4087-bbf1-4f40-9cca-9144d1e17827 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.710517 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc4087-bbf1-4f40-9cca-9144d1e17827 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.710788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc4087-bbf1-4f40-9cca-9144d1e17827 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.711756 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc4087-bbf1-4f40-9cca-9144d1e17827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.713878 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc4087-bbf1-4f40-9cca-9144d1e17827 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.748095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 967/1921] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:12 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:12.749741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193be738-0067-4f63-a870-8de2666456f5 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.763568 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193be738-0067-4f63-a870-8de2666456f5 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:12.823671 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef8011-8c32-4f37-8358-cda44b370d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:12.824455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8011-8c32-4f37-8358-cda44b370d26 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.824737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8011-8c32-4f37-8358-cda44b370d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.825008 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8011-8c32-4f37-8358-cda44b370d26 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.825733 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef8011-8c32-4f37-8358-cda44b370d26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.827749 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef8011-8c32-4f37-8358-cda44b370d26 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.849098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 955/1922] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:12 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:12.853183 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc4087-bbf1-4f40-9cca-9144d1e17827 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.866661 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc4087-bbf1-4f40-9cca-9144d1e17827 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:12.874991 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1ca92-ea8f-408a-b3ee-c299d4951529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:12.875831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ca92-ea8f-408a-b3ee-c299d4951529 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.876108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ca92-ea8f-408a-b3ee-c299d4951529 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.876482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ca92-ea8f-408a-b3ee-c299d4951529 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.877291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1ca92-ea8f-408a-b3ee-c299d4951529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.878997 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1ca92-ea8f-408a-b3ee-c299d4951529 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.893129 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 968/1923] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:12.897811 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef8011-8c32-4f37-8358-cda44b370d26 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.908947 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef8011-8c32-4f37-8358-cda44b370d26 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:12.913755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17e0a6-66f3-4f57-b2b7-e889b00deaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:12.914962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17e0a6-66f3-4f57-b2b7-e889b00deaa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.915318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17e0a6-66f3-4f57-b2b7-e889b00deaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.915653 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17e0a6-66f3-4f57-b2b7-e889b00deaa7 admin admin] PATH_INFO: `/v3/projects/ee1b07c027bb44c7a8510f18c7b04068/users/28b40b405b764435a62506fe6a5bbf67/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.931270 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17e0a6-66f3-4f57-b2b7-e889b00deaa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee1b07c027bb44c7a8510f18c7b04068, user_id=28b40b405b764435a62506fe6a5bbf67, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.934250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17e0a6-66f3-4f57-b2b7-e889b00deaa7 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.951818 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 956/1924] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:12 2022] PUT /identity/v3/projects/ee1b07c027bb44c7a8510f18c7b04068/users/28b40b405b764435a62506fe6a5bbf67/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:12.956242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1ca92-ea8f-408a-b3ee-c299d4951529 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.968592 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1ca92-ea8f-408a-b3ee-c299d4951529 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:13.053215 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d5921-aa4e-42c5-a5a7-d1432e5ac97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:13.054011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d5921-aa4e-42c5-a5a7-d1432e5ac97f admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:13.054529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d5921-aa4e-42c5-a5a7-d1432e5ac97f admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:13.054812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d5921-aa4e-42c5-a5a7-d1432e5ac97f admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:13.056252 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d5921-aa4e-42c5-a5a7-d1432e5ac97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:13.057760 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d5921-aa4e-42c5-a5a7-d1432e5ac97f admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:13.067883 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 969/1925] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:13.072943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17e0a6-66f3-4f57-b2b7-e889b00deaa7 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:13.083426 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17e0a6-66f3-4f57-b2b7-e889b00deaa7 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:13.089010 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e8607-dacc-43fe-97dd-d55c6e7a52d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:13.089938 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e8607-dacc-43fe-97dd-d55c6e7a52d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:13.090218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e8607-dacc-43fe-97dd-d55c6e7a52d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:13.090491 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e8607-dacc-43fe-97dd-d55c6e7a52d8 admin admin] PATH_INFO: `/v3/projects/ee1b07c027bb44c7a8510f18c7b04068/users/28b40b405b764435a62506fe6a5bbf67/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:13.092502 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e8607-dacc-43fe-97dd-d55c6e7a52d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee1b07c027bb44c7a8510f18c7b04068, user_id=28b40b405b764435a62506fe6a5bbf67, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:13.095224 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e8607-dacc-43fe-97dd-d55c6e7a52d8 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:13.105652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 957/1926] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:13 2022] PUT /identity/v3/projects/ee1b07c027bb44c7a8510f18c7b04068/users/28b40b405b764435a62506fe6a5bbf67/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:13.117242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c695f9e-f2b5-469b-9fbb-f9122fbac809 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:13.117605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c695f9e-f2b5-469b-9fbb-f9122fbac809 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:13.117886 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c695f9e-f2b5-469b-9fbb-f9122fbac809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:13.144236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-2c695f9e-f2b5-469b-9fbb-f9122fbac809 None None] MFA Rules not processed for user `28b40b405b764435a62506fe6a5bbf67`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:13.145349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2c695f9e-f2b5-469b-9fbb-f9122fbac809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:13.228010 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 970/1927] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:13.246379 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e8607-dacc-43fe-97dd-d55c6e7a52d8 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:13.249188 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4e1e8607-dacc-43fe-97dd-d55c6e7a52d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:13.331537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e8607-dacc-43fe-97dd-d55c6e7a52d8 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:13.335129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3ba9a-9b97-48b5-9b87-eef079faed47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:13.335883 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3ba9a-9b97-48b5-9b87-eef079faed47 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:13.336378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3ba9a-9b97-48b5-9b87-eef079faed47 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:13.336611 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3ba9a-9b97-48b5-9b87-eef079faed47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:13.346413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3ba9a-9b97-48b5-9b87-eef079faed47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:13.347909 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3ba9a-9b97-48b5-9b87-eef079faed47 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:13.358360 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 958/1928] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:13.461003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c695f9e-f2b5-469b-9fbb-f9122fbac809 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:13.462570 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2c695f9e-f2b5-469b-9fbb-f9122fbac809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:13.475426 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c695f9e-f2b5-469b-9fbb-f9122fbac809 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:13.479231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4c6e6-4a8a-471c-a6dc-143df42b3f60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:13.479684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4c6e6-4a8a-471c-a6dc-143df42b3f60 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:13.479967 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4c6e6-4a8a-471c-a6dc-143df42b3f60 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:13.481917 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4c6e6-4a8a-471c-a6dc-143df42b3f60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:13.539811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4c6e6-4a8a-471c-a6dc-143df42b3f60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:13.541222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4c6e6-4a8a-471c-a6dc-143df42b3f60 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:13.550434 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 971/1929] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:13 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:14.531051 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3ba9a-9b97-48b5-9b87-eef079faed47 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:14.539524 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3ba9a-9b97-48b5-9b87-eef079faed47 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:14.544339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123c60f-b039-46a8-b0e4-2152ac481a17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:14.545121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123c60f-b039-46a8-b0e4-2152ac481a17 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:14.545398 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123c60f-b039-46a8-b0e4-2152ac481a17 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:14.545667 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123c60f-b039-46a8-b0e4-2152ac481a17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:14.547560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-9123c60f-b039-46a8-b0e4-2152ac481a17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:14.607675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123c60f-b039-46a8-b0e4-2152ac481a17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:14.609190 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123c60f-b039-46a8-b0e4-2152ac481a17 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:14.618590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 959/1930] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:15.308226 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4c6e6-4a8a-471c-a6dc-143df42b3f60 service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:15.319004 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4c6e6-4a8a-471c-a6dc-143df42b3f60 service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:15.324836 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ba294-5d21-4480-8792-a330f0a1d931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:15.325712 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ba294-5d21-4480-8792-a330f0a1d931 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:15.326238 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ba294-5d21-4480-8792-a330f0a1d931 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:15.326728 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ba294-5d21-4480-8792-a330f0a1d931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:15.329621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b04ba294-5d21-4480-8792-a330f0a1d931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:15.394504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ba294-5d21-4480-8792-a330f0a1d931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:15.395964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ba294-5d21-4480-8792-a330f0a1d931 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:15.406309 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 972/1931] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:15.731652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123c60f-b039-46a8-b0e4-2152ac481a17 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:15.740920 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123c60f-b039-46a8-b0e4-2152ac481a17 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:15.744952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02ebde-5542-428b-b94e-e2d97e627a28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:15.745660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02ebde-5542-428b-b94e-e2d97e627a28 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:15.745960 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02ebde-5542-428b-b94e-e2d97e627a28 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:15.746236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02ebde-5542-428b-b94e-e2d97e627a28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:15.748177 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ff02ebde-5542-428b-b94e-e2d97e627a28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:15.814125 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02ebde-5542-428b-b94e-e2d97e627a28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:15.815588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02ebde-5542-428b-b94e-e2d97e627a28 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:15.825528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 960/1932] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:16.561039 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ba294-5d21-4480-8792-a330f0a1d931 service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:16.573565 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ba294-5d21-4480-8792-a330f0a1d931 service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:16.580805 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d825b-68b9-4650-9eac-d84ecc1f726d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:16.584123 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d825b-68b9-4650-9eac-d84ecc1f726d service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:16.585189 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d825b-68b9-4650-9eac-d84ecc1f726d service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:16.586277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d825b-68b9-4650-9eac-d84ecc1f726d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:16.589104 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-807d825b-68b9-4650-9eac-d84ecc1f726d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:16.695325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d825b-68b9-4650-9eac-d84ecc1f726d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:16.696919 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d825b-68b9-4650-9eac-d84ecc1f726d service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:16.716358 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 973/1933] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:53:19.816886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02ebde-5542-428b-b94e-e2d97e627a28 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:19.883390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02ebde-5542-428b-b94e-e2d97e627a28 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:19.888391 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9e250-7fd8-486d-9a6c-673c5c56c30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:19.889339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9e250-7fd8-486d-9a6c-673c5c56c30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:19.889626 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9e250-7fd8-486d-9a6c-673c5c56c30e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:19.889884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9e250-7fd8-486d-9a6c-673c5c56c30e admin admin] PATH_INFO: `/v3/users/9eef26fa947f4ca39b515ce178bd26fd` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:19.891100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9e250-7fd8-486d-9a6c-673c5c56c30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eef26fa947f4ca39b515ce178bd26fd)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:19.893082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9e250-7fd8-486d-9a6c-673c5c56c30e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:19.938836 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-02f9e250-7fd8-486d-9a6c-673c5c56c30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eef26fa947f4ca39b515ce178bd26fd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.939574 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-02f9e250-7fd8-486d-9a6c-673c5c56c30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eef26fa947f4ca39b515ce178bd26fd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.952710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-02f9e250-7fd8-486d-9a6c-673c5c56c30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eef26fa947f4ca39b515ce178bd26fd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.953454 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-02f9e250-7fd8-486d-9a6c-673c5c56c30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eef26fa947f4ca39b515ce178bd26fd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.960936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-02f9e250-7fd8-486d-9a6c-673c5c56c30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eef26fa947f4ca39b515ce178bd26fd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.973679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 961/1934] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:19 2022] DELETE /identity/v3/users/9eef26fa947f4ca39b515ce178bd26fd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:19.978684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcc2b0-632d-4f6d-b8e0-ae3ee9e80d2c None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:19.979501 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcc2b0-632d-4f6d-b8e0-ae3ee9e80d2c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:19.979647 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcc2b0-632d-4f6d-b8e0-ae3ee9e80d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:19.999864 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-45fcc2b0-632d-4f6d-b8e0-ae3ee9e80d2c None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:20.001343 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-45fcc2b0-632d-4f6d-b8e0-ae3ee9e80d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:20.067824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 974/1935] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:20.078387 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9e250-7fd8-486d-9a6c-673c5c56c30e admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:20.079801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-02f9e250-7fd8-486d-9a6c-673c5c56c30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:20.142805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9e250-7fd8-486d-9a6c-673c5c56c30e admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:20.147939 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3625fcb-63d3-4268-97fe-792f4350e7b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:20.148664 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3625fcb-63d3-4268-97fe-792f4350e7b5 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:20.149096 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3625fcb-63d3-4268-97fe-792f4350e7b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:20.149359 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3625fcb-63d3-4268-97fe-792f4350e7b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:20.163989 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3625fcb-63d3-4268-97fe-792f4350e7b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:20.165719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3625fcb-63d3-4268-97fe-792f4350e7b5 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:20.181255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 962/1936] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:20.563304 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcc2b0-632d-4f6d-b8e0-ae3ee9e80d2c None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:20.565572 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-45fcc2b0-632d-4f6d-b8e0-ae3ee9e80d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:20.584964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcc2b0-632d-4f6d-b8e0-ae3ee9e80d2c None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:20.611814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28e4de-3e30-40e8-bdfe-833a25914748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:20.614095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28e4de-3e30-40e8-bdfe-833a25914748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:20.614424 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28e4de-3e30-40e8-bdfe-833a25914748 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:20.614698 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28e4de-3e30-40e8-bdfe-833a25914748 admin admin] PATH_INFO: `/v3/projects/1f6f48d16b98469891d5240f5e451071` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:20.616580 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28e4de-3e30-40e8-bdfe-833a25914748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f6f48d16b98469891d5240f5e451071)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:20.621259 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28e4de-3e30-40e8-bdfe-833a25914748 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:20.725653 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5e28e4de-3e30-40e8-bdfe-833a25914748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6f48d16b98469891d5240f5e451071', 'request_id': 'req-5e28e4de-3e30-40e8-bdfe-833a25914748'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:20.738316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5e28e4de-3e30-40e8-bdfe-833a25914748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6f48d16b98469891d5240f5e451071', 'request_id': 'req-5e28e4de-3e30-40e8-bdfe-833a25914748'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:20.749184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5e28e4de-3e30-40e8-bdfe-833a25914748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6f48d16b98469891d5240f5e451071', 'request_id': 'req-5e28e4de-3e30-40e8-bdfe-833a25914748'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:20.761677 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3625fcb-63d3-4268-97fe-792f4350e7b5 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:20.763351 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e3625fcb-63d3-4268-97fe-792f4350e7b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:20.767641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5e28e4de-3e30-40e8-bdfe-833a25914748 admin admin] The token cache is being invalidate because project 1f6f48d16b98469891d5240f5e451071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:20.773354 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5e28e4de-3e30-40e8-bdfe-833a25914748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:20.774896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5e28e4de-3e30-40e8-bdfe-833a25914748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:20.777288 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 975/1937] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:20 2022] DELETE /identity/v3/projects/1f6f48d16b98469891d5240f5e451071 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:20.781270 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28e4de-3e30-40e8-bdfe-833a25914748 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:20.784821 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5e28e4de-3e30-40e8-bdfe-833a25914748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:20.793952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3625fcb-63d3-4268-97fe-792f4350e7b5 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:20.908608 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14c7f-a120-48b0-a654-6d5de259c292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:20.911704 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14c7f-a120-48b0-a654-6d5de259c292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:20.912551 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14c7f-a120-48b0-a654-6d5de259c292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:20.913034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14c7f-a120-48b0-a654-6d5de259c292 admin admin] PATH_INFO: `/v3/users/030c1d90be31408ebcc0fb9e0bfb9c9e` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:20.915635 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a14c7f-a120-48b0-a654-6d5de259c292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=030c1d90be31408ebcc0fb9e0bfb9c9e)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:20.918735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a14c7f-a120-48b0-a654-6d5de259c292 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:20.938763 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28e4de-3e30-40e8-bdfe-833a25914748 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:20.948869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8be0c0-1395-4f81-ad17-11676a261318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:20.952279 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8be0c0-1395-4f81-ad17-11676a261318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:20.952812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8be0c0-1395-4f81-ad17-11676a261318 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:20.953383 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8be0c0-1395-4f81-ad17-11676a261318 admin admin] PATH_INFO: `/v3/users/28b40b405b764435a62506fe6a5bbf67` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:20.956029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8be0c0-1395-4f81-ad17-11676a261318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b40b405b764435a62506fe6a5bbf67)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:20.960617 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8be0c0-1395-4f81-ad17-11676a261318 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:20.998558 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-42a14c7f-a120-48b0-a654-6d5de259c292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030c1d90be31408ebcc0fb9e0bfb9c9e'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:20.999625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-42a14c7f-a120-48b0-a654-6d5de259c292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030c1d90be31408ebcc0fb9e0bfb9c9e'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.018596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-42a14c7f-a120-48b0-a654-6d5de259c292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030c1d90be31408ebcc0fb9e0bfb9c9e'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.019644 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-42a14c7f-a120-48b0-a654-6d5de259c292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030c1d90be31408ebcc0fb9e0bfb9c9e'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.030740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-42a14c7f-a120-48b0-a654-6d5de259c292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030c1d90be31408ebcc0fb9e0bfb9c9e'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.041192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4a8be0c0-1395-4f81-ad17-11676a261318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b40b405b764435a62506fe6a5bbf67'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.042682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4a8be0c0-1395-4f81-ad17-11676a261318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b40b405b764435a62506fe6a5bbf67'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.048808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 963/1938] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:20 2022] DELETE /identity/v3/users/030c1d90be31408ebcc0fb9e0bfb9c9e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:21.050068 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14c7f-a120-48b0-a654-6d5de259c292 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:21.051821 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-42a14c7f-a120-48b0-a654-6d5de259c292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:21.062793 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4a8be0c0-1395-4f81-ad17-11676a261318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b40b405b764435a62506fe6a5bbf67'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.063923 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4a8be0c0-1395-4f81-ad17-11676a261318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b40b405b764435a62506fe6a5bbf67'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.075482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4a8be0c0-1395-4f81-ad17-11676a261318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b40b405b764435a62506fe6a5bbf67'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.096109 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 976/1939] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:20 2022] DELETE /identity/v3/users/28b40b405b764435a62506fe6a5bbf67 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:21.101324 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794fe73-7294-4236-ae79-7836f955f5e3 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:21.101613 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794fe73-7294-4236-ae79-7836f955f5e3 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:21.101884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794fe73-7294-4236-ae79-7836f955f5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:21.133147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-1794fe73-7294-4236-ae79-7836f955f5e3 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:21.134511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1794fe73-7294-4236-ae79-7836f955f5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:21.180739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14c7f-a120-48b0-a654-6d5de259c292 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:21.223187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 977/1940] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:21.235903 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794fe73-7294-4236-ae79-7836f955f5e3 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:21.238586 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1794fe73-7294-4236-ae79-7836f955f5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:21.289260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fe5b8-0204-4b81-9459-0558b274f4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:21.290725 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fe5b8-0204-4b81-9459-0558b274f4ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:21.291945 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fe5b8-0204-4b81-9459-0558b274f4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:21.291945 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fe5b8-0204-4b81-9459-0558b274f4ed admin admin] PATH_INFO: `/v3/users/2a2b78b185624c21a18d9d55c42371c5` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:21.293278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fe5b8-0204-4b81-9459-0558b274f4ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2b78b185624c21a18d9d55c42371c5)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:21.295537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fe5b8-0204-4b81-9459-0558b274f4ed admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:21.318576 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794fe73-7294-4236-ae79-7836f955f5e3 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:21.323808 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15218cbf-1f47-4a87-bd57-c1e4e382bea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:21.324993 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15218cbf-1f47-4a87-bd57-c1e4e382bea5 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:21.325478 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15218cbf-1f47-4a87-bd57-c1e4e382bea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:21.326103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15218cbf-1f47-4a87-bd57-c1e4e382bea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:21.339399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15218cbf-1f47-4a87-bd57-c1e4e382bea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:21.345877 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15218cbf-1f47-4a87-bd57-c1e4e382bea5 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:21.369833 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ac0fe5b8-0204-4b81-9459-0558b274f4ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2b78b185624c21a18d9d55c42371c5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.371397 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 978/1941] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:53:21.371632 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ac0fe5b8-0204-4b81-9459-0558b274f4ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2b78b185624c21a18d9d55c42371c5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.408990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ac0fe5b8-0204-4b81-9459-0558b274f4ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2b78b185624c21a18d9d55c42371c5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.409860 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ac0fe5b8-0204-4b81-9459-0558b274f4ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2b78b185624c21a18d9d55c42371c5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.424250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ac0fe5b8-0204-4b81-9459-0558b274f4ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2b78b185624c21a18d9d55c42371c5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.440828 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 964/1942] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:21 2022] DELETE /identity/v3/users/2a2b78b185624c21a18d9d55c42371c5 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:21.446721 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dc93c-3025-4213-aae8-cc09fe24232a None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:21.447277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dc93c-3025-4213-aae8-cc09fe24232a None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:21.447446 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dc93c-3025-4213-aae8-cc09fe24232a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:21.476281 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-e55dc93c-3025-4213-aae8-cc09fe24232a None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:21.478087 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e55dc93c-3025-4213-aae8-cc09fe24232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:21.548857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 979/1943] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:21.559333 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fe5b8-0204-4b81-9459-0558b274f4ed admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:21.560835 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ac0fe5b8-0204-4b81-9459-0558b274f4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:21.621326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fe5b8-0204-4b81-9459-0558b274f4ed admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:21.625903 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b57d53-ced8-401d-8859-d9e3f0e15ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:21.626706 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b57d53-ced8-401d-8859-d9e3f0e15ebc service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:21.627231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b57d53-ced8-401d-8859-d9e3f0e15ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:21.627652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b57d53-ced8-401d-8859-d9e3f0e15ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:21.638201 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b57d53-ced8-401d-8859-d9e3f0e15ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:21.640060 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b57d53-ced8-401d-8859-d9e3f0e15ebc service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:21.651874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 965/1944] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:21.679616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dc93c-3025-4213-aae8-cc09fe24232a None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:21.681142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e55dc93c-3025-4213-aae8-cc09fe24232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:21.695389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dc93c-3025-4213-aae8-cc09fe24232a None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:21.717807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:21.718671 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:21.719332 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:21.719332 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d admin admin] PATH_INFO: `/v3/projects/ee1b07c027bb44c7a8510f18c7b04068` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:21.720469 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee1b07c027bb44c7a8510f18c7b04068)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:21.722508 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:21.795201 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee1b07c027bb44c7a8510f18c7b04068', 'request_id': 'req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.817789 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee1b07c027bb44c7a8510f18c7b04068', 'request_id': 'req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.829213 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee1b07c027bb44c7a8510f18c7b04068', 'request_id': 'req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.841494 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d admin admin] The token cache is being invalidate because project ee1b07c027bb44c7a8510f18c7b04068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:21.842199 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.843564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.846052 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 980/1945] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:21 2022] DELETE /identity/v3/projects/ee1b07c027bb44c7a8510f18c7b04068 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:21.851152 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98a856-b0ec-454f-996a-3b93d966a4a5 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:21.851635 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98a856-b0ec-454f-996a-3b93d966a4a5 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:21.852229 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98a856-b0ec-454f-996a-3b93d966a4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:21.881261 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-1a98a856-b0ec-454f-996a-3b93d966a4a5 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:21.882506 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1a98a856-b0ec-454f-996a-3b93d966a4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:21.965664 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:21.967404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:22.007807 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 966/1946] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:22.016135 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e45c4-f6a6-479d-b097-ada1aecb5120 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.016455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e45c4-f6a6-479d-b097-ada1aecb5120 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.016742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e45c4-f6a6-479d-b097-ada1aecb5120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.059004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-822e45c4-f6a6-479d-b097-ada1aecb5120 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:22.060164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-822e45c4-f6a6-479d-b097-ada1aecb5120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:22.080941 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6e971-751e-4ff9-8ae8-d5d6ca00088d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.086221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.087368 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.087799 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.088299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c admin admin] PATH_INFO: `/v3/projects/2a45ec60c47e47a8a79326a9917a20aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.090023 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a45ec60c47e47a8a79326a9917a20aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.092299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.096155 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 967/1947] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:22.100075 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e45c4-f6a6-479d-b097-ada1aecb5120 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:22.116817 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e45c4-f6a6-479d-b097-ada1aecb5120 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.127755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40814962-f1b6-4eb6-8acd-753e5b181cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.128475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40814962-f1b6-4eb6-8acd-753e5b181cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.128758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40814962-f1b6-4eb6-8acd-753e5b181cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.129035 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40814962-f1b6-4eb6-8acd-753e5b181cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.129770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40814962-f1b6-4eb6-8acd-753e5b181cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:22.130077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40814962-f1b6-4eb6-8acd-753e5b181cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.131687 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40814962-f1b6-4eb6-8acd-753e5b181cc7 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.151940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 968/1948] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:53:22.156026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40814962-f1b6-4eb6-8acd-753e5b181cc7 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:22.171228 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40814962-f1b6-4eb6-8acd-753e5b181cc7 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.177819 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a45ec60c47e47a8a79326a9917a20aa', 'request_id': 'req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.187794 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a45ec60c47e47a8a79326a9917a20aa', 'request_id': 'req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.196453 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a45ec60c47e47a8a79326a9917a20aa', 'request_id': 'req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.211873 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c admin admin] The token cache is being invalidate because project 2a45ec60c47e47a8a79326a9917a20aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:22.212527 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.213592 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.215422 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 981/1949] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:21 2022] DELETE /identity/v3/projects/2a45ec60c47e47a8a79326a9917a20aa => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:22.216268 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:22.217888 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:22.251996 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac49c79-462e-4434-986c-13c05887b619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.252791 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac49c79-462e-4434-986c-13c05887b619 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.253167 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac49c79-462e-4434-986c-13c05887b619 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.253771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac49c79-462e-4434-986c-13c05887b619 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.254707 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac49c79-462e-4434-986c-13c05887b619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.256765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac49c79-462e-4434-986c-13c05887b619 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.286595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 969/1950] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:22 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:22.287412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac49c79-462e-4434-986c-13c05887b619 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:22.289144 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-cac49c79-462e-4434-986c-13c05887b619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:22.304235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc78ecc-ad58-4cf8-aa8a-00d4d57a367c admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.353821 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac49c79-462e-4434-986c-13c05887b619 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.358739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96120362-4b9a-432c-8bbb-e7b5aaeb7959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.359697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120362-4b9a-432c-8bbb-e7b5aaeb7959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.360050 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120362-4b9a-432c-8bbb-e7b5aaeb7959 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.360414 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120362-4b9a-432c-8bbb-e7b5aaeb7959 admin admin] PATH_INFO: `/v3/users/134c1b43c3394f2d9a08a56ea9fc7119` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.361314 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f5cf1-0763-465f-89b3-c7e708a7d032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.361772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96120362-4b9a-432c-8bbb-e7b5aaeb7959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=134c1b43c3394f2d9a08a56ea9fc7119)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.362237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f5cf1-0763-465f-89b3-c7e708a7d032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.362513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f5cf1-0763-465f-89b3-c7e708a7d032 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.362781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f5cf1-0763-465f-89b3-c7e708a7d032 admin admin] PATH_INFO: `/v3/projects/e3434bd8b17945659174229fc861bc29` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.363937 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f5cf1-0763-465f-89b3-c7e708a7d032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3434bd8b17945659174229fc861bc29)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.364024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96120362-4b9a-432c-8bbb-e7b5aaeb7959 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.365946 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f5cf1-0763-465f-89b3-c7e708a7d032 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.410632 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-96120362-4b9a-432c-8bbb-e7b5aaeb7959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134c1b43c3394f2d9a08a56ea9fc7119'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.411285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-96120362-4b9a-432c-8bbb-e7b5aaeb7959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134c1b43c3394f2d9a08a56ea9fc7119'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.412178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dd1f5cf1-0763-465f-89b3-c7e708a7d032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3434bd8b17945659174229fc861bc29', 'request_id': 'req-dd1f5cf1-0763-465f-89b3-c7e708a7d032'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.419708 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dd1f5cf1-0763-465f-89b3-c7e708a7d032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3434bd8b17945659174229fc861bc29', 'request_id': 'req-dd1f5cf1-0763-465f-89b3-c7e708a7d032'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.425568 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-96120362-4b9a-432c-8bbb-e7b5aaeb7959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134c1b43c3394f2d9a08a56ea9fc7119'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.426031 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dd1f5cf1-0763-465f-89b3-c7e708a7d032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3434bd8b17945659174229fc861bc29', 'request_id': 'req-dd1f5cf1-0763-465f-89b3-c7e708a7d032'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.426557 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-96120362-4b9a-432c-8bbb-e7b5aaeb7959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134c1b43c3394f2d9a08a56ea9fc7119'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.435371 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-96120362-4b9a-432c-8bbb-e7b5aaeb7959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134c1b43c3394f2d9a08a56ea9fc7119'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.438237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dd1f5cf1-0763-465f-89b3-c7e708a7d032 admin admin] The token cache is being invalidate because project e3434bd8b17945659174229fc861bc29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:22.438553 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dd1f5cf1-0763-465f-89b3-c7e708a7d032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.439199 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dd1f5cf1-0763-465f-89b3-c7e708a7d032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.443781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 982/1951] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:22 2022] DELETE /identity/v3/projects/e3434bd8b17945659174229fc861bc29 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:22.443781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f5cf1-0763-465f-89b3-c7e708a7d032 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:22.443781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-dd1f5cf1-0763-465f-89b3-c7e708a7d032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:22.447537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 970/1952] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:22 2022] DELETE /identity/v3/users/134c1b43c3394f2d9a08a56ea9fc7119 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:22.448480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96120362-4b9a-432c-8bbb-e7b5aaeb7959 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:22.449892 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-96120362-4b9a-432c-8bbb-e7b5aaeb7959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:22.522478 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f5cf1-0763-465f-89b3-c7e708a7d032 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.530232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae944aa-5259-4b43-909c-c5842cbc6945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.531085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae944aa-5259-4b43-909c-c5842cbc6945 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.531376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae944aa-5259-4b43-909c-c5842cbc6945 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.531765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96120362-4b9a-432c-8bbb-e7b5aaeb7959 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.532053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae944aa-5259-4b43-909c-c5842cbc6945 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.532841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae944aa-5259-4b43-909c-c5842cbc6945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.535836 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae944aa-5259-4b43-909c-c5842cbc6945 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.538670 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe469a7c-5fc1-497a-b4b4-dfd6aa906327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.539662 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe469a7c-5fc1-497a-b4b4-dfd6aa906327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.540010 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe469a7c-5fc1-497a-b4b4-dfd6aa906327 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.540447 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe469a7c-5fc1-497a-b4b4-dfd6aa906327 admin admin] PATH_INFO: `/v3/users/7aaa4e29f2e4491da6a2fe5fce804e1a` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.541794 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe469a7c-5fc1-497a-b4b4-dfd6aa906327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aaa4e29f2e4491da6a2fe5fce804e1a)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.543936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe469a7c-5fc1-497a-b4b4-dfd6aa906327 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.563645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 983/1953] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:22 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:22.567639 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae944aa-5259-4b43-909c-c5842cbc6945 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:22.580721 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae944aa-5259-4b43-909c-c5842cbc6945 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.589057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52131f57-3f1c-4b17-ab50-ad26a5218ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.590403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52131f57-3f1c-4b17-ab50-ad26a5218ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.590945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52131f57-3f1c-4b17-ab50-ad26a5218ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.591364 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52131f57-3f1c-4b17-ab50-ad26a5218ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.592340 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52131f57-3f1c-4b17-ab50-ad26a5218ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.594495 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52131f57-3f1c-4b17-ab50-ad26a5218ab2 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.606683 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 984/1954] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:22.607163 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fe469a7c-5fc1-497a-b4b4-dfd6aa906327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aaa4e29f2e4491da6a2fe5fce804e1a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.607863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fe469a7c-5fc1-497a-b4b4-dfd6aa906327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aaa4e29f2e4491da6a2fe5fce804e1a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.610905 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52131f57-3f1c-4b17-ab50-ad26a5218ab2 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:22.622483 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fe469a7c-5fc1-497a-b4b4-dfd6aa906327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aaa4e29f2e4491da6a2fe5fce804e1a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.623097 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fe469a7c-5fc1-497a-b4b4-dfd6aa906327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aaa4e29f2e4491da6a2fe5fce804e1a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.625694 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52131f57-3f1c-4b17-ab50-ad26a5218ab2 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.638010 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4410a1-65be-461c-9286-1fa2d3381b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.638830 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4410a1-65be-461c-9286-1fa2d3381b06 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.639213 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4410a1-65be-461c-9286-1fa2d3381b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.639753 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4410a1-65be-461c-9286-1fa2d3381b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.641002 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4410a1-65be-461c-9286-1fa2d3381b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.641223 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fe469a7c-5fc1-497a-b4b4-dfd6aa906327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aaa4e29f2e4491da6a2fe5fce804e1a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.642977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4410a1-65be-461c-9286-1fa2d3381b06 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.656670 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 971/1955] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:22 2022] DELETE /identity/v3/users/7aaa4e29f2e4491da6a2fe5fce804e1a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:22.660339 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 985/1956] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:22.660487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe469a7c-5fc1-497a-b4b4-dfd6aa906327 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:22.665391 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-fe469a7c-5fc1-497a-b4b4-dfd6aa906327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:22.746116 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe469a7c-5fc1-497a-b4b4-dfd6aa906327 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.751415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efa4a1-293e-438e-a15d-98a0545ec182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.752511 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efa4a1-293e-438e-a15d-98a0545ec182 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.752857 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efa4a1-293e-438e-a15d-98a0545ec182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.753232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efa4a1-293e-438e-a15d-98a0545ec182 admin admin] PATH_INFO: `/v3/projects/c58e3c332b9f4503921f4f9a66b7f68a/users/f96d976621a04f3bbcefddb2ca3caa92/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.775314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efa4a1-293e-438e-a15d-98a0545ec182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58e3c332b9f4503921f4f9a66b7f68a, user_id=f96d976621a04f3bbcefddb2ca3caa92, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.778427 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efa4a1-293e-438e-a15d-98a0545ec182 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.807744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 972/1957] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:22 2022] PUT /identity/v3/projects/c58e3c332b9f4503921f4f9a66b7f68a/users/f96d976621a04f3bbcefddb2ca3caa92/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:22.821412 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4410a1-65be-461c-9286-1fa2d3381b06 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:22.823333 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4e4410a1-65be-461c-9286-1fa2d3381b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:22.826727 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f646b7-d9d3-4a1d-9373-509aa1b32038 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.827157 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f646b7-d9d3-4a1d-9373-509aa1b32038 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.827535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f646b7-d9d3-4a1d-9373-509aa1b32038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.847337 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4410a1-65be-461c-9286-1fa2d3381b06 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.869082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-72f646b7-d9d3-4a1d-9373-509aa1b32038 None None] MFA Rules not processed for user `f96d976621a04f3bbcefddb2ca3caa92`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:22.870742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-72f646b7-d9d3-4a1d-9373-509aa1b32038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:22.942568 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14a748-00e6-4afa-93fc-5a4a599d2d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.943602 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14a748-00e6-4afa-93fc-5a4a599d2d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.943888 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14a748-00e6-4afa-93fc-5a4a599d2d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.944169 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14a748-00e6-4afa-93fc-5a4a599d2d66 admin admin] PATH_INFO: `/v3/projects/be4c1f640f0b4073ab3a0b6b7a25cf3c` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.945552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14a748-00e6-4afa-93fc-5a4a599d2d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4c1f640f0b4073ab3a0b6b7a25cf3c)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.947767 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14a748-00e6-4afa-93fc-5a4a599d2d66 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.962966 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 973/1958] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:22.967897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f646b7-d9d3-4a1d-9373-509aa1b32038 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:22.992035 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f646b7-d9d3-4a1d-9373-509aa1b32038 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.008653 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3c14a748-00e6-4afa-93fc-5a4a599d2d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4c1f640f0b4073ab3a0b6b7a25cf3c', 'request_id': 'req-3c14a748-00e6-4afa-93fc-5a4a599d2d66'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.020687 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3c14a748-00e6-4afa-93fc-5a4a599d2d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4c1f640f0b4073ab3a0b6b7a25cf3c', 'request_id': 'req-3c14a748-00e6-4afa-93fc-5a4a599d2d66'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.029638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3c14a748-00e6-4afa-93fc-5a4a599d2d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4c1f640f0b4073ab3a0b6b7a25cf3c', 'request_id': 'req-3c14a748-00e6-4afa-93fc-5a4a599d2d66'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.041604 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3c14a748-00e6-4afa-93fc-5a4a599d2d66 admin admin] The token cache is being invalidate because project be4c1f640f0b4073ab3a0b6b7a25cf3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:23.041928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3c14a748-00e6-4afa-93fc-5a4a599d2d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.042751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3c14a748-00e6-4afa-93fc-5a4a599d2d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.044373 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 986/1959] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:22 2022] DELETE /identity/v3/projects/be4c1f640f0b4073ab3a0b6b7a25cf3c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:23.045273 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14a748-00e6-4afa-93fc-5a4a599d2d66 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.046554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-3c14a748-00e6-4afa-93fc-5a4a599d2d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.060175 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc53500-f424-45ab-abdd-606c652ff6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.060897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc53500-f424-45ab-abdd-606c652ff6cd admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.061184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc53500-f424-45ab-abdd-606c652ff6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.061457 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc53500-f424-45ab-abdd-606c652ff6cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.062164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc53500-f424-45ab-abdd-606c652ff6cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.064082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc53500-f424-45ab-abdd-606c652ff6cd admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.093452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 974/1960] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:22 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:23.093452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc53500-f424-45ab-abdd-606c652ff6cd admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.093452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-6cc53500-f424-45ab-abdd-606c652ff6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.113591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14a748-00e6-4afa-93fc-5a4a599d2d66 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.158270 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc53500-f424-45ab-abdd-606c652ff6cd admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.162998 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d6f5c-555a-4d51-b2ec-44e1d42be146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.164107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d6f5c-555a-4d51-b2ec-44e1d42be146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.164435 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d6f5c-555a-4d51-b2ec-44e1d42be146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.164709 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d6f5c-555a-4d51-b2ec-44e1d42be146 admin admin] PATH_INFO: `/v3/users/232f104520dc4fb4bc1867cef555140b` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.165925 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d6f5c-555a-4d51-b2ec-44e1d42be146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=232f104520dc4fb4bc1867cef555140b)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.167959 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d6f5c-555a-4d51-b2ec-44e1d42be146 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.169970 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e02e5-6e54-4776-9a21-85aed4288eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.170872 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e02e5-6e54-4776-9a21-85aed4288eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.171180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e02e5-6e54-4776-9a21-85aed4288eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.171447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e02e5-6e54-4776-9a21-85aed4288eaf admin admin] PATH_INFO: `/v3/projects/30778990585b40d78b93d4c91509c514` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.172657 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e02e5-6e54-4776-9a21-85aed4288eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=30778990585b40d78b93d4c91509c514)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.174581 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e02e5-6e54-4776-9a21-85aed4288eaf admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.214698 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a81d6f5c-555a-4d51-b2ec-44e1d42be146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '232f104520dc4fb4bc1867cef555140b'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.215481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a81d6f5c-555a-4d51-b2ec-44e1d42be146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '232f104520dc4fb4bc1867cef555140b'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.219669 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-d72e02e5-6e54-4776-9a21-85aed4288eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30778990585b40d78b93d4c91509c514', 'request_id': 'req-d72e02e5-6e54-4776-9a21-85aed4288eaf'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.227683 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-d72e02e5-6e54-4776-9a21-85aed4288eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30778990585b40d78b93d4c91509c514', 'request_id': 'req-d72e02e5-6e54-4776-9a21-85aed4288eaf'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.227948 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a81d6f5c-555a-4d51-b2ec-44e1d42be146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '232f104520dc4fb4bc1867cef555140b'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.228752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a81d6f5c-555a-4d51-b2ec-44e1d42be146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '232f104520dc4fb4bc1867cef555140b'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.237081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a81d6f5c-555a-4d51-b2ec-44e1d42be146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '232f104520dc4fb4bc1867cef555140b'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.242246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-d72e02e5-6e54-4776-9a21-85aed4288eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30778990585b40d78b93d4c91509c514', 'request_id': 'req-d72e02e5-6e54-4776-9a21-85aed4288eaf'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.250693 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 975/1961] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:23 2022] DELETE /identity/v3/users/232f104520dc4fb4bc1867cef555140b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:23.251776 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d6f5c-555a-4d51-b2ec-44e1d42be146 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.253560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a81d6f5c-555a-4d51-b2ec-44e1d42be146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.262132 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-d72e02e5-6e54-4776-9a21-85aed4288eaf admin admin] The token cache is being invalidate because project 30778990585b40d78b93d4c91509c514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:23.262485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-d72e02e5-6e54-4776-9a21-85aed4288eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.263740 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-d72e02e5-6e54-4776-9a21-85aed4288eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.265749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 987/1962] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:23 2022] DELETE /identity/v3/projects/30778990585b40d78b93d4c91509c514 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:23.269839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e02e5-6e54-4776-9a21-85aed4288eaf admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.272300 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-d72e02e5-6e54-4776-9a21-85aed4288eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.326177 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d6f5c-555a-4d51-b2ec-44e1d42be146 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.331318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1a630-0f27-434a-8050-6ef6538ab890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.332135 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1a630-0f27-434a-8050-6ef6538ab890 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.332971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1a630-0f27-434a-8050-6ef6538ab890 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.332971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1a630-0f27-434a-8050-6ef6538ab890 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.333983 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1a630-0f27-434a-8050-6ef6538ab890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.336179 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1a630-0f27-434a-8050-6ef6538ab890 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.347388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e02e5-6e54-4776-9a21-85aed4288eaf admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.353335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e409e-0a0d-4842-aab4-52a95e43d6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.354350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e409e-0a0d-4842-aab4-52a95e43d6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.354650 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e409e-0a0d-4842-aab4-52a95e43d6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.355038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e409e-0a0d-4842-aab4-52a95e43d6ce admin admin] PATH_INFO: `/v3/users/d9f8931fda3148928b132a51bc05d052` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.356575 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e409e-0a0d-4842-aab4-52a95e43d6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f8931fda3148928b132a51bc05d052)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.358385 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e409e-0a0d-4842-aab4-52a95e43d6ce admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.363865 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 976/1963] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:23 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:23.368024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1a630-0f27-434a-8050-6ef6538ab890 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.371125 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-9ed1a630-0f27-434a-8050-6ef6538ab890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.397592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1a630-0f27-434a-8050-6ef6538ab890 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.405651 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ea491-3801-48b7-aea0-433ffe4ef81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.406714 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea491-3801-48b7-aea0-433ffe4ef81a admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.408241 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea491-3801-48b7-aea0-433ffe4ef81a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.408576 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea491-3801-48b7-aea0-433ffe4ef81a admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.409354 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ea491-3801-48b7-aea0-433ffe4ef81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.411405 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ea491-3801-48b7-aea0-433ffe4ef81a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.424945 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 977/1964] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:23.429246 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ea491-3801-48b7-aea0-433ffe4ef81a admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.438458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-f02e409e-0a0d-4842-aab4-52a95e43d6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f8931fda3148928b132a51bc05d052'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.439657 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-f02e409e-0a0d-4842-aab4-52a95e43d6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f8931fda3148928b132a51bc05d052'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.444846 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ea491-3801-48b7-aea0-433ffe4ef81a admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.457773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-f02e409e-0a0d-4842-aab4-52a95e43d6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f8931fda3148928b132a51bc05d052'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.457962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9e3ef-6cd1-4c77-939c-39a748a53a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.458474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-f02e409e-0a0d-4842-aab4-52a95e43d6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f8931fda3148928b132a51bc05d052'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.460056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9e3ef-6cd1-4c77-939c-39a748a53a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.460596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9e3ef-6cd1-4c77-939c-39a748a53a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.461078 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9e3ef-6cd1-4c77-939c-39a748a53a98 admin admin] PATH_INFO: `/v3/projects/26a35e23069040fea527cf6ed78ffda3/users/d75a3f24cc5f4cada5ffa6ac00150a68/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.469429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-f02e409e-0a0d-4842-aab4-52a95e43d6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f8931fda3148928b132a51bc05d052'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.483415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9e3ef-6cd1-4c77-939c-39a748a53a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a35e23069040fea527cf6ed78ffda3, user_id=d75a3f24cc5f4cada5ffa6ac00150a68, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.491879 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9e3ef-6cd1-4c77-939c-39a748a53a98 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.508825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 988/1965] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:23 2022] DELETE /identity/v3/users/d9f8931fda3148928b132a51bc05d052 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:23.510845 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 978/1966] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:23 2022] PUT /identity/v3/projects/26a35e23069040fea527cf6ed78ffda3/users/d75a3f24cc5f4cada5ffa6ac00150a68/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:23.514852 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e409e-0a0d-4842-aab4-52a95e43d6ce admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.516575 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f02e409e-0a0d-4842-aab4-52a95e43d6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.592163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e409e-0a0d-4842-aab4-52a95e43d6ce admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.660148 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78a3d6-32e1-4386-b8f1-d563f72db3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.660870 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78a3d6-32e1-4386-b8f1-d563f72db3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.661150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78a3d6-32e1-4386-b8f1-d563f72db3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.661420 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78a3d6-32e1-4386-b8f1-d563f72db3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.662147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78a3d6-32e1-4386-b8f1-d563f72db3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.663943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78a3d6-32e1-4386-b8f1-d563f72db3e9 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.679514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 989/1967] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:23.684639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9e3ef-6cd1-4c77-939c-39a748a53a98 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.695408 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9e3ef-6cd1-4c77-939c-39a748a53a98 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.697441 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78a3d6-32e1-4386-b8f1-d563f72db3e9 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.699285 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ab78a3d6-32e1-4386-b8f1-d563f72db3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.701430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12ab64-9a4e-4c56-8e3a-4dc13134b56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.702438 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12ab64-9a4e-4c56-8e3a-4dc13134b56c admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.702617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12ab64-9a4e-4c56-8e3a-4dc13134b56c admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.703174 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12ab64-9a4e-4c56-8e3a-4dc13134b56c admin admin] PATH_INFO: `/v3/projects/26a35e23069040fea527cf6ed78ffda3/users/d75a3f24cc5f4cada5ffa6ac00150a68/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.704964 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12ab64-9a4e-4c56-8e3a-4dc13134b56c admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a35e23069040fea527cf6ed78ffda3, user_id=d75a3f24cc5f4cada5ffa6ac00150a68, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.707615 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12ab64-9a4e-4c56-8e3a-4dc13134b56c admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.711666 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78a3d6-32e1-4386-b8f1-d563f72db3e9 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.718912 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 979/1968] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:23 2022] PUT /identity/v3/projects/26a35e23069040fea527cf6ed78ffda3/users/d75a3f24cc5f4cada5ffa6ac00150a68/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:23.731217 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff17f1c-3a80-4e49-a115-cc8d97614856 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.732514 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff17f1c-3a80-4e49-a115-cc8d97614856 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.732938 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff17f1c-3a80-4e49-a115-cc8d97614856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.767898 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-bff17f1c-3a80-4e49-a115-cc8d97614856 None None] MFA Rules not processed for user `d75a3f24cc5f4cada5ffa6ac00150a68`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:23.769625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-bff17f1c-3a80-4e49-a115-cc8d97614856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.812489 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7c33d-665a-41c3-8fb9-096607c2ec75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.813676 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7c33d-665a-41c3-8fb9-096607c2ec75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.813974 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7c33d-665a-41c3-8fb9-096607c2ec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.814438 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7c33d-665a-41c3-8fb9-096607c2ec75 admin admin] PATH_INFO: `/v3/projects/ecaccd20ae0f49d3b5a50d801c311779` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.817797 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7c33d-665a-41c3-8fb9-096607c2ec75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecaccd20ae0f49d3b5a50d801c311779)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.822016 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7c33d-665a-41c3-8fb9-096607c2ec75 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.884083 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-2fe7c33d-665a-41c3-8fb9-096607c2ec75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecaccd20ae0f49d3b5a50d801c311779', 'request_id': 'req-2fe7c33d-665a-41c3-8fb9-096607c2ec75'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.884746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 980/1969] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:23.885843 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff17f1c-3a80-4e49-a115-cc8d97614856 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.887327 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-bff17f1c-3a80-4e49-a115-cc8d97614856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.899448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-2fe7c33d-665a-41c3-8fb9-096607c2ec75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecaccd20ae0f49d3b5a50d801c311779', 'request_id': 'req-2fe7c33d-665a-41c3-8fb9-096607c2ec75'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.905138 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff17f1c-3a80-4e49-a115-cc8d97614856 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.906272 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-2fe7c33d-665a-41c3-8fb9-096607c2ec75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecaccd20ae0f49d3b5a50d801c311779', 'request_id': 'req-2fe7c33d-665a-41c3-8fb9-096607c2ec75'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.917657 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-2fe7c33d-665a-41c3-8fb9-096607c2ec75 admin admin] The token cache is being invalidate because project ecaccd20ae0f49d3b5a50d801c311779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:23.918589 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-2fe7c33d-665a-41c3-8fb9-096607c2ec75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.918727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-2fe7c33d-665a-41c3-8fb9-096607c2ec75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.923906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 990/1970] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:23 2022] DELETE /identity/v3/projects/ecaccd20ae0f49d3b5a50d801c311779 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:23.923906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7c33d-665a-41c3-8fb9-096607c2ec75 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.924901 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2fe7c33d-665a-41c3-8fb9-096607c2ec75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.970388 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddaced-2794-4231-b9d9-0f038cd03fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.971292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddaced-2794-4231-b9d9-0f038cd03fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.971562 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddaced-2794-4231-b9d9-0f038cd03fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.971834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddaced-2794-4231-b9d9-0f038cd03fc6 admin admin] PATH_INFO: `/v3/projects/4d108b2e745a4998972e6127e09b31f2` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.973043 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddaced-2794-4231-b9d9-0f038cd03fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d108b2e745a4998972e6127e09b31f2)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.974956 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddaced-2794-4231-b9d9-0f038cd03fc6 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.981318 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7c33d-665a-41c3-8fb9-096607c2ec75 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.987366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab489147-9136-48e6-bb15-0b5b767f283b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.988294 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab489147-9136-48e6-bb15-0b5b767f283b service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.988569 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab489147-9136-48e6-bb15-0b5b767f283b service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.988861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab489147-9136-48e6-bb15-0b5b767f283b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.991888 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ab489147-9136-48e6-bb15-0b5b767f283b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:24.023498 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-beddaced-2794-4231-b9d9-0f038cd03fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d108b2e745a4998972e6127e09b31f2', 'request_id': 'req-beddaced-2794-4231-b9d9-0f038cd03fc6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:24.033468 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-beddaced-2794-4231-b9d9-0f038cd03fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d108b2e745a4998972e6127e09b31f2', 'request_id': 'req-beddaced-2794-4231-b9d9-0f038cd03fc6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:24.039365 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-beddaced-2794-4231-b9d9-0f038cd03fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d108b2e745a4998972e6127e09b31f2', 'request_id': 'req-beddaced-2794-4231-b9d9-0f038cd03fc6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:24.051390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-beddaced-2794-4231-b9d9-0f038cd03fc6 admin admin] The token cache is being invalidate because project 4d108b2e745a4998972e6127e09b31f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:24.051682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-beddaced-2794-4231-b9d9-0f038cd03fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:24.052358 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-beddaced-2794-4231-b9d9-0f038cd03fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:24.057255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 981/1971] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:23 2022] DELETE /identity/v3/projects/4d108b2e745a4998972e6127e09b31f2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:24.057255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197728f-a33c-424e-b065-f8b8e5c17fe7 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.057255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197728f-a33c-424e-b065-f8b8e5c17fe7 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.057255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197728f-a33c-424e-b065-f8b8e5c17fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.061490 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab489147-9136-48e6-bb15-0b5b767f283b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.063102 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab489147-9136-48e6-bb15-0b5b767f283b service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.073795 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 991/1972] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:24.075325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155f6d4-9efb-4d53-a86c-6755eeee8f5f None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.075753 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155f6d4-9efb-4d53-a86c-6755eeee8f5f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.076035 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155f6d4-9efb-4d53-a86c-6755eeee8f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.091592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-c197728f-a33c-424e-b065-f8b8e5c17fe7 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:24.094428 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c197728f-a33c-424e-b065-f8b8e5c17fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:24.095450 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-d155f6d4-9efb-4d53-a86c-6755eeee8f5f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:24.097109 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-d155f6d4-9efb-4d53-a86c-6755eeee8f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:24.175931 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 982/1973] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:24.176937 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 992/1974] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:24.188866 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26484410-885e-4fa4-9218-d5f0ab592dde None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.189197 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a78a4-895a-48ed-8563-bcd61d5e470f None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.189287 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26484410-885e-4fa4-9218-d5f0ab592dde None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.189361 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a78a4-895a-48ed-8563-bcd61d5e470f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.189440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26484410-885e-4fa4-9218-d5f0ab592dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.189510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a78a4-895a-48ed-8563-bcd61d5e470f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.216777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-c93a78a4-895a-48ed-8563-bcd61d5e470f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:24.218040 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-c93a78a4-895a-48ed-8563-bcd61d5e470f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:24.221190 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-26484410-885e-4fa4-9218-d5f0ab592dde None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:24.222578 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-26484410-885e-4fa4-9218-d5f0ab592dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:24.226528 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 993/1975] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:24.231221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a78a4-895a-48ed-8563-bcd61d5e470f None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.232342 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 983/1976] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:24.236419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26484410-885e-4fa4-9218-d5f0ab592dde None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.240928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a78a4-895a-48ed-8563-bcd61d5e470f None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.245763 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2dc91-02d1-4e85-9163-dd5d7b532243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.245930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26484410-885e-4fa4-9218-d5f0ab592dde None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.246444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2dc91-02d1-4e85-9163-dd5d7b532243 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.246723 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2dc91-02d1-4e85-9163-dd5d7b532243 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.246991 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2dc91-02d1-4e85-9163-dd5d7b532243 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.247725 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2dc91-02d1-4e85-9163-dd5d7b532243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:24.248030 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2dc91-02d1-4e85-9163-dd5d7b532243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.249724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2dc91-02d1-4e85-9163-dd5d7b532243 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.251698 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b068ff-de52-430c-a37b-67f7026c15a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.252636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b068ff-de52-430c-a37b-67f7026c15a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.252918 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b068ff-de52-430c-a37b-67f7026c15a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.253196 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b068ff-de52-430c-a37b-67f7026c15a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.253923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b068ff-de52-430c-a37b-67f7026c15a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:24.254230 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b068ff-de52-430c-a37b-67f7026c15a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.255823 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b068ff-de52-430c-a37b-67f7026c15a6 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.261824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 994/1977] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:53:24.266241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2dc91-02d1-4e85-9163-dd5d7b532243 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.272169 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 984/1978] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:53:24.274254 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b068ff-de52-430c-a37b-67f7026c15a6 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.278699 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2dc91-02d1-4e85-9163-dd5d7b532243 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.283659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed843d7-6a28-498f-824e-064a2fa36b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.283959 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b068ff-de52-430c-a37b-67f7026c15a6 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.284366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed843d7-6a28-498f-824e-064a2fa36b04 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.284651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed843d7-6a28-498f-824e-064a2fa36b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.284979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed843d7-6a28-498f-824e-064a2fa36b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.285628 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed843d7-6a28-498f-824e-064a2fa36b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.287777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed843d7-6a28-498f-824e-064a2fa36b04 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.288911 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf9735-d69a-47c3-9571-b95a2aba7abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.289723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf9735-d69a-47c3-9571-b95a2aba7abc admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.289990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf9735-d69a-47c3-9571-b95a2aba7abc admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.290274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf9735-d69a-47c3-9571-b95a2aba7abc admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.290966 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf9735-d69a-47c3-9571-b95a2aba7abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.292961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf9735-d69a-47c3-9571-b95a2aba7abc admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.320498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 995/1979] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:24 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:24.325091 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed843d7-6a28-498f-824e-064a2fa36b04 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.325998 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 985/1980] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:24 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:24.337043 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf9735-d69a-47c3-9571-b95a2aba7abc admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.395886 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed843d7-6a28-498f-824e-064a2fa36b04 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.402213 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faedb3-0fd8-4dfd-82f1-f809ce7dc359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.403606 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faedb3-0fd8-4dfd-82f1-f809ce7dc359 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.403888 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faedb3-0fd8-4dfd-82f1-f809ce7dc359 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.404161 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faedb3-0fd8-4dfd-82f1-f809ce7dc359 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.405165 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faedb3-0fd8-4dfd-82f1-f809ce7dc359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.406778 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf9735-d69a-47c3-9571-b95a2aba7abc admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.407111 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faedb3-0fd8-4dfd-82f1-f809ce7dc359 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.411475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ac267-7473-4ddb-a5ce-ae25a916ae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.412155 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ac267-7473-4ddb-a5ce-ae25a916ae2d admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.412623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ac267-7473-4ddb-a5ce-ae25a916ae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.412908 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ac267-7473-4ddb-a5ce-ae25a916ae2d admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.413620 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ac267-7473-4ddb-a5ce-ae25a916ae2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.416712 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ac267-7473-4ddb-a5ce-ae25a916ae2d admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.433825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 996/1981] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:24 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:24.441474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faedb3-0fd8-4dfd-82f1-f809ce7dc359 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.444258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 986/1982] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:24 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:24.446790 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ac267-7473-4ddb-a5ce-ae25a916ae2d admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.451838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faedb3-0fd8-4dfd-82f1-f809ce7dc359 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.456906 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ac267-7473-4ddb-a5ce-ae25a916ae2d admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.457066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8a288-b6c0-4800-b905-856e6c686b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.457675 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8a288-b6c0-4800-b905-856e6c686b7d admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.457973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8a288-b6c0-4800-b905-856e6c686b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.458245 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8a288-b6c0-4800-b905-856e6c686b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.459076 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8a288-b6c0-4800-b905-856e6c686b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.460800 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8a288-b6c0-4800-b905-856e6c686b7d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.468729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff5a18-8716-46b9-bee0-b7a9abdf932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.469199 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff5a18-8716-46b9-bee0-b7a9abdf932e admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.469730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff5a18-8716-46b9-bee0-b7a9abdf932e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.469948 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff5a18-8716-46b9-bee0-b7a9abdf932e admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.470766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff5a18-8716-46b9-bee0-b7a9abdf932e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.472511 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff5a18-8716-46b9-bee0-b7a9abdf932e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.473239 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 997/1983] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:24.477540 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8a288-b6c0-4800-b905-856e6c686b7d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.487708 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8a288-b6c0-4800-b905-856e6c686b7d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.492034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 987/1984] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:24.495513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b624c-1653-4db8-86fd-b0b8721fc69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.496228 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b624c-1653-4db8-86fd-b0b8721fc69b admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.496514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b624c-1653-4db8-86fd-b0b8721fc69b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.496660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff5a18-8716-46b9-bee0-b7a9abdf932e admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.496797 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b624c-1653-4db8-86fd-b0b8721fc69b admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.498160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b624c-1653-4db8-86fd-b0b8721fc69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.499810 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b624c-1653-4db8-86fd-b0b8721fc69b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.510306 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 998/1985] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:24.512437 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff5a18-8716-46b9-bee0-b7a9abdf932e admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.514712 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b624c-1653-4db8-86fd-b0b8721fc69b admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.518110 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc90f40-89f8-49b4-a5cb-da70b39bc29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.519059 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc90f40-89f8-49b4-a5cb-da70b39bc29b admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.519566 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc90f40-89f8-49b4-a5cb-da70b39bc29b admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.519897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc90f40-89f8-49b4-a5cb-da70b39bc29b admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.520853 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc90f40-89f8-49b4-a5cb-da70b39bc29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.523184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc90f40-89f8-49b4-a5cb-da70b39bc29b admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.526877 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b624c-1653-4db8-86fd-b0b8721fc69b admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.534324 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d04350-cfe0-4d74-a916-fde5f9f21866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.535270 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d04350-cfe0-4d74-a916-fde5f9f21866 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.535549 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 988/1986] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:24.538945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d04350-cfe0-4d74-a916-fde5f9f21866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.539234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d04350-cfe0-4d74-a916-fde5f9f21866 admin admin] PATH_INFO: `/v3/projects/7a45ab62bcfa4e59ab951d8fbe6cbec2/users/aa25a6134ede45289dd29ce9156125f7/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.540498 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc90f40-89f8-49b4-a5cb-da70b39bc29b admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.552782 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc90f40-89f8-49b4-a5cb-da70b39bc29b admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.557502 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d04350-cfe0-4d74-a916-fde5f9f21866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a45ab62bcfa4e59ab951d8fbe6cbec2, user_id=aa25a6134ede45289dd29ce9156125f7, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.557930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b21b99-2e20-45ed-b0f2-e9ba7a40d7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.558837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b21b99-2e20-45ed-b0f2-e9ba7a40d7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.559117 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b21b99-2e20-45ed-b0f2-e9ba7a40d7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.559394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b21b99-2e20-45ed-b0f2-e9ba7a40d7e2 admin admin] PATH_INFO: `/v3/projects/2c22011cb72447d49eaf0e623c2d423c/users/f77ffa9a7dd44cf9b00c53d1356e0567/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.562853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d04350-cfe0-4d74-a916-fde5f9f21866 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.577475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b21b99-2e20-45ed-b0f2-e9ba7a40d7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c22011cb72447d49eaf0e623c2d423c, user_id=f77ffa9a7dd44cf9b00c53d1356e0567, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.580587 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b21b99-2e20-45ed-b0f2-e9ba7a40d7e2 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.582371 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 999/1987] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:24 2022] PUT /identity/v3/projects/7a45ab62bcfa4e59ab951d8fbe6cbec2/users/aa25a6134ede45289dd29ce9156125f7/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:24.595193 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd04904-2ccd-42cb-b3f8-3852b3c82b46 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.596755 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd04904-2ccd-42cb-b3f8-3852b3c82b46 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.597239 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd04904-2ccd-42cb-b3f8-3852b3c82b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.602004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 989/1988] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:24 2022] PUT /identity/v3/projects/2c22011cb72447d49eaf0e623c2d423c/users/f77ffa9a7dd44cf9b00c53d1356e0567/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:24.605098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87283b5e-3155-413c-a857-4b8b05f62446 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.614096 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87283b5e-3155-413c-a857-4b8b05f62446 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.614430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87283b5e-3155-413c-a857-4b8b05f62446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.642090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-4fd04904-2ccd-42cb-b3f8-3852b3c82b46 None None] MFA Rules not processed for user `aa25a6134ede45289dd29ce9156125f7`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:24.648525 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4fd04904-2ccd-42cb-b3f8-3852b3c82b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:24.648622 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-87283b5e-3155-413c-a857-4b8b05f62446 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:24.648622 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-87283b5e-3155-413c-a857-4b8b05f62446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:24.753221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1000/1989] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:24.769529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd04904-2ccd-42cb-b3f8-3852b3c82b46 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.770795 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4fd04904-2ccd-42cb-b3f8-3852b3c82b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:24.783679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 990/1990] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:24.793245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87283b5e-3155-413c-a857-4b8b05f62446 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.795463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-87283b5e-3155-413c-a857-4b8b05f62446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:24.808650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87283b5e-3155-413c-a857-4b8b05f62446 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.815056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bf83c-d37b-4aa8-88ce-14575fef7c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.815948 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bf83c-d37b-4aa8-88ce-14575fef7c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.816262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bf83c-d37b-4aa8-88ce-14575fef7c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.816547 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bf83c-d37b-4aa8-88ce-14575fef7c55 admin admin] PATH_INFO: `/v3/users/f96d976621a04f3bbcefddb2ca3caa92` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.817752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bf83c-d37b-4aa8-88ce-14575fef7c55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f96d976621a04f3bbcefddb2ca3caa92)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.819802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bf83c-d37b-4aa8-88ce-14575fef7c55 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.837658 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd04904-2ccd-42cb-b3f8-3852b3c82b46 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.841365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22df39a-8493-4926-b213-f094e40a7de6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0303312c6cec4067a4a92d38edb59086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.842083 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22df39a-8493-4926-b213-f094e40a7de6 service glance] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.842429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22df39a-8493-4926-b213-f094e40a7de6 service glance] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.842762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22df39a-8493-4926-b213-f094e40a7de6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.852291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22df39a-8493-4926-b213-f094e40a7de6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.853916 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22df39a-8493-4926-b213-f094e40a7de6 service glance] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.862866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1001/1991] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:24.863718 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22df39a-8493-4926-b213-f094e40a7de6 service glance] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.865029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-a22df39a-8493-4926-b213-f094e40a7de6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:24.868030 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-558bf83c-d37b-4aa8-88ce-14575fef7c55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f96d976621a04f3bbcefddb2ca3caa92'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:24.868771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-558bf83c-d37b-4aa8-88ce-14575fef7c55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f96d976621a04f3bbcefddb2ca3caa92'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:24.880881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-558bf83c-d37b-4aa8-88ce-14575fef7c55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f96d976621a04f3bbcefddb2ca3caa92'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:24.881690 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-558bf83c-d37b-4aa8-88ce-14575fef7c55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f96d976621a04f3bbcefddb2ca3caa92'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:24.890326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-558bf83c-d37b-4aa8-88ce-14575fef7c55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f96d976621a04f3bbcefddb2ca3caa92'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:24.903927 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 991/1992] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:24 2022] DELETE /identity/v3/users/f96d976621a04f3bbcefddb2ca3caa92 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:24.908471 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dd96a-fb33-4000-87ae-77c49b7c54d2 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.908763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dd96a-fb33-4000-87ae-77c49b7c54d2 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.909039 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dd96a-fb33-4000-87ae-77c49b7c54d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.924190 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22df39a-8493-4926-b213-f094e40a7de6 service glance] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.926910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-713dd96a-fb33-4000-87ae-77c49b7c54d2 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:24.928105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-713dd96a-fb33-4000-87ae-77c49b7c54d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:24.981929 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86069d1d-a988-40c9-9efc-fbd422d53a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.983130 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86069d1d-a988-40c9-9efc-fbd422d53a53 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.983575 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86069d1d-a988-40c9-9efc-fbd422d53a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.984001 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86069d1d-a988-40c9-9efc-fbd422d53a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.986502 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-86069d1d-a988-40c9-9efc-fbd422d53a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:25.001860 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86069d1d-a988-40c9-9efc-fbd422d53a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:25.003489 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86069d1d-a988-40c9-9efc-fbd422d53a53 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:25.004410 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 992/1993] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:25.014799 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dd96a-fb33-4000-87ae-77c49b7c54d2 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:25.016415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-713dd96a-fb33-4000-87ae-77c49b7c54d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:25.022047 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1002/1994] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:25.031180 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dd96a-fb33-4000-87ae-77c49b7c54d2 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:25.034886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd7c35-1b0a-4289-a643-c841ff6ea849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:25.035583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd7c35-1b0a-4289-a643-c841ff6ea849 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:25.035836 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd7c35-1b0a-4289-a643-c841ff6ea849 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:25.036285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd7c35-1b0a-4289-a643-c841ff6ea849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:25.048600 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd7c35-1b0a-4289-a643-c841ff6ea849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:25.050604 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd7c35-1b0a-4289-a643-c841ff6ea849 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:25.079260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 993/1995] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:25.638105 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86069d1d-a988-40c9-9efc-fbd422d53a53 service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:25.639655 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-86069d1d-a988-40c9-9efc-fbd422d53a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:25.655708 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86069d1d-a988-40c9-9efc-fbd422d53a53 service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:25.660432 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1439ab-0d43-4db4-adab-1690b722380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:25.661802 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1439ab-0d43-4db4-adab-1690b722380e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:25.661930 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1439ab-0d43-4db4-adab-1690b722380e admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:25.662218 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1439ab-0d43-4db4-adab-1690b722380e admin admin] PATH_INFO: `/v3/projects/c58e3c332b9f4503921f4f9a66b7f68a` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:25.663567 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1439ab-0d43-4db4-adab-1690b722380e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58e3c332b9f4503921f4f9a66b7f68a)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:25.665790 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1439ab-0d43-4db4-adab-1690b722380e admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:25.717090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-fa1439ab-0d43-4db4-adab-1690b722380e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58e3c332b9f4503921f4f9a66b7f68a', 'request_id': 'req-fa1439ab-0d43-4db4-adab-1690b722380e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:25.725156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-fa1439ab-0d43-4db4-adab-1690b722380e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58e3c332b9f4503921f4f9a66b7f68a', 'request_id': 'req-fa1439ab-0d43-4db4-adab-1690b722380e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:25.731779 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-fa1439ab-0d43-4db4-adab-1690b722380e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58e3c332b9f4503921f4f9a66b7f68a', 'request_id': 'req-fa1439ab-0d43-4db4-adab-1690b722380e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:25.741883 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-fa1439ab-0d43-4db4-adab-1690b722380e admin admin] The token cache is being invalidate because project c58e3c332b9f4503921f4f9a66b7f68a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:25.742295 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-fa1439ab-0d43-4db4-adab-1690b722380e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:25.742930 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-fa1439ab-0d43-4db4-adab-1690b722380e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:25.744485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1003/1996] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:25 2022] DELETE /identity/v3/projects/c58e3c332b9f4503921f4f9a66b7f68a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:25.748603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd7c35-1b0a-4289-a643-c841ff6ea849 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:25.758253 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd7c35-1b0a-4289-a643-c841ff6ea849 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:25.822162 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b25f7-4c2e-4e23-acec-4f6ef53d960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:25.823160 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b25f7-4c2e-4e23-acec-4f6ef53d960a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:25.823522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b25f7-4c2e-4e23-acec-4f6ef53d960a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:25.823882 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b25f7-4c2e-4e23-acec-4f6ef53d960a admin admin] PATH_INFO: `/v3/users/d75a3f24cc5f4cada5ffa6ac00150a68` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:25.825415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b25f7-4c2e-4e23-acec-4f6ef53d960a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75a3f24cc5f4cada5ffa6ac00150a68)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:25.827668 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b25f7-4c2e-4e23-acec-4f6ef53d960a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:25.882884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-259b25f7-4c2e-4e23-acec-4f6ef53d960a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75a3f24cc5f4cada5ffa6ac00150a68'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:25.884188 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-259b25f7-4c2e-4e23-acec-4f6ef53d960a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75a3f24cc5f4cada5ffa6ac00150a68'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:25.902058 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-259b25f7-4c2e-4e23-acec-4f6ef53d960a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75a3f24cc5f4cada5ffa6ac00150a68'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:25.903082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-259b25f7-4c2e-4e23-acec-4f6ef53d960a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75a3f24cc5f4cada5ffa6ac00150a68'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:25.915159 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-259b25f7-4c2e-4e23-acec-4f6ef53d960a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75a3f24cc5f4cada5ffa6ac00150a68'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:25.935494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 994/1997] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:25 2022] DELETE /identity/v3/users/d75a3f24cc5f4cada5ffa6ac00150a68 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:26.068029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc458f-7e45-48f8-b34e-9a4ff88d631b None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:26.068438 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc458f-7e45-48f8-b34e-9a4ff88d631b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:26.068739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc458f-7e45-48f8-b34e-9a4ff88d631b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:26.097009 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-4ccc458f-7e45-48f8-b34e-9a4ff88d631b None None] MFA Rules not processed for user `f77ffa9a7dd44cf9b00c53d1356e0567`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:26.098214 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4ccc458f-7e45-48f8-b34e-9a4ff88d631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:26.165929 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1004/1998] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:26.184994 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b25f7-4c2e-4e23-acec-4f6ef53d960a admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:26.186926 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-259b25f7-4c2e-4e23-acec-4f6ef53d960a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:26.285170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b25f7-4c2e-4e23-acec-4f6ef53d960a admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:26.289112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f5cd4-3553-4d9d-bd65-145ed753dcbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:26.289769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f5cd4-3553-4d9d-bd65-145ed753dcbc service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:26.290033 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f5cd4-3553-4d9d-bd65-145ed753dcbc service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:26.291607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f5cd4-3553-4d9d-bd65-145ed753dcbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:26.301417 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f5cd4-3553-4d9d-bd65-145ed753dcbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:26.302887 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f5cd4-3553-4d9d-bd65-145ed753dcbc service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:26.312493 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 995/1999] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:26.359405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc458f-7e45-48f8-b34e-9a4ff88d631b None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:26.360920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4ccc458f-7e45-48f8-b34e-9a4ff88d631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:26.477252 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc458f-7e45-48f8-b34e-9a4ff88d631b None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:26.488429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b60d6-1346-4e34-a0fc-dd3a6c39bd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:26.489492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b60d6-1346-4e34-a0fc-dd3a6c39bd71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:26.489874 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b60d6-1346-4e34-a0fc-dd3a6c39bd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:26.490246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b60d6-1346-4e34-a0fc-dd3a6c39bd71 admin admin] PATH_INFO: `/v3/projects/26a35e23069040fea527cf6ed78ffda3` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:26.491687 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b60d6-1346-4e34-a0fc-dd3a6c39bd71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26a35e23069040fea527cf6ed78ffda3)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:26.494017 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b60d6-1346-4e34-a0fc-dd3a6c39bd71 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:26.557393 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0f6b60d6-1346-4e34-a0fc-dd3a6c39bd71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26a35e23069040fea527cf6ed78ffda3', 'request_id': 'req-0f6b60d6-1346-4e34-a0fc-dd3a6c39bd71'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:26.566722 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0f6b60d6-1346-4e34-a0fc-dd3a6c39bd71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26a35e23069040fea527cf6ed78ffda3', 'request_id': 'req-0f6b60d6-1346-4e34-a0fc-dd3a6c39bd71'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:26.576828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0f6b60d6-1346-4e34-a0fc-dd3a6c39bd71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26a35e23069040fea527cf6ed78ffda3', 'request_id': 'req-0f6b60d6-1346-4e34-a0fc-dd3a6c39bd71'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:26.591626 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0f6b60d6-1346-4e34-a0fc-dd3a6c39bd71 admin admin] The token cache is being invalidate because project 26a35e23069040fea527cf6ed78ffda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:26.592618 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0f6b60d6-1346-4e34-a0fc-dd3a6c39bd71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:26.592858 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0f6b60d6-1346-4e34-a0fc-dd3a6c39bd71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:26.598983 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1005/2000] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:26 2022] DELETE /identity/v3/projects/26a35e23069040fea527cf6ed78ffda3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:26.603885 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b2900-94f6-4659-a96e-1b94da86b925 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:26.604348 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b2900-94f6-4659-a96e-1b94da86b925 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:26.604891 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b2900-94f6-4659-a96e-1b94da86b925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:26.657241 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-f46b2900-94f6-4659-a96e-1b94da86b925 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:26.658913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f46b2900-94f6-4659-a96e-1b94da86b925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:26.762961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 996/2001] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:26.770759 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ff01-7d18-4e9d-9a73-9f7e85471542 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:26.771510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ff01-7d18-4e9d-9a73-9f7e85471542 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:26.771967 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ff01-7d18-4e9d-9a73-9f7e85471542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:26.791113 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-ea84ff01-7d18-4e9d-9a73-9f7e85471542 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:26.792484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ea84ff01-7d18-4e9d-9a73-9f7e85471542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:26.804056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1006/2002] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:26.808700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b2900-94f6-4659-a96e-1b94da86b925 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:26.818732 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b2900-94f6-4659-a96e-1b94da86b925 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:26.824997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcc786-2a1a-48ab-8442-5b0009f2855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:26.825684 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcc786-2a1a-48ab-8442-5b0009f2855d admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:26.825967 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcc786-2a1a-48ab-8442-5b0009f2855d admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:26.826241 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcc786-2a1a-48ab-8442-5b0009f2855d admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:26.826977 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcc786-2a1a-48ab-8442-5b0009f2855d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:26.827280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcc786-2a1a-48ab-8442-5b0009f2855d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:26.828954 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcc786-2a1a-48ab-8442-5b0009f2855d admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:26.841016 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 997/2003] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:26.845471 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84ff01-7d18-4e9d-9a73-9f7e85471542 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:26.854964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84ff01-7d18-4e9d-9a73-9f7e85471542 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:26.860830 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6943e-f9f9-4529-bc26-de11ed7ebe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:26.861488 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6943e-f9f9-4529-bc26-de11ed7ebe20 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:26.861765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6943e-f9f9-4529-bc26-de11ed7ebe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:26.862033 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6943e-f9f9-4529-bc26-de11ed7ebe20 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:26.862734 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6943e-f9f9-4529-bc26-de11ed7ebe20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:26.864675 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6943e-f9f9-4529-bc26-de11ed7ebe20 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:26.893099 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1007/2004] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:26 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:26.897763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcc786-2a1a-48ab-8442-5b0009f2855d admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:26.908235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcc786-2a1a-48ab-8442-5b0009f2855d admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:26.967623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225b6ca-9af3-405c-9c98-b3ac3f7b8954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:26.968317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225b6ca-9af3-405c-9c98-b3ac3f7b8954 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:26.968595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225b6ca-9af3-405c-9c98-b3ac3f7b8954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:26.968853 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225b6ca-9af3-405c-9c98-b3ac3f7b8954 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:26.969529 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225b6ca-9af3-405c-9c98-b3ac3f7b8954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:26.971445 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225b6ca-9af3-405c-9c98-b3ac3f7b8954 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:26.993355 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 998/2005] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:26 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:26.997810 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6943e-f9f9-4529-bc26-de11ed7ebe20 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:27.008136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6943e-f9f9-4529-bc26-de11ed7ebe20 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:27.012825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc34a95-211c-4aeb-9ff6-59a6351dbfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:27.013475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc34a95-211c-4aeb-9ff6-59a6351dbfed admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.013752 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc34a95-211c-4aeb-9ff6-59a6351dbfed admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.014062 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc34a95-211c-4aeb-9ff6-59a6351dbfed admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.014752 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc34a95-211c-4aeb-9ff6-59a6351dbfed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:27.016376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc34a95-211c-4aeb-9ff6-59a6351dbfed admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:27.026813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1008/2006] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:27.030855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225b6ca-9af3-405c-9c98-b3ac3f7b8954 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:27.040981 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225b6ca-9af3-405c-9c98-b3ac3f7b8954 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:27.046150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5108da-4b55-4eae-ad30-b23fbc09fc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:27.046822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5108da-4b55-4eae-ad30-b23fbc09fc41 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.047124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5108da-4b55-4eae-ad30-b23fbc09fc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.047401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5108da-4b55-4eae-ad30-b23fbc09fc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.048128 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5108da-4b55-4eae-ad30-b23fbc09fc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:27.049736 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5108da-4b55-4eae-ad30-b23fbc09fc41 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:27.060029 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 999/2007] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:27.064404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc34a95-211c-4aeb-9ff6-59a6351dbfed admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:27.076185 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc34a95-211c-4aeb-9ff6-59a6351dbfed admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:27.082471 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d9fdf-3ab1-4d56-a1a2-db96f7402e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:27.083415 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d9fdf-3ab1-4d56-a1a2-db96f7402e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.083892 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d9fdf-3ab1-4d56-a1a2-db96f7402e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.084169 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d9fdf-3ab1-4d56-a1a2-db96f7402e7f admin admin] PATH_INFO: `/v3/projects/0b63644e41e0412fb5578eaf3ac3dab7/users/4d8920e151074bfda3bd5547d4f57fe0/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.100585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d9fdf-3ab1-4d56-a1a2-db96f7402e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b63644e41e0412fb5578eaf3ac3dab7, user_id=4d8920e151074bfda3bd5547d4f57fe0, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:27.103575 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d9fdf-3ab1-4d56-a1a2-db96f7402e7f admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:27.125841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1009/2008] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:27 2022] PUT /identity/v3/projects/0b63644e41e0412fb5578eaf3ac3dab7/users/4d8920e151074bfda3bd5547d4f57fe0/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:27.138099 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba83fef-6bab-4902-aa98-7f9420560c7e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.138642 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba83fef-6bab-4902-aa98-7f9420560c7e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.139060 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba83fef-6bab-4902-aa98-7f9420560c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.171275 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-2ba83fef-6bab-4902-aa98-7f9420560c7e None None] MFA Rules not processed for user `4d8920e151074bfda3bd5547d4f57fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:27.172839 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-2ba83fef-6bab-4902-aa98-7f9420560c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:27.252084 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1000/2009] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:27.256617 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d9fdf-3ab1-4d56-a1a2-db96f7402e7f admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:27.322736 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d9fdf-3ab1-4d56-a1a2-db96f7402e7f admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:27.327505 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8664661-7a3b-42f4-830d-4b80b0b9da12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:27.328196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8664661-7a3b-42f4-830d-4b80b0b9da12 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.328502 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8664661-7a3b-42f4-830d-4b80b0b9da12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.328775 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8664661-7a3b-42f4-830d-4b80b0b9da12 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.329501 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8664661-7a3b-42f4-830d-4b80b0b9da12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:27.331460 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8664661-7a3b-42f4-830d-4b80b0b9da12 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:27.359093 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1010/2010] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:27 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:27.363197 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba83fef-6bab-4902-aa98-7f9420560c7e None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:27.374381 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba83fef-6bab-4902-aa98-7f9420560c7e None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:27.447401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff59c0b-6b2c-4b02-9ec6-667e74898ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:27.448150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff59c0b-6b2c-4b02-9ec6-667e74898ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.448507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff59c0b-6b2c-4b02-9ec6-667e74898ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.448770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff59c0b-6b2c-4b02-9ec6-667e74898ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.449525 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff59c0b-6b2c-4b02-9ec6-667e74898ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:27.451838 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff59c0b-6b2c-4b02-9ec6-667e74898ec1 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:27.478389 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1001/2011] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:27 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:27.482400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8664661-7a3b-42f4-830d-4b80b0b9da12 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:27.500310 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8664661-7a3b-42f4-830d-4b80b0b9da12 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:27.511464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47a36c-a712-4cc1-a522-fddeaea4ffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:27.512226 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47a36c-a712-4cc1-a522-fddeaea4ffe8 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.512518 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47a36c-a712-4cc1-a522-fddeaea4ffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.512793 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47a36c-a712-4cc1-a522-fddeaea4ffe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.513594 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47a36c-a712-4cc1-a522-fddeaea4ffe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:27.515251 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47a36c-a712-4cc1-a522-fddeaea4ffe8 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:27.528448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1011/2012] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:27.533346 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff59c0b-6b2c-4b02-9ec6-667e74898ec1 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:27.545505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff59c0b-6b2c-4b02-9ec6-667e74898ec1 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:27.559592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c3b93-bee9-4376-b02e-46421b194198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:27.560548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c3b93-bee9-4376-b02e-46421b194198 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.560837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c3b93-bee9-4376-b02e-46421b194198 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.561115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c3b93-bee9-4376-b02e-46421b194198 admin admin] PATH_INFO: `/v3/projects/5f2c83b508ad47d29670dbea20bb9ff0/users/662c125de95246f098dee3100ad3a8bb/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.588000 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c3b93-bee9-4376-b02e-46421b194198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2c83b508ad47d29670dbea20bb9ff0, user_id=662c125de95246f098dee3100ad3a8bb, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:27.588000 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c3b93-bee9-4376-b02e-46421b194198 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:27.603004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1002/2013] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:27 2022] PUT /identity/v3/projects/5f2c83b508ad47d29670dbea20bb9ff0/users/662c125de95246f098dee3100ad3a8bb/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:27.603843 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47a36c-a712-4cc1-a522-fddeaea4ffe8 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:27.614281 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47a36c-a712-4cc1-a522-fddeaea4ffe8 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:27.686468 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12521062-492d-4c24-90e5-252220aea21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:27.687317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12521062-492d-4c24-90e5-252220aea21b admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.687848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12521062-492d-4c24-90e5-252220aea21b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.688641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12521062-492d-4c24-90e5-252220aea21b admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.689783 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12521062-492d-4c24-90e5-252220aea21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:27.691583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12521062-492d-4c24-90e5-252220aea21b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:27.702858 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1012/2014] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:27.709254 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c3b93-bee9-4376-b02e-46421b194198 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:27.719969 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c3b93-bee9-4376-b02e-46421b194198 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:27.724612 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d158742-4b33-477d-8d32-3686e3dd0ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:27.725494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d158742-4b33-477d-8d32-3686e3dd0ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.725793 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d158742-4b33-477d-8d32-3686e3dd0ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.726063 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d158742-4b33-477d-8d32-3686e3dd0ad3 admin admin] PATH_INFO: `/v3/projects/5f2c83b508ad47d29670dbea20bb9ff0/users/662c125de95246f098dee3100ad3a8bb/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.728407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d158742-4b33-477d-8d32-3686e3dd0ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2c83b508ad47d29670dbea20bb9ff0, user_id=662c125de95246f098dee3100ad3a8bb, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:27.731495 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d158742-4b33-477d-8d32-3686e3dd0ad3 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:27.741701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1003/2015] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:27 2022] PUT /identity/v3/projects/5f2c83b508ad47d29670dbea20bb9ff0/users/662c125de95246f098dee3100ad3a8bb/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:27.753908 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc693ce-91fa-4120-b207-ac4da69c793c None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.754199 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc693ce-91fa-4120-b207-ac4da69c793c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.754480 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc693ce-91fa-4120-b207-ac4da69c793c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.782718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc685b4e-2f3f-4734-b3b4-1e00f0c017a7 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.783310 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc685b4e-2f3f-4734-b3b4-1e00f0c017a7 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.783310 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc685b4e-2f3f-4734-b3b4-1e00f0c017a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.787565 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-5dc693ce-91fa-4120-b207-ac4da69c793c None None] MFA Rules not processed for user `662c125de95246f098dee3100ad3a8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:27.789665 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5dc693ce-91fa-4120-b207-ac4da69c793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:27.804762 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-bc685b4e-2f3f-4734-b3b4-1e00f0c017a7 None None] MFA Rules not processed for user `f77ffa9a7dd44cf9b00c53d1356e0567`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:27.806060 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-bc685b4e-2f3f-4734-b3b4-1e00f0c017a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:27.888442 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1004/2016] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:27.888664 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1013/2017] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:27.900872 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc685b4e-2f3f-4734-b3b4-1e00f0c017a7 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:27.902770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-bc685b4e-2f3f-4734-b3b4-1e00f0c017a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:27.985350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc685b4e-2f3f-4734-b3b4-1e00f0c017a7 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:27.993376 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bb781-e568-487c-a9a7-a417441a2429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:27.994054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bb781-e568-487c-a9a7-a417441a2429 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.994338 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bb781-e568-487c-a9a7-a417441a2429 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.994630 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bb781-e568-487c-a9a7-a417441a2429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:28.032831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7539e-ba8e-425c-ad8b-5aff58cd695c None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:28.033157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7539e-ba8e-425c-ad8b-5aff58cd695c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:28.033547 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7539e-ba8e-425c-ad8b-5aff58cd695c None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:28.035687 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1014/2018] 10.222.0.90 () {54 vars in 921 bytes} [Wed Nov 2 12:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:53:28.047967 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec043914-eaf3-44ac-8354-8301068b0e45 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:28.048329 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec043914-eaf3-44ac-8354-8301068b0e45 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:28.048547 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec043914-eaf3-44ac-8354-8301068b0e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:28.069039 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bb781-e568-487c-a9a7-a417441a2429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:28.070899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bb781-e568-487c-a9a7-a417441a2429 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:28.072832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-ec043914-eaf3-44ac-8354-8301068b0e45 None None] MFA Rules not processed for user `fbcda58f298444eebf4f08ce01deffc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:28.074091 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ec043914-eaf3-44ac-8354-8301068b0e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:28.082328 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1005/2019] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:28.175390 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1015/2020] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Nov 2 12:53:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:28.201827 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bb781-e568-487c-a9a7-a417441a2429 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:28.204068 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-dc1bb781-e568-487c-a9a7-a417441a2429 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:28.223353 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bb781-e568-487c-a9a7-a417441a2429 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:28.231703 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af2cf6-cd8a-4ac8-9695-6d53402cb942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:28.232669 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af2cf6-cd8a-4ac8-9695-6d53402cb942 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:28.233212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af2cf6-cd8a-4ac8-9695-6d53402cb942 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:28.233627 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af2cf6-cd8a-4ac8-9695-6d53402cb942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:28.245516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af2cf6-cd8a-4ac8-9695-6d53402cb942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:28.247278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af2cf6-cd8a-4ac8-9695-6d53402cb942 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:28.261207 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1006/2021] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:30.905406 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec043914-eaf3-44ac-8354-8301068b0e45 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:31.077334 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec043914-eaf3-44ac-8354-8301068b0e45 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:31.084570 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d95be4-411f-4c4c-aee4-f5869c738639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:31.086009 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d95be4-411f-4c4c-aee4-f5869c738639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:31.086443 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d95be4-411f-4c4c-aee4-f5869c738639 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:31.087026 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d95be4-411f-4c4c-aee4-f5869c738639 admin admin] PATH_INFO: `/v3/users/4d8920e151074bfda3bd5547d4f57fe0` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:31.088550 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d95be4-411f-4c4c-aee4-f5869c738639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8920e151074bfda3bd5547d4f57fe0)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:31.090749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d95be4-411f-4c4c-aee4-f5869c738639 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:31.172503 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-56d95be4-411f-4c4c-aee4-f5869c738639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8920e151074bfda3bd5547d4f57fe0'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:31.178596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-56d95be4-411f-4c4c-aee4-f5869c738639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8920e151074bfda3bd5547d4f57fe0'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:31.206461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-56d95be4-411f-4c4c-aee4-f5869c738639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8920e151074bfda3bd5547d4f57fe0'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:31.208729 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-56d95be4-411f-4c4c-aee4-f5869c738639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8920e151074bfda3bd5547d4f57fe0'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:31.219720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-56d95be4-411f-4c4c-aee4-f5869c738639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8920e151074bfda3bd5547d4f57fe0'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:31.244567 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1016/2022] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:30 2022] DELETE /identity/v3/users/4d8920e151074bfda3bd5547d4f57fe0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:31.249874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9d79c-e2f8-480b-8423-cfbaa09b46d4 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:31.250372 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9d79c-e2f8-480b-8423-cfbaa09b46d4 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:31.250719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9d79c-e2f8-480b-8423-cfbaa09b46d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:31.273756 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-a6f9d79c-e2f8-480b-8423-cfbaa09b46d4 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:31.274974 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a6f9d79c-e2f8-480b-8423-cfbaa09b46d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:31.383372 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1007/2023] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:31.391429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d95be4-411f-4c4c-aee4-f5869c738639 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:31.393243 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-56d95be4-411f-4c4c-aee4-f5869c738639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:31.473738 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d95be4-411f-4c4c-aee4-f5869c738639 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:31.479597 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed9edf-0552-4bd3-8c35-b1c4a4b40fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:31.480551 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed9edf-0552-4bd3-8c35-b1c4a4b40fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:31.480935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed9edf-0552-4bd3-8c35-b1c4a4b40fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:31.481782 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed9edf-0552-4bd3-8c35-b1c4a4b40fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:31.509753 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed9edf-0552-4bd3-8c35-b1c4a4b40fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:31.511633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed9edf-0552-4bd3-8c35-b1c4a4b40fa7 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:31.523524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1017/2024] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:31.735771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9d79c-e2f8-480b-8423-cfbaa09b46d4 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:31.740131 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a6f9d79c-e2f8-480b-8423-cfbaa09b46d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:31.752155 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9d79c-e2f8-480b-8423-cfbaa09b46d4 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:31.757139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f66bd-bf82-4493-a5b5-481e67984828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:31.757738 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f66bd-bf82-4493-a5b5-481e67984828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:31.758002 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f66bd-bf82-4493-a5b5-481e67984828 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:31.758266 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f66bd-bf82-4493-a5b5-481e67984828 admin admin] PATH_INFO: `/v3/users/8ff6826688a849a597e48fd9c798b0f8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:31.759486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f66bd-bf82-4493-a5b5-481e67984828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff6826688a849a597e48fd9c798b0f8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:31.761516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f66bd-bf82-4493-a5b5-481e67984828 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:31.854496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-875f66bd-bf82-4493-a5b5-481e67984828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff6826688a849a597e48fd9c798b0f8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:31.856612 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-875f66bd-bf82-4493-a5b5-481e67984828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff6826688a849a597e48fd9c798b0f8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:31.873311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-875f66bd-bf82-4493-a5b5-481e67984828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff6826688a849a597e48fd9c798b0f8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:31.874271 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-875f66bd-bf82-4493-a5b5-481e67984828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff6826688a849a597e48fd9c798b0f8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:31.883551 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-875f66bd-bf82-4493-a5b5-481e67984828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff6826688a849a597e48fd9c798b0f8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:31.900083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1008/2025] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:31 2022] DELETE /identity/v3/users/8ff6826688a849a597e48fd9c798b0f8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:31.904637 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc7f69-83ea-4302-933c-434a8bcad6a9 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:31.905409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc7f69-83ea-4302-933c-434a8bcad6a9 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:31.905906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc7f69-83ea-4302-933c-434a8bcad6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:31.925766 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-3dfc7f69-83ea-4302-933c-434a8bcad6a9 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:31.927029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-3dfc7f69-83ea-4302-933c-434a8bcad6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:31.962163 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f66bd-bf82-4493-a5b5-481e67984828 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:31.974322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-875f66bd-bf82-4493-a5b5-481e67984828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:32.044556 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1018/2026] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:32.055031 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc7f69-83ea-4302-933c-434a8bcad6a9 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:32.056842 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-3dfc7f69-83ea-4302-933c-434a8bcad6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:32.099463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f66bd-bf82-4493-a5b5-481e67984828 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:32.105353 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:32.106405 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:32.106656 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:32.106934 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5 admin admin] PATH_INFO: `/v3/projects/0b63644e41e0412fb5578eaf3ac3dab7` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:32.108720 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b63644e41e0412fb5578eaf3ac3dab7)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:32.111031 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:32.149128 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc7f69-83ea-4302-933c-434a8bcad6a9 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:32.153077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a9d23-446e-4221-983f-58c67ea44db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:32.153788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a9d23-446e-4221-983f-58c67ea44db6 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:32.154116 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a9d23-446e-4221-983f-58c67ea44db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:32.154388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a9d23-446e-4221-983f-58c67ea44db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:32.165793 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a9d23-446e-4221-983f-58c67ea44db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:32.167332 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a9d23-446e-4221-983f-58c67ea44db6 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:32.172941 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b63644e41e0412fb5578eaf3ac3dab7', 'request_id': 'req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.183040 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b63644e41e0412fb5578eaf3ac3dab7', 'request_id': 'req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.190346 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b63644e41e0412fb5578eaf3ac3dab7', 'request_id': 'req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.194355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1019/2027] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:32.203806 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5 admin admin] The token cache is being invalidate because project 0b63644e41e0412fb5578eaf3ac3dab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:32.204220 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.204989 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.206590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1009/2028] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:31 2022] DELETE /identity/v3/projects/0b63644e41e0412fb5578eaf3ac3dab7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:32.210690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a9d23-446e-4221-983f-58c67ea44db6 service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:32.220349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a9d23-446e-4221-983f-58c67ea44db6 service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:32.283141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578fbfd-bc3e-44c6-a4e2-a191e2830a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:32.284384 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578fbfd-bc3e-44c6-a4e2-a191e2830a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:32.284840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578fbfd-bc3e-44c6-a4e2-a191e2830a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:32.285254 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578fbfd-bc3e-44c6-a4e2-a191e2830a1c admin admin] PATH_INFO: `/v3/users/662c125de95246f098dee3100ad3a8bb` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:32.286814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578fbfd-bc3e-44c6-a4e2-a191e2830a1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=662c125de95246f098dee3100ad3a8bb)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:32.292022 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578fbfd-bc3e-44c6-a4e2-a191e2830a1c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:32.407439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0578fbfd-bc3e-44c6-a4e2-a191e2830a1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662c125de95246f098dee3100ad3a8bb'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.408380 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0578fbfd-bc3e-44c6-a4e2-a191e2830a1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662c125de95246f098dee3100ad3a8bb'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.422615 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0578fbfd-bc3e-44c6-a4e2-a191e2830a1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662c125de95246f098dee3100ad3a8bb'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.423464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0578fbfd-bc3e-44c6-a4e2-a191e2830a1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662c125de95246f098dee3100ad3a8bb'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.432355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0578fbfd-bc3e-44c6-a4e2-a191e2830a1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662c125de95246f098dee3100ad3a8bb'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.446249 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1020/2029] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:32 2022] DELETE /identity/v3/users/662c125de95246f098dee3100ad3a8bb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:32.590619 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:32.592818 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:32.615555 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b339d7-9cc2-4aa2-8a2b-d2d9542628d5 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:32.693718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af36381-acda-4817-857d-ecd7129085ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:32.694679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af36381-acda-4817-857d-ecd7129085ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:32.695164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af36381-acda-4817-857d-ecd7129085ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:32.695505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af36381-acda-4817-857d-ecd7129085ff admin admin] PATH_INFO: `/v3/projects/cbac433718c142539d5d9e3f268e661e` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:32.696777 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af36381-acda-4817-857d-ecd7129085ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbac433718c142539d5d9e3f268e661e)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:32.698982 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af36381-acda-4817-857d-ecd7129085ff admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:32.747916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1af36381-acda-4817-857d-ecd7129085ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbac433718c142539d5d9e3f268e661e', 'request_id': 'req-1af36381-acda-4817-857d-ecd7129085ff'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.756351 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1af36381-acda-4817-857d-ecd7129085ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbac433718c142539d5d9e3f268e661e', 'request_id': 'req-1af36381-acda-4817-857d-ecd7129085ff'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.762937 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1af36381-acda-4817-857d-ecd7129085ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbac433718c142539d5d9e3f268e661e', 'request_id': 'req-1af36381-acda-4817-857d-ecd7129085ff'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.775413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1af36381-acda-4817-857d-ecd7129085ff admin admin] The token cache is being invalidate because project cbac433718c142539d5d9e3f268e661e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:32.775667 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1af36381-acda-4817-857d-ecd7129085ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.776367 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1af36381-acda-4817-857d-ecd7129085ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.777974 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1010/2030] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:32 2022] DELETE /identity/v3/projects/cbac433718c142539d5d9e3f268e661e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:32.782094 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578fbfd-bc3e-44c6-a4e2-a191e2830a1c admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:32.783929 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0578fbfd-bc3e-44c6-a4e2-a191e2830a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:32.799071 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578fbfd-bc3e-44c6-a4e2-a191e2830a1c admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:32.807869 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af36381-acda-4817-857d-ecd7129085ff admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:32.809320 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1af36381-acda-4817-857d-ecd7129085ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:32.879295 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af36381-acda-4817-857d-ecd7129085ff admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:32.880189 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ad665-e5bb-4e41-a5c3-0c06e338d474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:32.881295 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ad665-e5bb-4e41-a5c3-0c06e338d474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:32.881734 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ad665-e5bb-4e41-a5c3-0c06e338d474 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:32.882177 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ad665-e5bb-4e41-a5c3-0c06e338d474 admin admin] PATH_INFO: `/v3/users/2d17e4e729a1460ca2c97d48009a378d` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:32.883534 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ad665-e5bb-4e41-a5c3-0c06e338d474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d17e4e729a1460ca2c97d48009a378d)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:32.885094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b395178-d359-44af-a807-680b22470c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:32.885924 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ad665-e5bb-4e41-a5c3-0c06e338d474 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:32.887454 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b395178-d359-44af-a807-680b22470c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:32.887797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b395178-d359-44af-a807-680b22470c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:32.888298 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b395178-d359-44af-a807-680b22470c71 admin admin] PATH_INFO: `/v3/projects/5f2c83b508ad47d29670dbea20bb9ff0` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:32.890688 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b395178-d359-44af-a807-680b22470c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2c83b508ad47d29670dbea20bb9ff0)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:32.892897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b395178-d359-44af-a807-680b22470c71 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:32.947549 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ff9ad665-e5bb-4e41-a5c3-0c06e338d474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d17e4e729a1460ca2c97d48009a378d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.948294 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ff9ad665-e5bb-4e41-a5c3-0c06e338d474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d17e4e729a1460ca2c97d48009a378d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.949200 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-7b395178-d359-44af-a807-680b22470c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2c83b508ad47d29670dbea20bb9ff0', 'request_id': 'req-7b395178-d359-44af-a807-680b22470c71'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.960436 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-7b395178-d359-44af-a807-680b22470c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2c83b508ad47d29670dbea20bb9ff0', 'request_id': 'req-7b395178-d359-44af-a807-680b22470c71'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.963104 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ff9ad665-e5bb-4e41-a5c3-0c06e338d474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d17e4e729a1460ca2c97d48009a378d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.963792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ff9ad665-e5bb-4e41-a5c3-0c06e338d474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d17e4e729a1460ca2c97d48009a378d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.966555 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-7b395178-d359-44af-a807-680b22470c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2c83b508ad47d29670dbea20bb9ff0', 'request_id': 'req-7b395178-d359-44af-a807-680b22470c71'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.971765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ff9ad665-e5bb-4e41-a5c3-0c06e338d474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d17e4e729a1460ca2c97d48009a378d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.978278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-7b395178-d359-44af-a807-680b22470c71 admin admin] The token cache is being invalidate because project 5f2c83b508ad47d29670dbea20bb9ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:32.978569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-7b395178-d359-44af-a807-680b22470c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.979215 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-7b395178-d359-44af-a807-680b22470c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.981080 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1011/2031] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:32 2022] DELETE /identity/v3/projects/5f2c83b508ad47d29670dbea20bb9ff0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:32.986505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c4f63-5ffc-4fe8-83a6-070055c3bbfe None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:32.986792 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c4f63-5ffc-4fe8-83a6-070055c3bbfe None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:32.987075 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c4f63-5ffc-4fe8-83a6-070055c3bbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:32.988755 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1021/2032] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:32 2022] DELETE /identity/v3/users/2d17e4e729a1460ca2c97d48009a378d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:33.007027 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-5b7c4f63-5ffc-4fe8-83a6-070055c3bbfe None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:33.008427 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5b7c4f63-5ffc-4fe8-83a6-070055c3bbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:33.124822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1012/2033] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:33.132922 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f8e9c-8747-4578-b830-b2b32fbe6ee1 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:33.133296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f8e9c-8747-4578-b830-b2b32fbe6ee1 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:33.133770 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f8e9c-8747-4578-b830-b2b32fbe6ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:33.156129 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-a33f8e9c-8747-4578-b830-b2b32fbe6ee1 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:33.157501 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-a33f8e9c-8747-4578-b830-b2b32fbe6ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:33.166582 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1022/2034] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:33.170840 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c4f63-5ffc-4fe8-83a6-070055c3bbfe None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:33.180780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c4f63-5ffc-4fe8-83a6-070055c3bbfe None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:33.185723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1b374-0078-48fa-b44c-9a6581fd33d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:33.186405 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1b374-0078-48fa-b44c-9a6581fd33d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:33.186686 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1b374-0078-48fa-b44c-9a6581fd33d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:33.186961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1b374-0078-48fa-b44c-9a6581fd33d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:33.188066 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1b374-0078-48fa-b44c-9a6581fd33d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:33.188436 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1b374-0078-48fa-b44c-9a6581fd33d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:33.190206 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1b374-0078-48fa-b44c-9a6581fd33d3 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:33.203991 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1013/2035] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:33.208714 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f8e9c-8747-4578-b830-b2b32fbe6ee1 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:33.218592 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f8e9c-8747-4578-b830-b2b32fbe6ee1 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:33.223332 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f2ccd-b289-4e52-87e9-a1897e30f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:33.224006 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f2ccd-b289-4e52-87e9-a1897e30f163 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:33.224317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f2ccd-b289-4e52-87e9-a1897e30f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:33.224585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f2ccd-b289-4e52-87e9-a1897e30f163 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:33.225323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f2ccd-b289-4e52-87e9-a1897e30f163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:33.227653 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f2ccd-b289-4e52-87e9-a1897e30f163 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:33.261400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1023/2036] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:33 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:33.268887 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1b374-0078-48fa-b44c-9a6581fd33d3 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:33.288775 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1b374-0078-48fa-b44c-9a6581fd33d3 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:33.391432 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a2281-30ce-489b-8c46-6157ed167ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:33.392245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a2281-30ce-489b-8c46-6157ed167ccc admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:33.392537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a2281-30ce-489b-8c46-6157ed167ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:33.392816 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a2281-30ce-489b-8c46-6157ed167ccc admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:33.393530 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a2281-30ce-489b-8c46-6157ed167ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:33.395628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a2281-30ce-489b-8c46-6157ed167ccc admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:33.443936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1014/2037] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:33 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:33.445163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f2ccd-b289-4e52-87e9-a1897e30f163 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:33.457633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f2ccd-b289-4e52-87e9-a1897e30f163 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:33.463507 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f03e2-57de-45a7-ad8c-8bdbcd0fe75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:33.464416 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f03e2-57de-45a7-ad8c-8bdbcd0fe75a admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:33.464935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f03e2-57de-45a7-ad8c-8bdbcd0fe75a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:33.465316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f03e2-57de-45a7-ad8c-8bdbcd0fe75a admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:33.470138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f03e2-57de-45a7-ad8c-8bdbcd0fe75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:33.470138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f03e2-57de-45a7-ad8c-8bdbcd0fe75a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:33.482764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1024/2038] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:33.487455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a2281-30ce-489b-8c46-6157ed167ccc admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:33.503013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a2281-30ce-489b-8c46-6157ed167ccc admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:33.508958 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e7768-c9ed-48cd-bce6-70d18d8dd4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:33.509993 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e7768-c9ed-48cd-bce6-70d18d8dd4cb admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:33.510399 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e7768-c9ed-48cd-bce6-70d18d8dd4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:33.511083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e7768-c9ed-48cd-bce6-70d18d8dd4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:33.511855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e7768-c9ed-48cd-bce6-70d18d8dd4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:33.513922 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e7768-c9ed-48cd-bce6-70d18d8dd4cb admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:33.532250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1015/2039] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:33.535376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f03e2-57de-45a7-ad8c-8bdbcd0fe75a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:33.550848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f03e2-57de-45a7-ad8c-8bdbcd0fe75a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:33.555776 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250028b-d0ea-4cd9-8d3d-f9a810d4ea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:33.556897 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250028b-d0ea-4cd9-8d3d-f9a810d4ea1c admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:33.557342 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250028b-d0ea-4cd9-8d3d-f9a810d4ea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:33.557716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250028b-d0ea-4cd9-8d3d-f9a810d4ea1c admin admin] PATH_INFO: `/v3/projects/0ad2f95fd2884c598b93b696c5e10b7c/users/503ebf94dd3e46509bb34fa9d34512c5/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:33.573167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250028b-d0ea-4cd9-8d3d-f9a810d4ea1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad2f95fd2884c598b93b696c5e10b7c, user_id=503ebf94dd3e46509bb34fa9d34512c5, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:33.582061 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250028b-d0ea-4cd9-8d3d-f9a810d4ea1c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:33.616685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1025/2040] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:33 2022] PUT /identity/v3/projects/0ad2f95fd2884c598b93b696c5e10b7c/users/503ebf94dd3e46509bb34fa9d34512c5/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:33.630119 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc7e82-3449-4402-9c78-0d677062f129 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:33.630759 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc7e82-3449-4402-9c78-0d677062f129 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:33.630759 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc7e82-3449-4402-9c78-0d677062f129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:33.668560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-5fbc7e82-3449-4402-9c78-0d677062f129 None None] MFA Rules not processed for user `503ebf94dd3e46509bb34fa9d34512c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:33.670257 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5fbc7e82-3449-4402-9c78-0d677062f129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:33.752245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1016/2041] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:33.753704 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250028b-d0ea-4cd9-8d3d-f9a810d4ea1c admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:33.784445 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc7e82-3449-4402-9c78-0d677062f129 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:33.786212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5fbc7e82-3449-4402-9c78-0d677062f129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:33.883132 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250028b-d0ea-4cd9-8d3d-f9a810d4ea1c admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:33.888827 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc76362-20c5-4678-8671-87024184401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:33.889501 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc76362-20c5-4678-8671-87024184401a admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:33.889783 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc76362-20c5-4678-8671-87024184401a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:33.890057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc76362-20c5-4678-8671-87024184401a admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:33.890768 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc76362-20c5-4678-8671-87024184401a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:33.892314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc7e82-3449-4402-9c78-0d677062f129 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:33.892724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc76362-20c5-4678-8671-87024184401a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:33.897660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416ef4f-b46f-4ef1-b0b7-fc9f2e1d4b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:33.898709 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416ef4f-b46f-4ef1-b0b7-fc9f2e1d4b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:33.899066 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416ef4f-b46f-4ef1-b0b7-fc9f2e1d4b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:33.899456 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416ef4f-b46f-4ef1-b0b7-fc9f2e1d4b78 admin admin] PATH_INFO: `/v3/projects/3144b08002f5453d9748cdab86f354fd` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:33.900968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416ef4f-b46f-4ef1-b0b7-fc9f2e1d4b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3144b08002f5453d9748cdab86f354fd)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:33.903860 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416ef4f-b46f-4ef1-b0b7-fc9f2e1d4b78 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:33.923901 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1026/2042] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:33 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:33.928507 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc76362-20c5-4678-8671-87024184401a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:33.965577 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-7416ef4f-b46f-4ef1-b0b7-fc9f2e1d4b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3144b08002f5453d9748cdab86f354fd', 'request_id': 'req-7416ef4f-b46f-4ef1-b0b7-fc9f2e1d4b78'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:33.975064 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-7416ef4f-b46f-4ef1-b0b7-fc9f2e1d4b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3144b08002f5453d9748cdab86f354fd', 'request_id': 'req-7416ef4f-b46f-4ef1-b0b7-fc9f2e1d4b78'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:33.981949 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-7416ef4f-b46f-4ef1-b0b7-fc9f2e1d4b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3144b08002f5453d9748cdab86f354fd', 'request_id': 'req-7416ef4f-b46f-4ef1-b0b7-fc9f2e1d4b78'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:33.993184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-7416ef4f-b46f-4ef1-b0b7-fc9f2e1d4b78 admin admin] The token cache is being invalidate because project 3144b08002f5453d9748cdab86f354fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:33.993470 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-7416ef4f-b46f-4ef1-b0b7-fc9f2e1d4b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:33.994136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-7416ef4f-b46f-4ef1-b0b7-fc9f2e1d4b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:33.996150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1017/2043] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:33 2022] DELETE /identity/v3/projects/3144b08002f5453d9748cdab86f354fd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:34.004260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4838cd-3edd-4508-a026-7d506df26cf2 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.004554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4838cd-3edd-4508-a026-7d506df26cf2 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.004838 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4838cd-3edd-4508-a026-7d506df26cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.013014 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc76362-20c5-4678-8671-87024184401a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.026860 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-1e4838cd-3edd-4508-a026-7d506df26cf2 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:34.029183 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1e4838cd-3edd-4508-a026-7d506df26cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:34.086229 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b786b21-26bf-48d4-bdf9-1743c2a31f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.086895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b786b21-26bf-48d4-bdf9-1743c2a31f9a admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.087173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b786b21-26bf-48d4-bdf9-1743c2a31f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.087447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b786b21-26bf-48d4-bdf9-1743c2a31f9a admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.088142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b786b21-26bf-48d4-bdf9-1743c2a31f9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.090203 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b786b21-26bf-48d4-bdf9-1743c2a31f9a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.106350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1018/2044] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:34.115463 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1027/2045] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:33 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:34.115639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247ab3-ac52-4b65-a2f5-5598078a6340 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.115639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247ab3-ac52-4b65-a2f5-5598078a6340 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.115639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247ab3-ac52-4b65-a2f5-5598078a6340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.124355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b786b21-26bf-48d4-bdf9-1743c2a31f9a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.126363 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5b786b21-26bf-48d4-bdf9-1743c2a31f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:34.138700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-7f247ab3-ac52-4b65-a2f5-5598078a6340 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:34.139915 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7f247ab3-ac52-4b65-a2f5-5598078a6340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:34.141857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b786b21-26bf-48d4-bdf9-1743c2a31f9a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.148646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb0aae-4462-4c05-a05e-4e3842328994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.149341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb0aae-4462-4c05-a05e-4e3842328994 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.149626 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb0aae-4462-4c05-a05e-4e3842328994 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.149937 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb0aae-4462-4c05-a05e-4e3842328994 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.150841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb0aae-4462-4c05-a05e-4e3842328994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.152909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb0aae-4462-4c05-a05e-4e3842328994 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.153218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1019/2046] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:34.154177 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247ab3-ac52-4b65-a2f5-5598078a6340 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.164151 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247ab3-ac52-4b65-a2f5-5598078a6340 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.169010 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db48e4e-d04c-430c-8469-b613d9dc633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.169742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db48e4e-d04c-430c-8469-b613d9dc633a admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.170024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db48e4e-d04c-430c-8469-b613d9dc633a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.170297 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db48e4e-d04c-430c-8469-b613d9dc633a admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.170405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1028/2047] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:34.171038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db48e4e-d04c-430c-8469-b613d9dc633a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:34.171309 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb0aae-4462-4c05-a05e-4e3842328994 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.171420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db48e4e-d04c-430c-8469-b613d9dc633a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.172989 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db48e4e-d04c-430c-8469-b613d9dc633a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.186135 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb0aae-4462-4c05-a05e-4e3842328994 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.198945 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1020/2048] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:34.199484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117a3af-c4c6-4e9f-8798-38c0fc725cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.200349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117a3af-c4c6-4e9f-8798-38c0fc725cbf admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.200668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117a3af-c4c6-4e9f-8798-38c0fc725cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.201424 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117a3af-c4c6-4e9f-8798-38c0fc725cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.201851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117a3af-c4c6-4e9f-8798-38c0fc725cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.203225 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db48e4e-d04c-430c-8469-b613d9dc633a admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.203669 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117a3af-c4c6-4e9f-8798-38c0fc725cbf admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.212990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db48e4e-d04c-430c-8469-b613d9dc633a admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.218111 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1029/2049] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:34.218239 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e22a1-64c1-44d2-b507-4335b3e15245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.218540 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e22a1-64c1-44d2-b507-4335b3e15245 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.218782 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e22a1-64c1-44d2-b507-4335b3e15245 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.219368 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117a3af-c4c6-4e9f-8798-38c0fc725cbf admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.219930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e22a1-64c1-44d2-b507-4335b3e15245 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.220676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e22a1-64c1-44d2-b507-4335b3e15245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.222786 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e22a1-64c1-44d2-b507-4335b3e15245 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.229519 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117a3af-c4c6-4e9f-8798-38c0fc725cbf admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.238828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d7ea1-3a9a-46a8-a2cd-b8c4e4d37186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.239744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d7ea1-3a9a-46a8-a2cd-b8c4e4d37186 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.240023 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d7ea1-3a9a-46a8-a2cd-b8c4e4d37186 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.240340 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d7ea1-3a9a-46a8-a2cd-b8c4e4d37186 admin admin] PATH_INFO: `/v3/projects/b13cbe9d73ac45158af61595ee8d32a6/users/fae029eddf714751a67d427689b8bc8a/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.257204 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d7ea1-3a9a-46a8-a2cd-b8c4e4d37186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13cbe9d73ac45158af61595ee8d32a6, user_id=fae029eddf714751a67d427689b8bc8a, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.258168 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1021/2050] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:34 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:34.261829 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e22a1-64c1-44d2-b507-4335b3e15245 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.264252 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d7ea1-3a9a-46a8-a2cd-b8c4e4d37186 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.278848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1030/2051] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:34 2022] PUT /identity/v3/projects/b13cbe9d73ac45158af61595ee8d32a6/users/fae029eddf714751a67d427689b8bc8a/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:34.293659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0a4e3-8144-46c0-ad01-a8d94bb895a4 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.293955 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0a4e3-8144-46c0-ad01-a8d94bb895a4 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.295178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0a4e3-8144-46c0-ad01-a8d94bb895a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.326316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-1cf0a4e3-8144-46c0-ad01-a8d94bb895a4 None None] MFA Rules not processed for user `fae029eddf714751a67d427689b8bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:34.328038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1cf0a4e3-8144-46c0-ad01-a8d94bb895a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:34.335116 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e22a1-64c1-44d2-b507-4335b3e15245 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.404932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1031/2052] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:34.409329 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0a4e3-8144-46c0-ad01-a8d94bb895a4 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.410065 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e041380-bc05-4d04-bc98-0ab191ade7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.411129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e041380-bc05-4d04-bc98-0ab191ade7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.411559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e041380-bc05-4d04-bc98-0ab191ade7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.411977 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e041380-bc05-4d04-bc98-0ab191ade7d4 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.413059 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e041380-bc05-4d04-bc98-0ab191ade7d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.415392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e041380-bc05-4d04-bc98-0ab191ade7d4 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.420324 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0a4e3-8144-46c0-ad01-a8d94bb895a4 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.427105 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c49921-2eb5-4567-a167-94aafc81a89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.428233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c49921-2eb5-4567-a167-94aafc81a89d admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.432863 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c49921-2eb5-4567-a167-94aafc81a89d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.433260 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c49921-2eb5-4567-a167-94aafc81a89d admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.434350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c49921-2eb5-4567-a167-94aafc81a89d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.436226 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c49921-2eb5-4567-a167-94aafc81a89d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.458693 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1022/2053] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:34 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:34.461312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e041380-bc05-4d04-bc98-0ab191ade7d4 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.479440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1032/2054] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:34 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:34.483050 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c49921-2eb5-4567-a167-94aafc81a89d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.487651 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e041380-bc05-4d04-bc98-0ab191ade7d4 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.573336 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c49921-2eb5-4567-a167-94aafc81a89d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.579143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b64c26-968d-4296-8801-8967fb503c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.580093 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b64c26-968d-4296-8801-8967fb503c7d admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.580420 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b64c26-968d-4296-8801-8967fb503c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.580695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b64c26-968d-4296-8801-8967fb503c7d admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.581482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b64c26-968d-4296-8801-8967fb503c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.583699 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b64c26-968d-4296-8801-8967fb503c7d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.605945 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e650c16-01c1-480f-9070-661b347118fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.610218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e650c16-01c1-480f-9070-661b347118fb admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.610913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e650c16-01c1-480f-9070-661b347118fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.611331 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e650c16-01c1-480f-9070-661b347118fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.612445 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e650c16-01c1-480f-9070-661b347118fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.618948 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1033/2055] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:34 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:34.620100 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b64c26-968d-4296-8801-8967fb503c7d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.627012 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e650c16-01c1-480f-9070-661b347118fb admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.633958 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b64c26-968d-4296-8801-8967fb503c7d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.656166 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1023/2056] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:34.657451 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e650c16-01c1-480f-9070-661b347118fb admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.673527 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a6999-5513-4b3b-9be9-ab99628e3871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.674292 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a6999-5513-4b3b-9be9-ab99628e3871 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.674646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a6999-5513-4b3b-9be9-ab99628e3871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.675007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a6999-5513-4b3b-9be9-ab99628e3871 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.675885 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a6999-5513-4b3b-9be9-ab99628e3871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.677692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a6999-5513-4b3b-9be9-ab99628e3871 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.681940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e650c16-01c1-480f-9070-661b347118fb admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.686742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c1ba5-8258-41c4-99e1-a77d471d880e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.687417 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c1ba5-8258-41c4-99e1-a77d471d880e admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.687698 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c1ba5-8258-41c4-99e1-a77d471d880e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.687975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c1ba5-8258-41c4-99e1-a77d471d880e admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.688739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c1ba5-8258-41c4-99e1-a77d471d880e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.690322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c1ba5-8258-41c4-99e1-a77d471d880e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.692159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1034/2057] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:34.696071 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a6999-5513-4b3b-9be9-ab99628e3871 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.703140 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1024/2058] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:34.706305 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c1ba5-8258-41c4-99e1-a77d471d880e admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.709118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a6999-5513-4b3b-9be9-ab99628e3871 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.715265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a80b6-96ce-4239-97bd-37c7eda77a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.716331 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a80b6-96ce-4239-97bd-37c7eda77a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.716708 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a80b6-96ce-4239-97bd-37c7eda77a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.716803 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c1ba5-8258-41c4-99e1-a77d471d880e admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.717141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a80b6-96ce-4239-97bd-37c7eda77a2a admin admin] PATH_INFO: `/v3/projects/805e797bcc894455affc58046b639b52/users/a05a384afbdd4fddb787c1e9d05e6a09/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.721451 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f144d9c-a9ae-4801-922c-071942b882a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.722463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f144d9c-a9ae-4801-922c-071942b882a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.722746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f144d9c-a9ae-4801-922c-071942b882a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.723020 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f144d9c-a9ae-4801-922c-071942b882a8 admin admin] PATH_INFO: `/v3/projects/4e5e64c074ee43c0ba98d5cd2ade61e3/users/536aedf751704dba8f823fc7ab539147/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.735077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a80b6-96ce-4239-97bd-37c7eda77a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=805e797bcc894455affc58046b639b52, user_id=a05a384afbdd4fddb787c1e9d05e6a09, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.738129 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a80b6-96ce-4239-97bd-37c7eda77a2a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.740997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f144d9c-a9ae-4801-922c-071942b882a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5e64c074ee43c0ba98d5cd2ade61e3, user_id=536aedf751704dba8f823fc7ab539147, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.744224 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f144d9c-a9ae-4801-922c-071942b882a8 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.754597 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1035/2059] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:34 2022] PUT /identity/v3/projects/805e797bcc894455affc58046b639b52/users/a05a384afbdd4fddb787c1e9d05e6a09/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:34.758150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a80b6-96ce-4239-97bd-37c7eda77a2a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.765022 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1025/2060] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:34 2022] PUT /identity/v3/projects/4e5e64c074ee43c0ba98d5cd2ade61e3/users/536aedf751704dba8f823fc7ab539147/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:34.776002 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c1344-ee82-44af-ba26-5be82242e212 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.776749 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c1344-ee82-44af-ba26-5be82242e212 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.777678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c1344-ee82-44af-ba26-5be82242e212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.813282 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-c01c1344-ee82-44af-ba26-5be82242e212 None None] MFA Rules not processed for user `536aedf751704dba8f823fc7ab539147`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:34.817137 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c01c1344-ee82-44af-ba26-5be82242e212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:34.841346 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a80b6-96ce-4239-97bd-37c7eda77a2a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.916527 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1026/2061] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:34.918172 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c1344-ee82-44af-ba26-5be82242e212 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.930627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96161395-88ca-4b0b-a71b-fdaed2ba0454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.931938 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96161395-88ca-4b0b-a71b-fdaed2ba0454 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.932322 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96161395-88ca-4b0b-a71b-fdaed2ba0454 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.932607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96161395-88ca-4b0b-a71b-fdaed2ba0454 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.934383 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96161395-88ca-4b0b-a71b-fdaed2ba0454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.936759 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96161395-88ca-4b0b-a71b-fdaed2ba0454 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.949420 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1036/2062] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:34.953711 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96161395-88ca-4b0b-a71b-fdaed2ba0454 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.965068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96161395-88ca-4b0b-a71b-fdaed2ba0454 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.977729 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97138c5-c4de-4c05-b9cd-7ffec200c4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.978823 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97138c5-c4de-4c05-b9cd-7ffec200c4b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.979175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97138c5-c4de-4c05-b9cd-7ffec200c4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.979552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97138c5-c4de-4c05-b9cd-7ffec200c4b8 admin admin] PATH_INFO: `/v3/projects/805e797bcc894455affc58046b639b52/users/a05a384afbdd4fddb787c1e9d05e6a09/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.985402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97138c5-c4de-4c05-b9cd-7ffec200c4b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805e797bcc894455affc58046b639b52, user_id=a05a384afbdd4fddb787c1e9d05e6a09, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.987631 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97138c5-c4de-4c05-b9cd-7ffec200c4b8 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:35.010627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1037/2063] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:34 2022] PUT /identity/v3/projects/805e797bcc894455affc58046b639b52/users/a05a384afbdd4fddb787c1e9d05e6a09/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:35.020251 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c1344-ee82-44af-ba26-5be82242e212 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:35.023488 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aefacf-40f9-4841-a58a-a5290da014af None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:35.023937 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aefacf-40f9-4841-a58a-a5290da014af None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:35.024027 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aefacf-40f9-4841-a58a-a5290da014af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:35.060420 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-10aefacf-40f9-4841-a58a-a5290da014af None None] MFA Rules not processed for user `a05a384afbdd4fddb787c1e9d05e6a09`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:35.062110 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-10aefacf-40f9-4841-a58a-a5290da014af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:35.140535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa78e8-d355-4a67-8f2a-784becec09d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:35.141921 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa78e8-d355-4a67-8f2a-784becec09d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:35.142204 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa78e8-d355-4a67-8f2a-784becec09d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:35.142478 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa78e8-d355-4a67-8f2a-784becec09d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:35.143176 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa78e8-d355-4a67-8f2a-784becec09d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:35.147951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa78e8-d355-4a67-8f2a-784becec09d2 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:35.151861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1038/2064] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:35.163771 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aefacf-40f9-4841-a58a-a5290da014af None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:35.165565 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-10aefacf-40f9-4841-a58a-a5290da014af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:35.200406 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1027/2065] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:34 2022] POST /identity/v3/projects => generated 365 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:35.204499 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa78e8-d355-4a67-8f2a-784becec09d2 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:35.287183 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aefacf-40f9-4841-a58a-a5290da014af None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:35.312237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa78e8-d355-4a67-8f2a-784becec09d2 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:35.319494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd68513-4e27-4100-b88e-5d895e5b869c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:35.320590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd68513-4e27-4100-b88e-5d895e5b869c admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:35.320948 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd68513-4e27-4100-b88e-5d895e5b869c admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:35.321732 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd68513-4e27-4100-b88e-5d895e5b869c admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:35.322107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd68513-4e27-4100-b88e-5d895e5b869c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:35.324770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd68513-4e27-4100-b88e-5d895e5b869c admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:35.349463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1028/2066] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:35 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:35.354367 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd68513-4e27-4100-b88e-5d895e5b869c admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:35.357274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef72585-9ad1-43ae-ad48-655fbbab1d64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:35.357945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef72585-9ad1-43ae-ad48-655fbbab1d64 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:35.358223 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef72585-9ad1-43ae-ad48-655fbbab1d64 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:35.358543 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef72585-9ad1-43ae-ad48-655fbbab1d64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:35.360994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4ef72585-9ad1-43ae-ad48-655fbbab1d64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:35.364650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd68513-4e27-4100-b88e-5d895e5b869c admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:35.370756 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df501e6-8239-4424-90b5-5d0781ab4862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:35.372308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df501e6-8239-4424-90b5-5d0781ab4862 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:35.372678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df501e6-8239-4424-90b5-5d0781ab4862 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:35.372800 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df501e6-8239-4424-90b5-5d0781ab4862 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:35.373662 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df501e6-8239-4424-90b5-5d0781ab4862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:35.375332 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df501e6-8239-4424-90b5-5d0781ab4862 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:35.389131 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1029/2067] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:35.390234 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df501e6-8239-4424-90b5-5d0781ab4862 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:35.400712 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df501e6-8239-4424-90b5-5d0781ab4862 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:35.405941 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b591b3-6c6e-458c-85ab-a83d7f144bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:35.406860 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b591b3-6c6e-458c-85ab-a83d7f144bad admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:35.407149 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b591b3-6c6e-458c-85ab-a83d7f144bad admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:35.407452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b591b3-6c6e-458c-85ab-a83d7f144bad admin admin] PATH_INFO: `/v3/projects/f5d9e48176a4415dafc978c5539d7f98/users/612f39e5cf644a32b848ee43159cfd13/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:35.424157 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b591b3-6c6e-458c-85ab-a83d7f144bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d9e48176a4415dafc978c5539d7f98, user_id=612f39e5cf644a32b848ee43159cfd13, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:35.426945 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b591b3-6c6e-458c-85ab-a83d7f144bad admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:35.434040 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef72585-9ad1-43ae-ad48-655fbbab1d64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:35.436328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef72585-9ad1-43ae-ad48-655fbbab1d64 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:35.444518 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1030/2068] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:35 2022] PUT /identity/v3/projects/f5d9e48176a4415dafc978c5539d7f98/users/612f39e5cf644a32b848ee43159cfd13/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:35.448740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b591b3-6c6e-458c-85ab-a83d7f144bad admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:35.449996 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1039/2069] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:53:35.535772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b591b3-6c6e-458c-85ab-a83d7f144bad admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:35.540557 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc851be6-c91c-4401-8e3e-1160a2c9ef31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:35.541347 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851be6-c91c-4401-8e3e-1160a2c9ef31 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:35.541625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851be6-c91c-4401-8e3e-1160a2c9ef31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:35.541898 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851be6-c91c-4401-8e3e-1160a2c9ef31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:35.543314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc851be6-c91c-4401-8e3e-1160a2c9ef31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:35.544320 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc851be6-c91c-4401-8e3e-1160a2c9ef31 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:35.555435 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1031/2070] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:35.560748 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef72585-9ad1-43ae-ad48-655fbbab1d64 service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:35.575362 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef72585-9ad1-43ae-ad48-655fbbab1d64 service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:35.590386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a10b2b-d1a7-4288-8291-fd59f27e6e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:35.591378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a10b2b-d1a7-4288-8291-fd59f27e6e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:35.591725 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a10b2b-d1a7-4288-8291-fd59f27e6e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:35.591996 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a10b2b-d1a7-4288-8291-fd59f27e6e33 admin admin] PATH_INFO: `/v3/projects/f5d9e48176a4415dafc978c5539d7f98/users/612f39e5cf644a32b848ee43159cfd13/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:35.594168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a10b2b-d1a7-4288-8291-fd59f27e6e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d9e48176a4415dafc978c5539d7f98, user_id=612f39e5cf644a32b848ee43159cfd13, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:35.597030 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a10b2b-d1a7-4288-8291-fd59f27e6e33 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:35.608306 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1040/2071] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:35 2022] PUT /identity/v3/projects/f5d9e48176a4415dafc978c5539d7f98/users/612f39e5cf644a32b848ee43159cfd13/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:35.620450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e24ed-8669-4d48-a5aa-d4783262cbe7 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:35.620790 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e24ed-8669-4d48-a5aa-d4783262cbe7 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:35.621135 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e24ed-8669-4d48-a5aa-d4783262cbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:35.650002 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e12e24ed-8669-4d48-a5aa-d4783262cbe7 None None] MFA Rules not processed for user `612f39e5cf644a32b848ee43159cfd13`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:35.651342 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e12e24ed-8669-4d48-a5aa-d4783262cbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:35.744374 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1032/2072] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:35.760365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a10b2b-d1a7-4288-8291-fd59f27e6e33 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:35.828313 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a10b2b-d1a7-4288-8291-fd59f27e6e33 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:35.834233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c81df8-9da2-4587-94a2-9ddcdd7c39b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:35.835332 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c81df8-9da2-4587-94a2-9ddcdd7c39b9 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:35.835798 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c81df8-9da2-4587-94a2-9ddcdd7c39b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:35.836420 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c81df8-9da2-4587-94a2-9ddcdd7c39b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:35.853768 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c81df8-9da2-4587-94a2-9ddcdd7c39b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:35.855905 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c81df8-9da2-4587-94a2-9ddcdd7c39b9 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:35.880544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1041/2073] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:35.953470 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e24ed-8669-4d48-a5aa-d4783262cbe7 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:35.962916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e24ed-8669-4d48-a5aa-d4783262cbe7 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:35.966429 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0a5f9-eccb-473e-877e-fca85b24030b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:35.967074 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0a5f9-eccb-473e-877e-fca85b24030b service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:35.967355 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0a5f9-eccb-473e-877e-fca85b24030b service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:35.967651 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0a5f9-eccb-473e-877e-fca85b24030b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:36.025744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0a5f9-eccb-473e-877e-fca85b24030b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:36.027478 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0a5f9-eccb-473e-877e-fca85b24030b service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:36.038426 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1033/2074] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:38.063652 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c81df8-9da2-4587-94a2-9ddcdd7c39b9 service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:38.072739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c81df8-9da2-4587-94a2-9ddcdd7c39b9 service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:38.076494 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99393335-826e-493f-b497-88910c8d9d1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:38.077137 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99393335-826e-493f-b497-88910c8d9d1d service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:38.077417 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99393335-826e-493f-b497-88910c8d9d1d service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:38.077744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99393335-826e-493f-b497-88910c8d9d1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:38.140182 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99393335-826e-493f-b497-88910c8d9d1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:38.141750 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99393335-826e-493f-b497-88910c8d9d1d service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:38.151455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1042/2075] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:38.262027 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba6148-6eff-4b4c-9ab7-f05153673c77 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:38.262756 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba6148-6eff-4b4c-9ab7-f05153673c77 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:38.262756 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba6148-6eff-4b4c-9ab7-f05153673c77 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:38.264397 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1034/2076] 10.222.0.90 () {54 vars in 921 bytes} [Wed Nov 2 12:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:53:38.270159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7087d83-c385-4dae-b41e-8b162638c17e None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:38.271904 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7087d83-c385-4dae-b41e-8b162638c17e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:38.272302 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7087d83-c385-4dae-b41e-8b162638c17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:38.293677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-d7087d83-c385-4dae-b41e-8b162638c17e None None] MFA Rules not processed for user `fbcda58f298444eebf4f08ce01deffc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:38.295143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-d7087d83-c385-4dae-b41e-8b162638c17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:38.366987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1043/2077] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Nov 2 12:53:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:38.380231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba6148-6eff-4b4c-9ab7-f05153673c77 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:38.382207 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-05ba6148-6eff-4b4c-9ab7-f05153673c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:38.401258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba6148-6eff-4b4c-9ab7-f05153673c77 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:38.406941 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969be26-1489-440c-a5ad-99132270282e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:38.407658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969be26-1489-440c-a5ad-99132270282e service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:38.408005 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969be26-1489-440c-a5ad-99132270282e service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:38.408389 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969be26-1489-440c-a5ad-99132270282e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:38.418183 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969be26-1489-440c-a5ad-99132270282e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:38.419860 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969be26-1489-440c-a5ad-99132270282e service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:38.430381 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1035/2078] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:38.802621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7087d83-c385-4dae-b41e-8b162638c17e None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:38.804276 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-d7087d83-c385-4dae-b41e-8b162638c17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:38.824297 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7087d83-c385-4dae-b41e-8b162638c17e None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:38.829065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31109ba8-1fdd-4ae3-8ac4-32b14a9a0edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:38.832904 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31109ba8-1fdd-4ae3-8ac4-32b14a9a0edd service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:38.833308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31109ba8-1fdd-4ae3-8ac4-32b14a9a0edd service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:38.833727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31109ba8-1fdd-4ae3-8ac4-32b14a9a0edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:38.927201 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31109ba8-1fdd-4ae3-8ac4-32b14a9a0edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:38.928774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31109ba8-1fdd-4ae3-8ac4-32b14a9a0edd service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:38.939948 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1044/2079] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:51.826029 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969be26-1489-440c-a5ad-99132270282e service nova] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:51.890400 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969be26-1489-440c-a5ad-99132270282e service nova] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:51.895019 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d94c79-da8d-45b3-83d8-986b06b60c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:51.896240 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d94c79-da8d-45b3-83d8-986b06b60c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:51.896594 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d94c79-da8d-45b3-83d8-986b06b60c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:51.896867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d94c79-da8d-45b3-83d8-986b06b60c66 admin admin] PATH_INFO: `/v3/users/503ebf94dd3e46509bb34fa9d34512c5` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:51.898249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d94c79-da8d-45b3-83d8-986b06b60c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=503ebf94dd3e46509bb34fa9d34512c5)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:51.900165 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d94c79-da8d-45b3-83d8-986b06b60c66 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:51.951280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-16d94c79-da8d-45b3-83d8-986b06b60c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '503ebf94dd3e46509bb34fa9d34512c5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:51.951939 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-16d94c79-da8d-45b3-83d8-986b06b60c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '503ebf94dd3e46509bb34fa9d34512c5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:51.963742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-16d94c79-da8d-45b3-83d8-986b06b60c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '503ebf94dd3e46509bb34fa9d34512c5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:51.964467 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-16d94c79-da8d-45b3-83d8-986b06b60c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '503ebf94dd3e46509bb34fa9d34512c5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:51.973682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-16d94c79-da8d-45b3-83d8-986b06b60c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '503ebf94dd3e46509bb34fa9d34512c5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:51.988025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1036/2080] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:51 2022] DELETE /identity/v3/users/503ebf94dd3e46509bb34fa9d34512c5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:51.992779 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc21db3-2228-4e23-a36b-0411ed3524b9 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:51.993248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc21db3-2228-4e23-a36b-0411ed3524b9 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:51.993356 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc21db3-2228-4e23-a36b-0411ed3524b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:52.012145 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-0fc21db3-2228-4e23-a36b-0411ed3524b9 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:52.013401 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0fc21db3-2228-4e23-a36b-0411ed3524b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:52.074052 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1045/2081] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:52.084023 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d94c79-da8d-45b3-83d8-986b06b60c66 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:52.085291 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-16d94c79-da8d-45b3-83d8-986b06b60c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:52.148128 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d94c79-da8d-45b3-83d8-986b06b60c66 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:52.152422 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7757e-be00-444c-885c-325c56eeb793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:52.153366 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7757e-be00-444c-885c-325c56eeb793 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:52.153649 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7757e-be00-444c-885c-325c56eeb793 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:52.153920 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7757e-be00-444c-885c-325c56eeb793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:52.164660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7757e-be00-444c-885c-325c56eeb793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:52.166344 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7757e-be00-444c-885c-325c56eeb793 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:52.176965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1037/2082] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:52.509694 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc21db3-2228-4e23-a36b-0411ed3524b9 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:52.511230 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0fc21db3-2228-4e23-a36b-0411ed3524b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:52.528605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc21db3-2228-4e23-a36b-0411ed3524b9 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:52.534292 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9342c19-1da1-4e6c-86ae-f64902381eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:52.535192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9342c19-1da1-4e6c-86ae-f64902381eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:52.535471 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9342c19-1da1-4e6c-86ae-f64902381eda admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:52.535741 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9342c19-1da1-4e6c-86ae-f64902381eda admin admin] PATH_INFO: `/v3/projects/0ad2f95fd2884c598b93b696c5e10b7c` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:52.538065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9342c19-1da1-4e6c-86ae-f64902381eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad2f95fd2884c598b93b696c5e10b7c)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:52.540046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9342c19-1da1-4e6c-86ae-f64902381eda admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:52.589524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e9342c19-1da1-4e6c-86ae-f64902381eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad2f95fd2884c598b93b696c5e10b7c', 'request_id': 'req-e9342c19-1da1-4e6c-86ae-f64902381eda'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:52.598238 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e9342c19-1da1-4e6c-86ae-f64902381eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad2f95fd2884c598b93b696c5e10b7c', 'request_id': 'req-e9342c19-1da1-4e6c-86ae-f64902381eda'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:52.606253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e9342c19-1da1-4e6c-86ae-f64902381eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad2f95fd2884c598b93b696c5e10b7c', 'request_id': 'req-e9342c19-1da1-4e6c-86ae-f64902381eda'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:52.617154 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e9342c19-1da1-4e6c-86ae-f64902381eda admin admin] The token cache is being invalidate because project 0ad2f95fd2884c598b93b696c5e10b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:52.617448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e9342c19-1da1-4e6c-86ae-f64902381eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:52.618104 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e9342c19-1da1-4e6c-86ae-f64902381eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:52.619660 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1046/2083] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:52 2022] DELETE /identity/v3/projects/0ad2f95fd2884c598b93b696c5e10b7c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:52.623933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7757e-be00-444c-885c-325c56eeb793 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:52.634634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7757e-be00-444c-885c-325c56eeb793 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:52.694655 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd967796-e209-4cbe-bbcc-2c58bcd77720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:52.695564 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd967796-e209-4cbe-bbcc-2c58bcd77720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:52.695837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd967796-e209-4cbe-bbcc-2c58bcd77720 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:52.696105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd967796-e209-4cbe-bbcc-2c58bcd77720 admin admin] PATH_INFO: `/v3/users/fae029eddf714751a67d427689b8bc8a` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:52.697340 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd967796-e209-4cbe-bbcc-2c58bcd77720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae029eddf714751a67d427689b8bc8a)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:52.699344 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd967796-e209-4cbe-bbcc-2c58bcd77720 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:52.742921 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-cd967796-e209-4cbe-bbcc-2c58bcd77720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae029eddf714751a67d427689b8bc8a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:52.743551 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-cd967796-e209-4cbe-bbcc-2c58bcd77720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae029eddf714751a67d427689b8bc8a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:52.756233 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-cd967796-e209-4cbe-bbcc-2c58bcd77720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae029eddf714751a67d427689b8bc8a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:52.757003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-cd967796-e209-4cbe-bbcc-2c58bcd77720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae029eddf714751a67d427689b8bc8a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:52.765826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-cd967796-e209-4cbe-bbcc-2c58bcd77720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae029eddf714751a67d427689b8bc8a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:52.778265 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1038/2084] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:52 2022] DELETE /identity/v3/users/fae029eddf714751a67d427689b8bc8a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:53.073223 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9342c19-1da1-4e6c-86ae-f64902381eda admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:53.075065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e9342c19-1da1-4e6c-86ae-f64902381eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:53.089118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9342c19-1da1-4e6c-86ae-f64902381eda admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:53.145474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc9976-cea5-41e0-b060-50f0a97fdf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:53.146714 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc9976-cea5-41e0-b060-50f0a97fdf78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:53.146976 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc9976-cea5-41e0-b060-50f0a97fdf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:53.147609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc9976-cea5-41e0-b060-50f0a97fdf78 admin admin] PATH_INFO: `/v3/projects/b13cbe9d73ac45158af61595ee8d32a6` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:53.149097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc9976-cea5-41e0-b060-50f0a97fdf78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13cbe9d73ac45158af61595ee8d32a6)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:53.151033 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc9976-cea5-41e0-b060-50f0a97fdf78 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:53.203690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dccc9976-cea5-41e0-b060-50f0a97fdf78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13cbe9d73ac45158af61595ee8d32a6', 'request_id': 'req-dccc9976-cea5-41e0-b060-50f0a97fdf78'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.212990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dccc9976-cea5-41e0-b060-50f0a97fdf78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13cbe9d73ac45158af61595ee8d32a6', 'request_id': 'req-dccc9976-cea5-41e0-b060-50f0a97fdf78'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.219579 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dccc9976-cea5-41e0-b060-50f0a97fdf78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13cbe9d73ac45158af61595ee8d32a6', 'request_id': 'req-dccc9976-cea5-41e0-b060-50f0a97fdf78'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.230488 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dccc9976-cea5-41e0-b060-50f0a97fdf78 admin admin] The token cache is being invalidate because project b13cbe9d73ac45158af61595ee8d32a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:53.230821 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dccc9976-cea5-41e0-b060-50f0a97fdf78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.231459 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dccc9976-cea5-41e0-b060-50f0a97fdf78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.233772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1047/2085] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:53 2022] DELETE /identity/v3/projects/b13cbe9d73ac45158af61595ee8d32a6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:53.238674 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd967796-e209-4cbe-bbcc-2c58bcd77720 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:53.240007 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-cd967796-e209-4cbe-bbcc-2c58bcd77720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:53.253436 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd967796-e209-4cbe-bbcc-2c58bcd77720 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:53.320591 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b58efa-fc3b-415c-aa13-3d7cc47c787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:53.321596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b58efa-fc3b-415c-aa13-3d7cc47c787b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:53.321976 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b58efa-fc3b-415c-aa13-3d7cc47c787b admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:53.322352 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b58efa-fc3b-415c-aa13-3d7cc47c787b admin admin] PATH_INFO: `/v3/users/a05a384afbdd4fddb787c1e9d05e6a09` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:53.323784 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b58efa-fc3b-415c-aa13-3d7cc47c787b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05a384afbdd4fddb787c1e9d05e6a09)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:53.326384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b58efa-fc3b-415c-aa13-3d7cc47c787b admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:53.380943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc9976-cea5-41e0-b060-50f0a97fdf78 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:53.382646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-dccc9976-cea5-41e0-b060-50f0a97fdf78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:53.388708 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-67b58efa-fc3b-415c-aa13-3d7cc47c787b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05a384afbdd4fddb787c1e9d05e6a09'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.389496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-67b58efa-fc3b-415c-aa13-3d7cc47c787b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05a384afbdd4fddb787c1e9d05e6a09'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.396481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc9976-cea5-41e0-b060-50f0a97fdf78 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:53.402163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2781f-b894-4455-aef7-3ea1c0c9257e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:53.402354 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-67b58efa-fc3b-415c-aa13-3d7cc47c787b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05a384afbdd4fddb787c1e9d05e6a09'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.403212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-67b58efa-fc3b-415c-aa13-3d7cc47c787b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05a384afbdd4fddb787c1e9d05e6a09'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.403325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2781f-b894-4455-aef7-3ea1c0c9257e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:53.403626 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2781f-b894-4455-aef7-3ea1c0c9257e admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:53.403904 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2781f-b894-4455-aef7-3ea1c0c9257e admin admin] PATH_INFO: `/v3/users/536aedf751704dba8f823fc7ab539147` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:53.405192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2781f-b894-4455-aef7-3ea1c0c9257e admin admin] RBAC: Authorizing `identity:delete_user(user_id=536aedf751704dba8f823fc7ab539147)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:53.407132 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2781f-b894-4455-aef7-3ea1c0c9257e admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:53.413581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-67b58efa-fc3b-415c-aa13-3d7cc47c787b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05a384afbdd4fddb787c1e9d05e6a09'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.427200 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1039/2086] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:53 2022] DELETE /identity/v3/users/a05a384afbdd4fddb787c1e9d05e6a09 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:53.458907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-f5f2781f-b894-4455-aef7-3ea1c0c9257e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536aedf751704dba8f823fc7ab539147'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.460604 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-f5f2781f-b894-4455-aef7-3ea1c0c9257e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536aedf751704dba8f823fc7ab539147'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.474282 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-f5f2781f-b894-4455-aef7-3ea1c0c9257e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536aedf751704dba8f823fc7ab539147'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.475410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-f5f2781f-b894-4455-aef7-3ea1c0c9257e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536aedf751704dba8f823fc7ab539147'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.485581 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-f5f2781f-b894-4455-aef7-3ea1c0c9257e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536aedf751704dba8f823fc7ab539147'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.513136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1048/2087] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:53 2022] DELETE /identity/v3/users/536aedf751704dba8f823fc7ab539147 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:53.517850 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826d3c6-3aa9-409b-96f5-a290d5e71e97 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:53.518138 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826d3c6-3aa9-409b-96f5-a290d5e71e97 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:53.518440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826d3c6-3aa9-409b-96f5-a290d5e71e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:53.538021 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-a826d3c6-3aa9-409b-96f5-a290d5e71e97 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:53.539609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a826d3c6-3aa9-409b-96f5-a290d5e71e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:53.601152 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1040/2088] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:53.617092 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2781f-b894-4455-aef7-3ea1c0c9257e admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:53.618755 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f5f2781f-b894-4455-aef7-3ea1c0c9257e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:53.679320 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2781f-b894-4455-aef7-3ea1c0c9257e admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:53.683184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b8ca9-c45d-4183-8e74-47f7fc3bb6fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:53.683857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b8ca9-c45d-4183-8e74-47f7fc3bb6fe service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:53.684158 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b8ca9-c45d-4183-8e74-47f7fc3bb6fe service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:53.684455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b8ca9-c45d-4183-8e74-47f7fc3bb6fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:53.694625 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b8ca9-c45d-4183-8e74-47f7fc3bb6fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:53.696460 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b8ca9-c45d-4183-8e74-47f7fc3bb6fe service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:53.707756 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1049/2089] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:53.756945 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826d3c6-3aa9-409b-96f5-a290d5e71e97 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:53.758939 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a826d3c6-3aa9-409b-96f5-a290d5e71e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:53.772479 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826d3c6-3aa9-409b-96f5-a290d5e71e97 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:53.777850 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e525d7-aa85-4f2e-8f11-8fe2649a4ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:53.778851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e525d7-aa85-4f2e-8f11-8fe2649a4ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:53.779235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e525d7-aa85-4f2e-8f11-8fe2649a4ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:53.779607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e525d7-aa85-4f2e-8f11-8fe2649a4ca6 admin admin] PATH_INFO: `/v3/projects/805e797bcc894455affc58046b639b52` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:53.782356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e525d7-aa85-4f2e-8f11-8fe2649a4ca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=805e797bcc894455affc58046b639b52)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:53.784409 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e525d7-aa85-4f2e-8f11-8fe2649a4ca6 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:53.840539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-56e525d7-aa85-4f2e-8f11-8fe2649a4ca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805e797bcc894455affc58046b639b52', 'request_id': 'req-56e525d7-aa85-4f2e-8f11-8fe2649a4ca6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.849278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-56e525d7-aa85-4f2e-8f11-8fe2649a4ca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805e797bcc894455affc58046b639b52', 'request_id': 'req-56e525d7-aa85-4f2e-8f11-8fe2649a4ca6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.856729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-56e525d7-aa85-4f2e-8f11-8fe2649a4ca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805e797bcc894455affc58046b639b52', 'request_id': 'req-56e525d7-aa85-4f2e-8f11-8fe2649a4ca6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.868411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-56e525d7-aa85-4f2e-8f11-8fe2649a4ca6 admin admin] The token cache is being invalidate because project 805e797bcc894455affc58046b639b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:53.868705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-56e525d7-aa85-4f2e-8f11-8fe2649a4ca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.869368 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-56e525d7-aa85-4f2e-8f11-8fe2649a4ca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.871250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1041/2090] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:53 2022] DELETE /identity/v3/projects/805e797bcc894455affc58046b639b52 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:53.876943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7e6e5-49c6-4b7e-9c46-ba1655447b08 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:53.877231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7e6e5-49c6-4b7e-9c46-ba1655447b08 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:53.877505 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7e6e5-49c6-4b7e-9c46-ba1655447b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:53.897596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-f5b7e6e5-49c6-4b7e-9c46-ba1655447b08 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:53.898946 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f5b7e6e5-49c6-4b7e-9c46-ba1655447b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:53.963306 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1050/2091] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:53.971401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6d33-b81b-49b8-98fe-b59afd0f2b4f None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:53.972026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6d33-b81b-49b8-98fe-b59afd0f2b4f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:53.972557 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6d33-b81b-49b8-98fe-b59afd0f2b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:53.993442 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-a51e6d33-b81b-49b8-98fe-b59afd0f2b4f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:53.994739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a51e6d33-b81b-49b8-98fe-b59afd0f2b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:54.015549 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1042/2092] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:54.020282 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7e6e5-49c6-4b7e-9c46-ba1655447b08 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.025089 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6d33-b81b-49b8-98fe-b59afd0f2b4f None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.026755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a51e6d33-b81b-49b8-98fe-b59afd0f2b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:54.035622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7e6e5-49c6-4b7e-9c46-ba1655447b08 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.043792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3f04d-ffe2-4b8f-b128-8c94d2a29d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.044655 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f04d-ffe2-4b8f-b128-8c94d2a29d22 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.044931 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f04d-ffe2-4b8f-b128-8c94d2a29d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.045197 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f04d-ffe2-4b8f-b128-8c94d2a29d22 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.045924 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3f04d-ffe2-4b8f-b128-8c94d2a29d22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:54.046797 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3f04d-ffe2-4b8f-b128-8c94d2a29d22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.048607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3f04d-ffe2-4b8f-b128-8c94d2a29d22 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.051333 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6d33-b81b-49b8-98fe-b59afd0f2b4f None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.057807 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895f0bb-000d-4868-9dda-0b5396ed1690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.059020 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895f0bb-000d-4868-9dda-0b5396ed1690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.059236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895f0bb-000d-4868-9dda-0b5396ed1690 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.059673 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895f0bb-000d-4868-9dda-0b5396ed1690 admin admin] PATH_INFO: `/v3/projects/4e5e64c074ee43c0ba98d5cd2ade61e3` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.062131 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1051/2093] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:54.064885 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895f0bb-000d-4868-9dda-0b5396ed1690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e5e64c074ee43c0ba98d5cd2ade61e3)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.066622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3f04d-ffe2-4b8f-b128-8c94d2a29d22 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.069027 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895f0bb-000d-4868-9dda-0b5396ed1690 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.077539 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3f04d-ffe2-4b8f-b128-8c94d2a29d22 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.082753 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff3926-28f3-43ce-8415-067e48ab76b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.083452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff3926-28f3-43ce-8415-067e48ab76b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.083736 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff3926-28f3-43ce-8415-067e48ab76b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.084006 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff3926-28f3-43ce-8415-067e48ab76b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.084765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff3926-28f3-43ce-8415-067e48ab76b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.086696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff3926-28f3-43ce-8415-067e48ab76b4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.117826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1052/2094] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:54 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:54.119175 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-3895f0bb-000d-4868-9dda-0b5396ed1690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e5e64c074ee43c0ba98d5cd2ade61e3', 'request_id': 'req-3895f0bb-000d-4868-9dda-0b5396ed1690'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:54.122526 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff3926-28f3-43ce-8415-067e48ab76b4 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.130264 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-3895f0bb-000d-4868-9dda-0b5396ed1690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e5e64c074ee43c0ba98d5cd2ade61e3', 'request_id': 'req-3895f0bb-000d-4868-9dda-0b5396ed1690'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:54.137132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-3895f0bb-000d-4868-9dda-0b5396ed1690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e5e64c074ee43c0ba98d5cd2ade61e3', 'request_id': 'req-3895f0bb-000d-4868-9dda-0b5396ed1690'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:54.149745 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-3895f0bb-000d-4868-9dda-0b5396ed1690 admin admin] The token cache is being invalidate because project 4e5e64c074ee43c0ba98d5cd2ade61e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:54.150031 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-3895f0bb-000d-4868-9dda-0b5396ed1690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:54.150927 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-3895f0bb-000d-4868-9dda-0b5396ed1690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:54.152675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1043/2095] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:54 2022] DELETE /identity/v3/projects/4e5e64c074ee43c0ba98d5cd2ade61e3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:54.156698 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895f0bb-000d-4868-9dda-0b5396ed1690 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.158105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-3895f0bb-000d-4868-9dda-0b5396ed1690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:54.188964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff3926-28f3-43ce-8415-067e48ab76b4 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.193681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f974f4-0176-4bfe-8e95-cb3324c6b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.194345 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f974f4-0176-4bfe-8e95-cb3324c6b10e admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.194621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f974f4-0176-4bfe-8e95-cb3324c6b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.194933 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f974f4-0176-4bfe-8e95-cb3324c6b10e admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.195853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f974f4-0176-4bfe-8e95-cb3324c6b10e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.197910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f974f4-0176-4bfe-8e95-cb3324c6b10e admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.220807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1053/2096] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:54 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:54.224384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895f0bb-000d-4868-9dda-0b5396ed1690 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.225159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f974f4-0176-4bfe-8e95-cb3324c6b10e admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.226827 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-50f974f4-0176-4bfe-8e95-cb3324c6b10e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:54.229350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2bb65-65b7-4e1e-8df1-2cc598351976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.230259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2bb65-65b7-4e1e-8df1-2cc598351976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.230606 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2bb65-65b7-4e1e-8df1-2cc598351976 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.230833 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2bb65-65b7-4e1e-8df1-2cc598351976 admin admin] PATH_INFO: `/v3/users/612f39e5cf644a32b848ee43159cfd13` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.232036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2bb65-65b7-4e1e-8df1-2cc598351976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=612f39e5cf644a32b848ee43159cfd13)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.234014 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2bb65-65b7-4e1e-8df1-2cc598351976 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.238909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f974f4-0176-4bfe-8e95-cb3324c6b10e admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.243909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55942c1a-6ad1-41c2-8a12-e3566538871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.244612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55942c1a-6ad1-41c2-8a12-e3566538871d admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.244894 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55942c1a-6ad1-41c2-8a12-e3566538871d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.245169 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55942c1a-6ad1-41c2-8a12-e3566538871d admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.245904 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55942c1a-6ad1-41c2-8a12-e3566538871d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.247656 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55942c1a-6ad1-41c2-8a12-e3566538871d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.258306 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1054/2097] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:54.262920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55942c1a-6ad1-41c2-8a12-e3566538871d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.273858 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55942c1a-6ad1-41c2-8a12-e3566538871d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.278849 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f61a00-c04a-4f13-b29e-45390793b8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.279497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f61a00-c04a-4f13-b29e-45390793b8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.279770 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f61a00-c04a-4f13-b29e-45390793b8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.280039 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f61a00-c04a-4f13-b29e-45390793b8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.281105 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f61a00-c04a-4f13-b29e-45390793b8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.281524 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-27a2bb65-65b7-4e1e-8df1-2cc598351976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612f39e5cf644a32b848ee43159cfd13'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:54.282195 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-27a2bb65-65b7-4e1e-8df1-2cc598351976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612f39e5cf644a32b848ee43159cfd13'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:54.282701 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f61a00-c04a-4f13-b29e-45390793b8b8 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.293289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1055/2098] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:54.294095 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-27a2bb65-65b7-4e1e-8df1-2cc598351976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612f39e5cf644a32b848ee43159cfd13'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:54.294827 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-27a2bb65-65b7-4e1e-8df1-2cc598351976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612f39e5cf644a32b848ee43159cfd13'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:54.297475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f61a00-c04a-4f13-b29e-45390793b8b8 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.299232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-c2f61a00-c04a-4f13-b29e-45390793b8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:54.303386 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-27a2bb65-65b7-4e1e-8df1-2cc598351976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612f39e5cf644a32b848ee43159cfd13'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:54.311833 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f61a00-c04a-4f13-b29e-45390793b8b8 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.316285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1044/2099] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:54 2022] DELETE /identity/v3/users/612f39e5cf644a32b848ee43159cfd13 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:54.316433 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f44c2-ae30-4b87-a631-8af7012f0916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.317462 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f44c2-ae30-4b87-a631-8af7012f0916 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.317732 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f44c2-ae30-4b87-a631-8af7012f0916 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.317996 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f44c2-ae30-4b87-a631-8af7012f0916 admin admin] PATH_INFO: `/v3/projects/90b42fe203384f8c852afe1c917d4f40/users/a05c9a5fa170471aa8d73e243ffc30b8/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.336222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f44c2-ae30-4b87-a631-8af7012f0916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b42fe203384f8c852afe1c917d4f40, user_id=a05c9a5fa170471aa8d73e243ffc30b8, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.338987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f44c2-ae30-4b87-a631-8af7012f0916 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.357206 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1056/2100] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:54 2022] PUT /identity/v3/projects/90b42fe203384f8c852afe1c917d4f40/users/a05c9a5fa170471aa8d73e243ffc30b8/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:54.364232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe2054-ed17-4faf-844e-4d363b15844f None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.364901 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe2054-ed17-4faf-844e-4d363b15844f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.364901 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe2054-ed17-4faf-844e-4d363b15844f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.386534 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-c4fe2054-ed17-4faf-844e-4d363b15844f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:54.388355 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c4fe2054-ed17-4faf-844e-4d363b15844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:54.452603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1045/2101] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:54.466685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f44c2-ae30-4b87-a631-8af7012f0916 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.468522 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-406f44c2-ae30-4b87-a631-8af7012f0916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:54.539984 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f44c2-ae30-4b87-a631-8af7012f0916 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.544061 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab990791-b161-4174-a49d-20c4c11c268f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.544804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab990791-b161-4174-a49d-20c4c11c268f service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.545082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab990791-b161-4174-a49d-20c4c11c268f service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.545349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab990791-b161-4174-a49d-20c4c11c268f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.556192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab990791-b161-4174-a49d-20c4c11c268f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.559446 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab990791-b161-4174-a49d-20c4c11c268f service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.570909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1057/2102] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:54.626087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe2054-ed17-4faf-844e-4d363b15844f None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.627802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c4fe2054-ed17-4faf-844e-4d363b15844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:54.647122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe2054-ed17-4faf-844e-4d363b15844f None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.652595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb3d31-9d9f-4965-bff7-6915df5ca497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.653481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb3d31-9d9f-4965-bff7-6915df5ca497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.653746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb3d31-9d9f-4965-bff7-6915df5ca497 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.654025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb3d31-9d9f-4965-bff7-6915df5ca497 admin admin] PATH_INFO: `/v3/projects/f5d9e48176a4415dafc978c5539d7f98` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.655370 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb3d31-9d9f-4965-bff7-6915df5ca497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5d9e48176a4415dafc978c5539d7f98)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.657344 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb3d31-9d9f-4965-bff7-6915df5ca497 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.708714 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-cffb3d31-9d9f-4965-bff7-6915df5ca497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5d9e48176a4415dafc978c5539d7f98', 'request_id': 'req-cffb3d31-9d9f-4965-bff7-6915df5ca497'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:54.717815 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-cffb3d31-9d9f-4965-bff7-6915df5ca497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5d9e48176a4415dafc978c5539d7f98', 'request_id': 'req-cffb3d31-9d9f-4965-bff7-6915df5ca497'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:54.723560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-cffb3d31-9d9f-4965-bff7-6915df5ca497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5d9e48176a4415dafc978c5539d7f98', 'request_id': 'req-cffb3d31-9d9f-4965-bff7-6915df5ca497'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:54.737713 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-cffb3d31-9d9f-4965-bff7-6915df5ca497 admin admin] The token cache is being invalidate because project f5d9e48176a4415dafc978c5539d7f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:54.738054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-cffb3d31-9d9f-4965-bff7-6915df5ca497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:54.738886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-cffb3d31-9d9f-4965-bff7-6915df5ca497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:54.741122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1046/2103] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:54 2022] DELETE /identity/v3/projects/f5d9e48176a4415dafc978c5539d7f98 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:54.747649 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c78d80-f8da-4e90-a750-65bf4bef08aa None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.748098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c78d80-f8da-4e90-a750-65bf4bef08aa None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.748408 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c78d80-f8da-4e90-a750-65bf4bef08aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.771348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-39c78d80-f8da-4e90-a750-65bf4bef08aa None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:54.772745 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-39c78d80-f8da-4e90-a750-65bf4bef08aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:54.846602 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1058/2104] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:54.855115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e4534-b27a-4b22-8c9a-16ef8e8af879 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.855444 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e4534-b27a-4b22-8c9a-16ef8e8af879 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.855770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e4534-b27a-4b22-8c9a-16ef8e8af879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.874973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-bb9e4534-b27a-4b22-8c9a-16ef8e8af879 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:54.876670 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-bb9e4534-b27a-4b22-8c9a-16ef8e8af879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:54.885275 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1047/2105] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:54.889784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c78d80-f8da-4e90-a750-65bf4bef08aa None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.901726 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c78d80-f8da-4e90-a750-65bf4bef08aa None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.906828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10501c56-5448-45ed-8416-60424390e089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.907526 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10501c56-5448-45ed-8416-60424390e089 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.907859 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10501c56-5448-45ed-8416-60424390e089 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.908139 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10501c56-5448-45ed-8416-60424390e089 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.908928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10501c56-5448-45ed-8416-60424390e089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:54.909236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10501c56-5448-45ed-8416-60424390e089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.910932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10501c56-5448-45ed-8416-60424390e089 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.924066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1059/2106] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:53:54.929041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e4534-b27a-4b22-8c9a-16ef8e8af879 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.940805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e4534-b27a-4b22-8c9a-16ef8e8af879 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.945772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507b7cc-de41-4426-ae7b-78693a7e6758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.946560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507b7cc-de41-4426-ae7b-78693a7e6758 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.946904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507b7cc-de41-4426-ae7b-78693a7e6758 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.947263 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507b7cc-de41-4426-ae7b-78693a7e6758 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.948037 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507b7cc-de41-4426-ae7b-78693a7e6758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.950103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507b7cc-de41-4426-ae7b-78693a7e6758 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.984362 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1048/2107] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:54 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:54.985587 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10501c56-5448-45ed-8416-60424390e089 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.996362 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10501c56-5448-45ed-8416-60424390e089 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:55.067116 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453db4f-eb4e-41b3-91dd-ffeec596b624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:55.067919 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453db4f-eb4e-41b3-91dd-ffeec596b624 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.068222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453db4f-eb4e-41b3-91dd-ffeec596b624 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.068503 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453db4f-eb4e-41b3-91dd-ffeec596b624 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.069193 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453db4f-eb4e-41b3-91dd-ffeec596b624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:55.071498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453db4f-eb4e-41b3-91dd-ffeec596b624 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:55.092641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1060/2108] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:54 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:55.097064 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507b7cc-de41-4426-ae7b-78693a7e6758 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:55.107389 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507b7cc-de41-4426-ae7b-78693a7e6758 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:55.112489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01330344-6970-4bd9-b260-982345e67a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:55.113258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01330344-6970-4bd9-b260-982345e67a3f admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.113604 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01330344-6970-4bd9-b260-982345e67a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.113974 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01330344-6970-4bd9-b260-982345e67a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.114767 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01330344-6970-4bd9-b260-982345e67a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:55.117043 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01330344-6970-4bd9-b260-982345e67a3f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:55.128502 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1049/2109] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:55.132816 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453db4f-eb4e-41b3-91dd-ffeec596b624 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:55.144142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453db4f-eb4e-41b3-91dd-ffeec596b624 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:55.149963 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c59113-0f82-41e9-99d6-c4baffdf901b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:55.150714 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c59113-0f82-41e9-99d6-c4baffdf901b admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.151057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c59113-0f82-41e9-99d6-c4baffdf901b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.151395 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c59113-0f82-41e9-99d6-c4baffdf901b admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.152236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c59113-0f82-41e9-99d6-c4baffdf901b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:55.154039 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c59113-0f82-41e9-99d6-c4baffdf901b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:55.175288 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1061/2110] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:55.179797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01330344-6970-4bd9-b260-982345e67a3f admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:55.198724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01330344-6970-4bd9-b260-982345e67a3f admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:55.205025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9edae4-4712-4c12-9175-890a4f35e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:55.206053 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9edae4-4712-4c12-9175-890a4f35e5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.206535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9edae4-4712-4c12-9175-890a4f35e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.206881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9edae4-4712-4c12-9175-890a4f35e5e2 admin admin] PATH_INFO: `/v3/projects/ea5adb3cc118479985e5e440884d474d/users/19af08bcc22a436695b0545cc00a779c/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.224617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9edae4-4712-4c12-9175-890a4f35e5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5adb3cc118479985e5e440884d474d, user_id=19af08bcc22a436695b0545cc00a779c, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:55.227463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9edae4-4712-4c12-9175-890a4f35e5e2 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:55.242198 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1050/2111] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:55 2022] PUT /identity/v3/projects/ea5adb3cc118479985e5e440884d474d/users/19af08bcc22a436695b0545cc00a779c/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:55.253777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada207e-1b10-430a-a062-eb3393f4f7d4 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.254092 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada207e-1b10-430a-a062-eb3393f4f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.254365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada207e-1b10-430a-a062-eb3393f4f7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.282614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-cada207e-1b10-430a-a062-eb3393f4f7d4 None None] MFA Rules not processed for user `19af08bcc22a436695b0545cc00a779c`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:55.283830 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-cada207e-1b10-430a-a062-eb3393f4f7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:55.362555 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1062/2112] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:55.372103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada207e-1b10-430a-a062-eb3393f4f7d4 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:55.372500 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5acd7-0b3b-4c7c-a523-ce08402808cc None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.373292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5acd7-0b3b-4c7c-a523-ce08402808cc None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.373711 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5acd7-0b3b-4c7c-a523-ce08402808cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.408335 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-97c5acd7-0b3b-4c7c-a523-ce08402808cc None None] MFA Rules not processed for user `a05c9a5fa170471aa8d73e243ffc30b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:55.409588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-97c5acd7-0b3b-4c7c-a523-ce08402808cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:55.458721 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada207e-1b10-430a-a062-eb3393f4f7d4 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:55.469907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fa9f0-0071-4f6f-a453-ddc7d4df6ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:55.470979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa9f0-0071-4f6f-a453-ddc7d4df6ace admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.471987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa9f0-0071-4f6f-a453-ddc7d4df6ace admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.472465 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa9f0-0071-4f6f-a453-ddc7d4df6ace admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.474555 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fa9f0-0071-4f6f-a453-ddc7d4df6ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:55.476974 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fa9f0-0071-4f6f-a453-ddc7d4df6ace admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:55.521875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1051/2113] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:55.538157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1063/2114] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:55 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:55.539398 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5acd7-0b3b-4c7c-a523-ce08402808cc None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:55.553498 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5acd7-0b3b-4c7c-a523-ce08402808cc None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:55.554562 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fa9f0-0071-4f6f-a453-ddc7d4df6ace admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:55.558569 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-bd9fa9f0-0071-4f6f-a453-ddc7d4df6ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:55.637233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fa9f0-0071-4f6f-a453-ddc7d4df6ace admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:55.641461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4c0b7-b0d9-4881-a310-7998c0390380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:55.642192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4c0b7-b0d9-4881-a310-7998c0390380 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.642568 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4c0b7-b0d9-4881-a310-7998c0390380 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.642899 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4c0b7-b0d9-4881-a310-7998c0390380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.651926 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0c4b7-4b32-40c9-8788-7f27d0b1aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:55.652711 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0c4b7-4b32-40c9-8788-7f27d0b1aa98 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.652994 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0c4b7-4b32-40c9-8788-7f27d0b1aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.653268 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0c4b7-4b32-40c9-8788-7f27d0b1aa98 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.654177 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0c4b7-4b32-40c9-8788-7f27d0b1aa98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:55.657130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0c4b7-4b32-40c9-8788-7f27d0b1aa98 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:55.683130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1052/2115] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:55 2022] POST /identity/v3/users => generated 295 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:55.684324 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0c4b7-4b32-40c9-8788-7f27d0b1aa98 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:55.694007 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0c4b7-4b32-40c9-8788-7f27d0b1aa98 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:55.699902 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bf490-2362-4fca-9079-b520930ec083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:55.700695 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bf490-2362-4fca-9079-b520930ec083 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.700987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bf490-2362-4fca-9079-b520930ec083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.701278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bf490-2362-4fca-9079-b520930ec083 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.702013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3bf490-2362-4fca-9079-b520930ec083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:55.703724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3bf490-2362-4fca-9079-b520930ec083 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:55.714523 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4c0b7-b0d9-4881-a310-7998c0390380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:55.718626 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1053/2116] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:55.718751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4c0b7-b0d9-4881-a310-7998c0390380 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:55.719515 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bf490-2362-4fca-9079-b520930ec083 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:55.725918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1064/2117] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:53:55.729871 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bf490-2362-4fca-9079-b520930ec083 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:55.736128 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb133d8-a4a9-4618-9980-5964a83a1f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:55.737486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb133d8-a4a9-4618-9980-5964a83a1f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.737851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb133d8-a4a9-4618-9980-5964a83a1f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.738175 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb133d8-a4a9-4618-9980-5964a83a1f3f admin admin] PATH_INFO: `/v3/projects/16833589d53b47da826bd615e76de9aa/users/fbf5b3a8fa9a45a9b8ed9b7ae3e01fd6/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.765676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb133d8-a4a9-4618-9980-5964a83a1f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=16833589d53b47da826bd615e76de9aa, user_id=fbf5b3a8fa9a45a9b8ed9b7ae3e01fd6, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:55.769681 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb133d8-a4a9-4618-9980-5964a83a1f3f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:55.795323 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1054/2118] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:55 2022] PUT /identity/v3/projects/16833589d53b47da826bd615e76de9aa/users/fbf5b3a8fa9a45a9b8ed9b7ae3e01fd6/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:55.799514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4c0b7-b0d9-4881-a310-7998c0390380 service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:55.812258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4c0b7-b0d9-4881-a310-7998c0390380 service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:55.879052 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4bd0b-732f-4da6-99fb-f5cc70468c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:55.880038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4bd0b-732f-4da6-99fb-f5cc70468c32 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.880649 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4bd0b-732f-4da6-99fb-f5cc70468c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.881067 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4bd0b-732f-4da6-99fb-f5cc70468c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.882156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4bd0b-732f-4da6-99fb-f5cc70468c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:55.883970 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4bd0b-732f-4da6-99fb-f5cc70468c32 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:55.894914 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1065/2119] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:55.900479 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb133d8-a4a9-4618-9980-5964a83a1f3f admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:55.915422 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb133d8-a4a9-4618-9980-5964a83a1f3f admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:55.921336 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af4591-4e66-4873-bb17-fafd74c6abb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:55.922240 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af4591-4e66-4873-bb17-fafd74c6abb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.922501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af4591-4e66-4873-bb17-fafd74c6abb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.922770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af4591-4e66-4873-bb17-fafd74c6abb2 admin admin] PATH_INFO: `/v3/projects/16833589d53b47da826bd615e76de9aa/users/fbf5b3a8fa9a45a9b8ed9b7ae3e01fd6/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.924884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af4591-4e66-4873-bb17-fafd74c6abb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16833589d53b47da826bd615e76de9aa, user_id=fbf5b3a8fa9a45a9b8ed9b7ae3e01fd6, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:55.927561 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af4591-4e66-4873-bb17-fafd74c6abb2 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:55.939625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1055/2120] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:55 2022] PUT /identity/v3/projects/16833589d53b47da826bd615e76de9aa/users/fbf5b3a8fa9a45a9b8ed9b7ae3e01fd6/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:55.951911 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1512738-0a5a-44f4-a16f-ea29d261b3d9 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.952217 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1512738-0a5a-44f4-a16f-ea29d261b3d9 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.952491 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1512738-0a5a-44f4-a16f-ea29d261b3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.981116 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-d1512738-0a5a-44f4-a16f-ea29d261b3d9 None None] MFA Rules not processed for user `fbf5b3a8fa9a45a9b8ed9b7ae3e01fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:55.982339 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-d1512738-0a5a-44f4-a16f-ea29d261b3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:56.072720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1066/2121] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:56.082506 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af4591-4e66-4873-bb17-fafd74c6abb2 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:56.140628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af4591-4e66-4873-bb17-fafd74c6abb2 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:56.144565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c83798-e925-46a8-932e-f489bad88d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:56.145236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c83798-e925-46a8-932e-f489bad88d05 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:56.145880 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c83798-e925-46a8-932e-f489bad88d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:56.146198 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c83798-e925-46a8-932e-f489bad88d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:56.205084 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c83798-e925-46a8-932e-f489bad88d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:56.206432 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c83798-e925-46a8-932e-f489bad88d05 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:56.216328 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1056/2122] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:58.269356 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c018d31-d456-4eb7-9cc8-7bbcb250d744 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:58.269960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c018d31-d456-4eb7-9cc8-7bbcb250d744 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:58.269960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c018d31-d456-4eb7-9cc8-7bbcb250d744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:58.292272 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-8c018d31-d456-4eb7-9cc8-7bbcb250d744 None None] MFA Rules not processed for user `a05c9a5fa170471aa8d73e243ffc30b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:58.293685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8c018d31-d456-4eb7-9cc8-7bbcb250d744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:58.351974 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1067/2123] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:53:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:06.067990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c83798-e925-46a8-932e-f489bad88d05 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:06.078098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c83798-e925-46a8-932e-f489bad88d05 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:06.082681 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ccca6-53e7-4a3f-b291-8f571e630f71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:06.083753 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ccca6-53e7-4a3f-b291-8f571e630f71 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:06.084164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ccca6-53e7-4a3f-b291-8f571e630f71 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:06.084476 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ccca6-53e7-4a3f-b291-8f571e630f71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:06.095017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ccca6-53e7-4a3f-b291-8f571e630f71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:06.096541 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ccca6-53e7-4a3f-b291-8f571e630f71 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:06.107137 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1057/2124] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:12.646438 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ad6f0-1752-4507-9c1a-7df4212c87ed None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:12.646994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ad6f0-1752-4507-9c1a-7df4212c87ed None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:12.646994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ad6f0-1752-4507-9c1a-7df4212c87ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:12.665466 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-8c5ad6f0-1752-4507-9c1a-7df4212c87ed None None] MFA Rules not processed for user `f77ffa9a7dd44cf9b00c53d1356e0567`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:12.666680 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8c5ad6f0-1752-4507-9c1a-7df4212c87ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:12.721054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1068/2125] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:39.115751 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ccca6-53e7-4a3f-b291-8f571e630f71 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:39.117484 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c69ccca6-53e7-4a3f-b291-8f571e630f71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:39.270004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ccca6-53e7-4a3f-b291-8f571e630f71 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:39.275213 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df35bb-c3d8-4672-9660-f554449c0559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:39.276105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df35bb-c3d8-4672-9660-f554449c0559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:39.276480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df35bb-c3d8-4672-9660-f554449c0559 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:39.276757 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df35bb-c3d8-4672-9660-f554449c0559 admin admin] PATH_INFO: `/v3/users/aa25a6134ede45289dd29ce9156125f7` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:39.278126 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df35bb-c3d8-4672-9660-f554449c0559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa25a6134ede45289dd29ce9156125f7)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:39.280122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df35bb-c3d8-4672-9660-f554449c0559 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:39.344374 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-35df35bb-c3d8-4672-9660-f554449c0559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa25a6134ede45289dd29ce9156125f7'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:39.345049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-35df35bb-c3d8-4672-9660-f554449c0559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa25a6134ede45289dd29ce9156125f7'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:39.358303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-35df35bb-c3d8-4672-9660-f554449c0559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa25a6134ede45289dd29ce9156125f7'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:39.359133 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-35df35bb-c3d8-4672-9660-f554449c0559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa25a6134ede45289dd29ce9156125f7'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:39.369433 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-35df35bb-c3d8-4672-9660-f554449c0559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa25a6134ede45289dd29ce9156125f7'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:39.396463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1058/2126] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:39 2022] DELETE /identity/v3/users/aa25a6134ede45289dd29ce9156125f7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:39.399321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29c16a-9ca9-4374-8aeb-0f81d527209c None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:39.399813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29c16a-9ca9-4374-8aeb-0f81d527209c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:39.399931 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29c16a-9ca9-4374-8aeb-0f81d527209c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:39.429523 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-db29c16a-9ca9-4374-8aeb-0f81d527209c None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:39.431943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-db29c16a-9ca9-4374-8aeb-0f81d527209c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:39.505103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1069/2127] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:39.515561 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df35bb-c3d8-4672-9660-f554449c0559 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:39.517098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-35df35bb-c3d8-4672-9660-f554449c0559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:39.650659 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df35bb-c3d8-4672-9660-f554449c0559 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:39.654658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85029a39-f397-4284-b0b8-b6cdc7d2de4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:39.655398 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85029a39-f397-4284-b0b8-b6cdc7d2de4e service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:39.655758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85029a39-f397-4284-b0b8-b6cdc7d2de4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:39.656104 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85029a39-f397-4284-b0b8-b6cdc7d2de4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:39.665798 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85029a39-f397-4284-b0b8-b6cdc7d2de4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:39.667337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85029a39-f397-4284-b0b8-b6cdc7d2de4e service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:39.678596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1059/2128] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:40.087141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29c16a-9ca9-4374-8aeb-0f81d527209c None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:40.088689 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-db29c16a-9ca9-4374-8aeb-0f81d527209c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:40.101381 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29c16a-9ca9-4374-8aeb-0f81d527209c None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:40.110141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971d3ec-d8af-4750-a7b0-927297da1947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:40.111178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971d3ec-d8af-4750-a7b0-927297da1947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.111470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971d3ec-d8af-4750-a7b0-927297da1947 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.111745 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971d3ec-d8af-4750-a7b0-927297da1947 admin admin] PATH_INFO: `/v3/projects/7a45ab62bcfa4e59ab951d8fbe6cbec2` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.113057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971d3ec-d8af-4750-a7b0-927297da1947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a45ab62bcfa4e59ab951d8fbe6cbec2)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:40.115234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971d3ec-d8af-4750-a7b0-927297da1947 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:40.165462 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c971d3ec-d8af-4750-a7b0-927297da1947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a45ab62bcfa4e59ab951d8fbe6cbec2', 'request_id': 'req-c971d3ec-d8af-4750-a7b0-927297da1947'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:40.174175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c971d3ec-d8af-4750-a7b0-927297da1947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a45ab62bcfa4e59ab951d8fbe6cbec2', 'request_id': 'req-c971d3ec-d8af-4750-a7b0-927297da1947'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:40.180899 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c971d3ec-d8af-4750-a7b0-927297da1947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a45ab62bcfa4e59ab951d8fbe6cbec2', 'request_id': 'req-c971d3ec-d8af-4750-a7b0-927297da1947'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:40.192895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c971d3ec-d8af-4750-a7b0-927297da1947 admin admin] The token cache is being invalidate because project 7a45ab62bcfa4e59ab951d8fbe6cbec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:40.193114 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c971d3ec-d8af-4750-a7b0-927297da1947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:40.194117 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c971d3ec-d8af-4750-a7b0-927297da1947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:40.200928 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1070/2129] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:40 2022] DELETE /identity/v3/projects/7a45ab62bcfa4e59ab951d8fbe6cbec2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:40.202955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90fbbb-d1e1-45c2-8a55-a720400a005c None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.203443 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90fbbb-d1e1-45c2-8a55-a720400a005c None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.203979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90fbbb-d1e1-45c2-8a55-a720400a005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.246359 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-8b90fbbb-d1e1-45c2-8a55-a720400a005c None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:40.247586 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-8b90fbbb-d1e1-45c2-8a55-a720400a005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:40.312936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1060/2130] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:40.321380 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07d962-47e8-485c-a403-b8dd18fd48e9 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.321664 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07d962-47e8-485c-a403-b8dd18fd48e9 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.321939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07d962-47e8-485c-a403-b8dd18fd48e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.344767 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-cd07d962-47e8-485c-a403-b8dd18fd48e9 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:40.345985 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-cd07d962-47e8-485c-a403-b8dd18fd48e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:40.356077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1071/2131] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:54:40.361966 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90fbbb-d1e1-45c2-8a55-a720400a005c None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:40.372084 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90fbbb-d1e1-45c2-8a55-a720400a005c None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:40.377297 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbb948-60bf-46c7-ae06-aa262892912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:40.378018 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbb948-60bf-46c7-ae06-aa262892912d admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.378293 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbb948-60bf-46c7-ae06-aa262892912d admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.378557 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbb948-60bf-46c7-ae06-aa262892912d admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.379280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbb948-60bf-46c7-ae06-aa262892912d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:40.379582 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbb948-60bf-46c7-ae06-aa262892912d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:40.381496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbb948-60bf-46c7-ae06-aa262892912d admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:40.393729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1061/2132] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:54:40.398628 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07d962-47e8-485c-a403-b8dd18fd48e9 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:40.408251 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07d962-47e8-485c-a403-b8dd18fd48e9 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:40.415410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c974b53-4c1b-4d97-82d2-2537cc6eb244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:40.416310 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974b53-4c1b-4d97-82d2-2537cc6eb244 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.416804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974b53-4c1b-4d97-82d2-2537cc6eb244 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.417504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974b53-4c1b-4d97-82d2-2537cc6eb244 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.418357 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c974b53-4c1b-4d97-82d2-2537cc6eb244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:40.422033 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c974b53-4c1b-4d97-82d2-2537cc6eb244 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:40.457015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1072/2133] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:40 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:40.461700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbb948-60bf-46c7-ae06-aa262892912d admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:40.474729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbb948-60bf-46c7-ae06-aa262892912d admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:40.560609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5aaf2e-88de-4972-a1b7-aca7e586c9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:40.560609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5aaf2e-88de-4972-a1b7-aca7e586c9ef admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.560913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5aaf2e-88de-4972-a1b7-aca7e586c9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.561006 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5aaf2e-88de-4972-a1b7-aca7e586c9ef admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.561692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5aaf2e-88de-4972-a1b7-aca7e586c9ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:40.563633 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5aaf2e-88de-4972-a1b7-aca7e586c9ef admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:40.586597 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1062/2134] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:40 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:40.591008 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c974b53-4c1b-4d97-82d2-2537cc6eb244 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:40.602046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c974b53-4c1b-4d97-82d2-2537cc6eb244 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:40.607405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a66508-53d5-40c6-9663-6b227e619dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:40.608333 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a66508-53d5-40c6-9663-6b227e619dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.608835 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a66508-53d5-40c6-9663-6b227e619dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.609173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a66508-53d5-40c6-9663-6b227e619dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.609983 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a66508-53d5-40c6-9663-6b227e619dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:40.611826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a66508-53d5-40c6-9663-6b227e619dc1 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:40.624706 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1073/2135] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:40.627942 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5aaf2e-88de-4972-a1b7-aca7e586c9ef admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:40.641458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5aaf2e-88de-4972-a1b7-aca7e586c9ef admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:40.649624 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3817d8-3a95-421f-9acc-982203e33edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:40.650312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3817d8-3a95-421f-9acc-982203e33edd admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.650589 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3817d8-3a95-421f-9acc-982203e33edd admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.650857 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3817d8-3a95-421f-9acc-982203e33edd admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.651869 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3817d8-3a95-421f-9acc-982203e33edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:40.653553 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3817d8-3a95-421f-9acc-982203e33edd admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:40.664506 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1063/2136] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:40.669120 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a66508-53d5-40c6-9663-6b227e619dc1 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:40.680822 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a66508-53d5-40c6-9663-6b227e619dc1 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:40.685618 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ef336-f8f7-4d47-aa4d-4220b2cfd86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:40.686503 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ef336-f8f7-4d47-aa4d-4220b2cfd86c admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.686774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ef336-f8f7-4d47-aa4d-4220b2cfd86c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.687041 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ef336-f8f7-4d47-aa4d-4220b2cfd86c admin admin] PATH_INFO: `/v3/projects/1ffa8215f4d6479babed8b59e14b7e39/users/8c01ed6e76ef4ee4ba5356c526e113e4/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.702431 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ef336-f8f7-4d47-aa4d-4220b2cfd86c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ffa8215f4d6479babed8b59e14b7e39, user_id=8c01ed6e76ef4ee4ba5356c526e113e4, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:40.705199 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ef336-f8f7-4d47-aa4d-4220b2cfd86c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:40.719718 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1074/2137] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:40 2022] PUT /identity/v3/projects/1ffa8215f4d6479babed8b59e14b7e39/users/8c01ed6e76ef4ee4ba5356c526e113e4/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:40.725333 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5925a-64e2-4a03-972d-804e1fcf291e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.725704 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5925a-64e2-4a03-972d-804e1fcf291e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.726045 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5925a-64e2-4a03-972d-804e1fcf291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.748607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-01a5925a-64e2-4a03-972d-804e1fcf291e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:40.749507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-01a5925a-64e2-4a03-972d-804e1fcf291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:40.822615 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1064/2138] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:40.842835 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ef336-f8f7-4d47-aa4d-4220b2cfd86c admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:40.846680 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-883ef336-f8f7-4d47-aa4d-4220b2cfd86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:40.946901 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ef336-f8f7-4d47-aa4d-4220b2cfd86c admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:40.950755 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723f9ab-03c8-4e1b-bf06-dad0f061a524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:40.951441 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723f9ab-03c8-4e1b-bf06-dad0f061a524 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.951718 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723f9ab-03c8-4e1b-bf06-dad0f061a524 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.951986 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723f9ab-03c8-4e1b-bf06-dad0f061a524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.961751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723f9ab-03c8-4e1b-bf06-dad0f061a524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:40.963253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723f9ab-03c8-4e1b-bf06-dad0f061a524 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:40.973556 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1075/2139] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:41.950010 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5268e-df3f-453f-8c6e-874bdeb28fbc None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:41.951267 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5268e-df3f-453f-8c6e-874bdeb28fbc None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:41.952431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5268e-df3f-453f-8c6e-874bdeb28fbc None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:41.955508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1065/2140] 10.222.0.90 () {54 vars in 921 bytes} [Wed Nov 2 12:54:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:54:41.971288 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177306-2209-403d-b41f-cfb83559d4bd None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:41.972415 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177306-2209-403d-b41f-cfb83559d4bd None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:41.972963 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177306-2209-403d-b41f-cfb83559d4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:42.013178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5268e-df3f-453f-8c6e-874bdeb28fbc None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:42.016510 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-9dc5268e-df3f-453f-8c6e-874bdeb28fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:42.062886 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-75177306-2209-403d-b41f-cfb83559d4bd None None] MFA Rules not processed for user `65e89359a42b4b0592db48f5a5a6e465`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:42.064474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-75177306-2209-403d-b41f-cfb83559d4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:42.070096 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5268e-df3f-453f-8c6e-874bdeb28fbc None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:42.086123 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c79395-0ec6-4942-86d9-da22b5b278a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:42.087339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c79395-0ec6-4942-86d9-da22b5b278a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:42.087720 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c79395-0ec6-4942-86d9-da22b5b278a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:42.089335 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c79395-0ec6-4942-86d9-da22b5b278a5 admin admin] PATH_INFO: `/v3/users/fd0b35be3944451d961e68ed1e39afc2` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:42.091771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c79395-0ec6-4942-86d9-da22b5b278a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0b35be3944451d961e68ed1e39afc2)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:42.093749 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c79395-0ec6-4942-86d9-da22b5b278a5 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:42.155043 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1076/2141] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Nov 2 12:54:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:42.179785 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-62c79395-0ec6-4942-86d9-da22b5b278a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0b35be3944451d961e68ed1e39afc2'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:42.180863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-62c79395-0ec6-4942-86d9-da22b5b278a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0b35be3944451d961e68ed1e39afc2'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:42.185922 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75177306-2209-403d-b41f-cfb83559d4bd None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:42.188616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-75177306-2209-403d-b41f-cfb83559d4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:42.199162 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-62c79395-0ec6-4942-86d9-da22b5b278a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0b35be3944451d961e68ed1e39afc2'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:42.199951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-62c79395-0ec6-4942-86d9-da22b5b278a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0b35be3944451d961e68ed1e39afc2'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:42.223321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75177306-2209-403d-b41f-cfb83559d4bd None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:42.223539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-62c79395-0ec6-4942-86d9-da22b5b278a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0b35be3944451d961e68ed1e39afc2'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:42.234167 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1066/2142] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:42 2022] DELETE /identity/v3/users/fd0b35be3944451d961e68ed1e39afc2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:54:42.234467 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b98cae-ffc6-4da0-a44f-fc247737bab4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:42.236331 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b98cae-ffc6-4da0-a44f-fc247737bab4 service placement] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:42.236807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b98cae-ffc6-4da0-a44f-fc247737bab4 service placement] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:42.237235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b98cae-ffc6-4da0-a44f-fc247737bab4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:42.241027 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e3b98cae-ffc6-4da0-a44f-fc247737bab4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:42.267999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b98cae-ffc6-4da0-a44f-fc247737bab4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:42.270527 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b98cae-ffc6-4da0-a44f-fc247737bab4 service placement] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:42.290402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1077/2143] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:54:42.629758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c79395-0ec6-4942-86d9-da22b5b278a5 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:42.631390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-62c79395-0ec6-4942-86d9-da22b5b278a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:42.748888 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c79395-0ec6-4942-86d9-da22b5b278a5 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:42.753323 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660e5b8-57d0-4ae8-b5cf-8af6125c06ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:42.754241 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660e5b8-57d0-4ae8-b5cf-8af6125c06ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:42.754496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660e5b8-57d0-4ae8-b5cf-8af6125c06ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:42.754768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660e5b8-57d0-4ae8-b5cf-8af6125c06ba admin admin] PATH_INFO: `/v3/projects/7d2c4b25d8f447e99927fa32e9f35b1a` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:42.756026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660e5b8-57d0-4ae8-b5cf-8af6125c06ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2c4b25d8f447e99927fa32e9f35b1a)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:42.758024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660e5b8-57d0-4ae8-b5cf-8af6125c06ba admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:42.813286 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8660e5b8-57d0-4ae8-b5cf-8af6125c06ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2c4b25d8f447e99927fa32e9f35b1a', 'request_id': 'req-8660e5b8-57d0-4ae8-b5cf-8af6125c06ba'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:42.822825 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8660e5b8-57d0-4ae8-b5cf-8af6125c06ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2c4b25d8f447e99927fa32e9f35b1a', 'request_id': 'req-8660e5b8-57d0-4ae8-b5cf-8af6125c06ba'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:42.829041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8660e5b8-57d0-4ae8-b5cf-8af6125c06ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2c4b25d8f447e99927fa32e9f35b1a', 'request_id': 'req-8660e5b8-57d0-4ae8-b5cf-8af6125c06ba'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:42.842304 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8660e5b8-57d0-4ae8-b5cf-8af6125c06ba admin admin] The token cache is being invalidate because project 7d2c4b25d8f447e99927fa32e9f35b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:42.842588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8660e5b8-57d0-4ae8-b5cf-8af6125c06ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:42.843317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8660e5b8-57d0-4ae8-b5cf-8af6125c06ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:42.845183 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1067/2144] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:42 2022] DELETE /identity/v3/projects/7d2c4b25d8f447e99927fa32e9f35b1a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:42.851639 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831aca3-d7f7-4f8b-b833-1154cca229c0 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:42.852512 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831aca3-d7f7-4f8b-b833-1154cca229c0 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:42.853366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831aca3-d7f7-4f8b-b833-1154cca229c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:42.872339 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-f831aca3-d7f7-4f8b-b833-1154cca229c0 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:42.873610 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f831aca3-d7f7-4f8b-b833-1154cca229c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:42.940084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1078/2145] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:42.941973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a6a43-d5c9-4584-b656-ab4a147d8035 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:42.942324 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a6a43-d5c9-4584-b656-ab4a147d8035 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:42.942776 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a6a43-d5c9-4584-b656-ab4a147d8035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:42.963004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-245a6a43-d5c9-4584-b656-ab4a147d8035 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:42.964538 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-245a6a43-d5c9-4584-b656-ab4a147d8035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:42.974038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1068/2146] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:42.979010 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831aca3-d7f7-4f8b-b833-1154cca229c0 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:42.989555 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831aca3-d7f7-4f8b-b833-1154cca229c0 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:42.994261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6051-fec3-4981-8f7a-baae6e2c6370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:42.994920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6051-fec3-4981-8f7a-baae6e2c6370 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:42.995245 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6051-fec3-4981-8f7a-baae6e2c6370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:42.995517 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6051-fec3-4981-8f7a-baae6e2c6370 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:42.996283 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a6051-fec3-4981-8f7a-baae6e2c6370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:42.996616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a6051-fec3-4981-8f7a-baae6e2c6370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:42.998236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a6051-fec3-4981-8f7a-baae6e2c6370 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:43.010147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1079/2147] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:54:43.015212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a6a43-d5c9-4584-b656-ab4a147d8035 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:43.025343 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a6a43-d5c9-4584-b656-ab4a147d8035 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:43.030679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff2b73-5aca-4cb9-b6ab-301761448636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:43.031420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff2b73-5aca-4cb9-b6ab-301761448636 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:43.031787 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff2b73-5aca-4cb9-b6ab-301761448636 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:43.032342 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff2b73-5aca-4cb9-b6ab-301761448636 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:43.033130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff2b73-5aca-4cb9-b6ab-301761448636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:43.035129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff2b73-5aca-4cb9-b6ab-301761448636 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:43.066269 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1069/2148] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:43 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:43.066980 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6051-fec3-4981-8f7a-baae6e2c6370 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:43.077233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6051-fec3-4981-8f7a-baae6e2c6370 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:43.147622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d7d8d-c635-45a8-9444-571a52f270ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:43.149018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d7d8d-c635-45a8-9444-571a52f270ba admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:43.150173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d7d8d-c635-45a8-9444-571a52f270ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:43.150510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d7d8d-c635-45a8-9444-571a52f270ba admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:43.151390 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d7d8d-c635-45a8-9444-571a52f270ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:43.153521 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d7d8d-c635-45a8-9444-571a52f270ba admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:43.181594 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1080/2149] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:43 2022] POST /identity/v3/users => generated 284 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:54:43.185957 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff2b73-5aca-4cb9-b6ab-301761448636 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:43.197248 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff2b73-5aca-4cb9-b6ab-301761448636 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:43.203283 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9415608-8b1f-430a-aa57-57cb56524205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:43.204290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9415608-8b1f-430a-aa57-57cb56524205 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:43.204731 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9415608-8b1f-430a-aa57-57cb56524205 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:43.205201 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9415608-8b1f-430a-aa57-57cb56524205 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:43.205954 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9415608-8b1f-430a-aa57-57cb56524205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:43.207591 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9415608-8b1f-430a-aa57-57cb56524205 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:43.222256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1070/2150] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:43.230133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d7d8d-c635-45a8-9444-571a52f270ba admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:43.245175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d7d8d-c635-45a8-9444-571a52f270ba admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:43.251634 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45db99d-0d17-4b01-baed-0c60f770fecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:43.252743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45db99d-0d17-4b01-baed-0c60f770fecf admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:43.253924 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45db99d-0d17-4b01-baed-0c60f770fecf admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:43.254362 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45db99d-0d17-4b01-baed-0c60f770fecf admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:43.255247 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45db99d-0d17-4b01-baed-0c60f770fecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:43.257343 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45db99d-0d17-4b01-baed-0c60f770fecf admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:43.274665 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1081/2151] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:43.276271 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9415608-8b1f-430a-aa57-57cb56524205 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:43.287095 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9415608-8b1f-430a-aa57-57cb56524205 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:43.296672 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c58be-a70e-41a6-afe3-7acf17634c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:43.297862 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c58be-a70e-41a6-afe3-7acf17634c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:43.298298 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c58be-a70e-41a6-afe3-7acf17634c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:43.298774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c58be-a70e-41a6-afe3-7acf17634c7f admin admin] PATH_INFO: `/v3/projects/1b12bc906c404d35bc4111149a3c384f/users/51433f18966e4e90942932295ccd52b4/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:43.319408 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c58be-a70e-41a6-afe3-7acf17634c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b12bc906c404d35bc4111149a3c384f, user_id=51433f18966e4e90942932295ccd52b4, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:43.322220 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c58be-a70e-41a6-afe3-7acf17634c7f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:43.346264 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1071/2152] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:43 2022] PUT /identity/v3/projects/1b12bc906c404d35bc4111149a3c384f/users/51433f18966e4e90942932295ccd52b4/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:43.357178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacfd9b-aefd-4b8e-8656-436d4813f70f None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:43.358093 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacfd9b-aefd-4b8e-8656-436d4813f70f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:43.358598 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacfd9b-aefd-4b8e-8656-436d4813f70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:43.393331 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-ceacfd9b-aefd-4b8e-8656-436d4813f70f None None] MFA Rules not processed for user `51433f18966e4e90942932295ccd52b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:43.395043 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ceacfd9b-aefd-4b8e-8656-436d4813f70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:43.527609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1082/2153] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:54:43.535892 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c58be-a70e-41a6-afe3-7acf17634c7f admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:43.538015 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c08c58be-a70e-41a6-afe3-7acf17634c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:43.694806 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c58be-a70e-41a6-afe3-7acf17634c7f admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:43.699260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19404b8-fff8-426c-94ef-6c176041a8b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:43.699963 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19404b8-fff8-426c-94ef-6c176041a8b5 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:43.700466 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19404b8-fff8-426c-94ef-6c176041a8b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:43.700748 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19404b8-fff8-426c-94ef-6c176041a8b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:43.710521 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19404b8-fff8-426c-94ef-6c176041a8b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:43.712390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19404b8-fff8-426c-94ef-6c176041a8b5 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:43.736847 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1072/2154] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:45.967440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476451e1-8612-4242-a9cb-e26e09bc0315 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:45.967960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476451e1-8612-4242-a9cb-e26e09bc0315 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:45.968103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476451e1-8612-4242-a9cb-e26e09bc0315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:46.001011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-476451e1-8612-4242-a9cb-e26e09bc0315 None None] MFA Rules not processed for user `8c01ed6e76ef4ee4ba5356c526e113e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:46.002350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-476451e1-8612-4242-a9cb-e26e09bc0315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:46.074195 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1083/2155] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:46.078735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19404b8-fff8-426c-94ef-6c176041a8b5 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:46.080879 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f19404b8-fff8-426c-94ef-6c176041a8b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:46.148758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19404b8-fff8-426c-94ef-6c176041a8b5 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:46.154778 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235145e-6171-4bc1-a245-aac08ece2ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:46.155475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235145e-6171-4bc1-a245-aac08ece2ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:46.155724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235145e-6171-4bc1-a245-aac08ece2ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:46.155992 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235145e-6171-4bc1-a245-aac08ece2ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:46.156757 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235145e-6171-4bc1-a245-aac08ece2ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:46.158725 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235145e-6171-4bc1-a245-aac08ece2ab9 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:46.185717 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1073/2156] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:46 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:46.190400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476451e1-8612-4242-a9cb-e26e09bc0315 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:46.213278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476451e1-8612-4242-a9cb-e26e09bc0315 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:46.307532 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d8812-767f-4c07-8019-7577f2da88f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:46.311279 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d8812-767f-4c07-8019-7577f2da88f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:46.311857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d8812-767f-4c07-8019-7577f2da88f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:46.312152 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d8812-767f-4c07-8019-7577f2da88f6 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:46.312935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d8812-767f-4c07-8019-7577f2da88f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:46.315855 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d8812-767f-4c07-8019-7577f2da88f6 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:46.357021 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1084/2157] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:46 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:46.357360 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235145e-6171-4bc1-a245-aac08ece2ab9 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:46.406303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235145e-6171-4bc1-a245-aac08ece2ab9 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:46.417282 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85c82e-ab22-4b49-aa46-46cafecdb2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:46.418292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85c82e-ab22-4b49-aa46-46cafecdb2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:46.418967 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85c82e-ab22-4b49-aa46-46cafecdb2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:46.419438 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85c82e-ab22-4b49-aa46-46cafecdb2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:46.420314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85c82e-ab22-4b49-aa46-46cafecdb2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:46.422214 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85c82e-ab22-4b49-aa46-46cafecdb2f8 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:46.444270 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d8812-767f-4c07-8019-7577f2da88f6 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:46.455254 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1074/2158] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:54:46.468785 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d8812-767f-4c07-8019-7577f2da88f6 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:46.489485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71883f5-4ca0-4398-b602-0bd5de857d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:46.490720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71883f5-4ca0-4398-b602-0bd5de857d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:46.491145 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71883f5-4ca0-4398-b602-0bd5de857d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:46.491583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71883f5-4ca0-4398-b602-0bd5de857d59 admin admin] PATH_INFO: `/v3/projects/ad803df8780d4fc8acfbb929b9fd4ca4/users/1c9db6fb132840a68b762e73132313ae/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:46.515295 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71883f5-4ca0-4398-b602-0bd5de857d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad803df8780d4fc8acfbb929b9fd4ca4, user_id=1c9db6fb132840a68b762e73132313ae, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:46.518608 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71883f5-4ca0-4398-b602-0bd5de857d59 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:46.538045 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1085/2159] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:46 2022] PUT /identity/v3/projects/ad803df8780d4fc8acfbb929b9fd4ca4/users/1c9db6fb132840a68b762e73132313ae/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:54:46.542112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85c82e-ab22-4b49-aa46-46cafecdb2f8 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:46.561322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85c82e-ab22-4b49-aa46-46cafecdb2f8 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:46.666294 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d88472-f1fe-4c0a-aaee-000c0b66f68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:46.667399 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d88472-f1fe-4c0a-aaee-000c0b66f68b admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:46.667987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d88472-f1fe-4c0a-aaee-000c0b66f68b admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:46.668535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d88472-f1fe-4c0a-aaee-000c0b66f68b admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:46.669899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d88472-f1fe-4c0a-aaee-000c0b66f68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:46.671864 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d88472-f1fe-4c0a-aaee-000c0b66f68b admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:46.708732 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1075/2160] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:46.713152 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71883f5-4ca0-4398-b602-0bd5de857d59 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:46.737614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71883f5-4ca0-4398-b602-0bd5de857d59 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:46.745526 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5409e-d28c-4714-b855-1590235198b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:46.746532 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5409e-d28c-4714-b855-1590235198b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:46.746871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5409e-d28c-4714-b855-1590235198b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:46.747248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5409e-d28c-4714-b855-1590235198b5 admin admin] PATH_INFO: `/v3/projects/ad803df8780d4fc8acfbb929b9fd4ca4/users/1c9db6fb132840a68b762e73132313ae/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:46.750403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5409e-d28c-4714-b855-1590235198b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad803df8780d4fc8acfbb929b9fd4ca4, user_id=1c9db6fb132840a68b762e73132313ae, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:46.755401 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5409e-d28c-4714-b855-1590235198b5 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:46.768138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1086/2161] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:46 2022] PUT /identity/v3/projects/ad803df8780d4fc8acfbb929b9fd4ca4/users/1c9db6fb132840a68b762e73132313ae/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:54:49.421271 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d88472-f1fe-4c0a-aaee-000c0b66f68b admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:49.424364 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f3d88472-f1fe-4c0a-aaee-000c0b66f68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:49.446871 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d88472-f1fe-4c0a-aaee-000c0b66f68b admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:49.575565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd3e1f-9b94-4330-9505-9269bc930215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:49.576479 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd3e1f-9b94-4330-9505-9269bc930215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:49.576761 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd3e1f-9b94-4330-9505-9269bc930215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:49.577235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd3e1f-9b94-4330-9505-9269bc930215 admin admin] PATH_INFO: `/v3/users/19af08bcc22a436695b0545cc00a779c` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:49.578385 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd3e1f-9b94-4330-9505-9269bc930215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19af08bcc22a436695b0545cc00a779c)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:49.580356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd3e1f-9b94-4330-9505-9269bc930215 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:49.655219 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f2fd3e1f-9b94-4330-9505-9269bc930215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19af08bcc22a436695b0545cc00a779c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:49.657527 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f2fd3e1f-9b94-4330-9505-9269bc930215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19af08bcc22a436695b0545cc00a779c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:49.702819 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f2fd3e1f-9b94-4330-9505-9269bc930215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19af08bcc22a436695b0545cc00a779c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:49.703851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f2fd3e1f-9b94-4330-9505-9269bc930215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19af08bcc22a436695b0545cc00a779c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:49.719195 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f2fd3e1f-9b94-4330-9505-9269bc930215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19af08bcc22a436695b0545cc00a779c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:49.742695 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1076/2162] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:49 2022] DELETE /identity/v3/users/19af08bcc22a436695b0545cc00a779c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:49.747797 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862e622-27bb-4990-ad7a-8ca16356fc62 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:49.748422 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862e622-27bb-4990-ad7a-8ca16356fc62 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:49.748801 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862e622-27bb-4990-ad7a-8ca16356fc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:49.787636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-7862e622-27bb-4990-ad7a-8ca16356fc62 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:49.790305 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-7862e622-27bb-4990-ad7a-8ca16356fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:49.915465 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1087/2163] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:49.930611 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd3e1f-9b94-4330-9505-9269bc930215 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:49.932645 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f2fd3e1f-9b94-4330-9505-9269bc930215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:50.053073 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd3e1f-9b94-4330-9505-9269bc930215 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:50.057305 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cdf94-341b-40bc-aa7b-4a0a451ebe6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:50.058188 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cdf94-341b-40bc-aa7b-4a0a451ebe6b service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:50.058706 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cdf94-341b-40bc-aa7b-4a0a451ebe6b service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:50.059251 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cdf94-341b-40bc-aa7b-4a0a451ebe6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:50.076740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cdf94-341b-40bc-aa7b-4a0a451ebe6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:50.080507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cdf94-341b-40bc-aa7b-4a0a451ebe6b service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:50.109349 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1077/2164] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:50.869005 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862e622-27bb-4990-ad7a-8ca16356fc62 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:50.870784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-7862e622-27bb-4990-ad7a-8ca16356fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:50.898458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862e622-27bb-4990-ad7a-8ca16356fc62 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:50.923670 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:50.927608 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:50.928330 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:50.928630 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47 admin admin] PATH_INFO: `/v3/projects/ea5adb3cc118479985e5e440884d474d` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:50.931720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea5adb3cc118479985e5e440884d474d)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:50.949293 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:51.038194 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea5adb3cc118479985e5e440884d474d', 'request_id': 'req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:51.057233 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea5adb3cc118479985e5e440884d474d', 'request_id': 'req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:51.066909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea5adb3cc118479985e5e440884d474d', 'request_id': 'req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:51.079533 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47 admin admin] The token cache is being invalidate because project ea5adb3cc118479985e5e440884d474d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:51.080069 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:51.080917 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:51.083416 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1088/2165] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:50 2022] DELETE /identity/v3/projects/ea5adb3cc118479985e5e440884d474d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:51.087162 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cdf94-341b-40bc-aa7b-4a0a451ebe6b service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:51.100875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cdf94-341b-40bc-aa7b-4a0a451ebe6b service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:51.255069 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918bf75-9c92-4302-98a9-820d65858693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:51.256255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918bf75-9c92-4302-98a9-820d65858693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:51.256715 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918bf75-9c92-4302-98a9-820d65858693 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:51.257371 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918bf75-9c92-4302-98a9-820d65858693 admin admin] PATH_INFO: `/v3/users/fbf5b3a8fa9a45a9b8ed9b7ae3e01fd6` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:51.258944 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918bf75-9c92-4302-98a9-820d65858693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf5b3a8fa9a45a9b8ed9b7ae3e01fd6)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:51.261858 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918bf75-9c92-4302-98a9-820d65858693 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:51.395574 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1918bf75-9c92-4302-98a9-820d65858693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf5b3a8fa9a45a9b8ed9b7ae3e01fd6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:51.396812 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1918bf75-9c92-4302-98a9-820d65858693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf5b3a8fa9a45a9b8ed9b7ae3e01fd6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:51.426352 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1918bf75-9c92-4302-98a9-820d65858693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf5b3a8fa9a45a9b8ed9b7ae3e01fd6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:51.428303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1918bf75-9c92-4302-98a9-820d65858693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf5b3a8fa9a45a9b8ed9b7ae3e01fd6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:51.460154 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1918bf75-9c92-4302-98a9-820d65858693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf5b3a8fa9a45a9b8ed9b7ae3e01fd6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:51.502442 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1078/2166] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:51 2022] DELETE /identity/v3/users/fbf5b3a8fa9a45a9b8ed9b7ae3e01fd6 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:52.455604 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:52.459443 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:52.491426 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc72073-b81c-4ecf-9f79-8e6ac7e7be47 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:52.631153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac01b8-82e1-4c4e-868c-92cc56a73060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:52.632935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac01b8-82e1-4c4e-868c-92cc56a73060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:52.633582 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac01b8-82e1-4c4e-868c-92cc56a73060 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:52.636140 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac01b8-82e1-4c4e-868c-92cc56a73060 admin admin] PATH_INFO: `/v3/projects/16833589d53b47da826bd615e76de9aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:52.654434 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac01b8-82e1-4c4e-868c-92cc56a73060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16833589d53b47da826bd615e76de9aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:52.656877 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac01b8-82e1-4c4e-868c-92cc56a73060 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:52.756840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-edac01b8-82e1-4c4e-868c-92cc56a73060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16833589d53b47da826bd615e76de9aa', 'request_id': 'req-edac01b8-82e1-4c4e-868c-92cc56a73060'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:52.771319 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-edac01b8-82e1-4c4e-868c-92cc56a73060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16833589d53b47da826bd615e76de9aa', 'request_id': 'req-edac01b8-82e1-4c4e-868c-92cc56a73060'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:52.782705 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-edac01b8-82e1-4c4e-868c-92cc56a73060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16833589d53b47da826bd615e76de9aa', 'request_id': 'req-edac01b8-82e1-4c4e-868c-92cc56a73060'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:52.795840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-edac01b8-82e1-4c4e-868c-92cc56a73060 admin admin] The token cache is being invalidate because project 16833589d53b47da826bd615e76de9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:52.797896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-edac01b8-82e1-4c4e-868c-92cc56a73060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:52.800261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-edac01b8-82e1-4c4e-868c-92cc56a73060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:52.802319 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1089/2167] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:52 2022] DELETE /identity/v3/projects/16833589d53b47da826bd615e76de9aa => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:52.807108 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cc97a-73fe-42f7-8a7c-e17d32bb3e71 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:52.807720 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cc97a-73fe-42f7-8a7c-e17d32bb3e71 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:52.807808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cc97a-73fe-42f7-8a7c-e17d32bb3e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:52.871213 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-300cc97a-73fe-42f7-8a7c-e17d32bb3e71 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:52.872733 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-300cc97a-73fe-42f7-8a7c-e17d32bb3e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:53.026857 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1079/2168] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:53.035838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2fdc4-053a-4347-8e58-4307477fce40 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:53.036155 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2fdc4-053a-4347-8e58-4307477fce40 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:53.036461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2fdc4-053a-4347-8e58-4307477fce40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:53.063732 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-88f2fdc4-053a-4347-8e58-4307477fce40 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:53.065563 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-88f2fdc4-053a-4347-8e58-4307477fce40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:53.085880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1090/2169] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:53.090650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cc97a-73fe-42f7-8a7c-e17d32bb3e71 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:53.100961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cc97a-73fe-42f7-8a7c-e17d32bb3e71 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:53.110809 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c82b9-ad92-489a-aba8-de516f99f403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:53.111576 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c82b9-ad92-489a-aba8-de516f99f403 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:53.111904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c82b9-ad92-489a-aba8-de516f99f403 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:53.112285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c82b9-ad92-489a-aba8-de516f99f403 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:53.113812 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c82b9-ad92-489a-aba8-de516f99f403 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:53.114937 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c82b9-ad92-489a-aba8-de516f99f403 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:53.117677 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c82b9-ad92-489a-aba8-de516f99f403 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:53.145830 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1080/2170] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:54:53.149550 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2fdc4-053a-4347-8e58-4307477fce40 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:53.161240 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc59d62-6ec3-4ad0-b02d-9211d2de134c None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:53.161587 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc59d62-6ec3-4ad0-b02d-9211d2de134c None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:53.161968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc59d62-6ec3-4ad0-b02d-9211d2de134c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:53.165710 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2fdc4-053a-4347-8e58-4307477fce40 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:53.184800 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043bdc2-a3c6-46e8-b42b-87793888a066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:53.185481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043bdc2-a3c6-46e8-b42b-87793888a066 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:53.185763 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043bdc2-a3c6-46e8-b42b-87793888a066 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:53.186033 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043bdc2-a3c6-46e8-b42b-87793888a066 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:53.186743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043bdc2-a3c6-46e8-b42b-87793888a066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:53.188709 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043bdc2-a3c6-46e8-b42b-87793888a066 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:53.197002 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-1bc59d62-6ec3-4ad0-b02d-9211d2de134c None None] MFA Rules not processed for user `1c9db6fb132840a68b762e73132313ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:53.199793 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1bc59d62-6ec3-4ad0-b02d-9211d2de134c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:53.248976 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1091/2171] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:53 2022] POST /identity/v3/projects => generated 401 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:53.254802 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043bdc2-a3c6-46e8-b42b-87793888a066 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:53.347234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043bdc2-a3c6-46e8-b42b-87793888a066 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:53.356666 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05430b0d-3f3d-410f-9d4d-24cf66bbfc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:53.357428 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05430b0d-3f3d-410f-9d4d-24cf66bbfc6f admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:53.357712 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05430b0d-3f3d-410f-9d4d-24cf66bbfc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:53.357989 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05430b0d-3f3d-410f-9d4d-24cf66bbfc6f admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:53.358697 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05430b0d-3f3d-410f-9d4d-24cf66bbfc6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:53.361853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05430b0d-3f3d-410f-9d4d-24cf66bbfc6f admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:53.396593 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1081/2172] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:53.396880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1092/2173] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:53 2022] POST /identity/v3/users => generated 301 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:53.404510 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc59d62-6ec3-4ad0-b02d-9211d2de134c None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:53.407934 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05430b0d-3f3d-410f-9d4d-24cf66bbfc6f admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:53.410939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-05430b0d-3f3d-410f-9d4d-24cf66bbfc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:53.419878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc59d62-6ec3-4ad0-b02d-9211d2de134c None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:53.432961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e6775-2094-4383-b3cd-a3a2fe745a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:53.433934 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e6775-2094-4383-b3cd-a3a2fe745a9b admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:53.434368 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e6775-2094-4383-b3cd-a3a2fe745a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:53.434780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e6775-2094-4383-b3cd-a3a2fe745a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:53.435656 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e6775-2094-4383-b3cd-a3a2fe745a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:53.437569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e6775-2094-4383-b3cd-a3a2fe745a9b admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:53.476334 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1082/2174] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:53.477765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e6775-2094-4383-b3cd-a3a2fe745a9b admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:53.495989 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e6775-2094-4383-b3cd-a3a2fe745a9b admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:53.513057 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9cb9a-ebd6-4f71-8f1f-0ce2a695ec1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:53.513755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9cb9a-ebd6-4f71-8f1f-0ce2a695ec1b admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:53.514040 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9cb9a-ebd6-4f71-8f1f-0ce2a695ec1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:53.514315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9cb9a-ebd6-4f71-8f1f-0ce2a695ec1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:53.515507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9cb9a-ebd6-4f71-8f1f-0ce2a695ec1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:53.517520 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9cb9a-ebd6-4f71-8f1f-0ce2a695ec1b admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:53.539103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05430b0d-3f3d-410f-9d4d-24cf66bbfc6f admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:53.543195 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1083/2175] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:53.543663 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9cb9a-ebd6-4f71-8f1f-0ce2a695ec1b admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:53.555372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f04544-134a-44f1-a16c-db3ce720d8b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:53.556171 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f04544-134a-44f1-a16c-db3ce720d8b6 service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:53.556550 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f04544-134a-44f1-a16c-db3ce720d8b6 service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:53.556895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f04544-134a-44f1-a16c-db3ce720d8b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:53.561318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9cb9a-ebd6-4f71-8f1f-0ce2a695ec1b admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:53.564189 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-84f04544-134a-44f1-a16c-db3ce720d8b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:53.564731 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5bceb-4edf-4775-aff8-73e33df10a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:53.565703 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5bceb-4edf-4775-aff8-73e33df10a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:53.566332 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5bceb-4edf-4775-aff8-73e33df10a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:53.566688 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5bceb-4edf-4775-aff8-73e33df10a4a admin admin] PATH_INFO: `/v3/projects/b5800d6478f14bf292b8054198ec9ed6/users/b6005b98bfad4b38a177d58e9186e634/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:53.599446 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5bceb-4edf-4775-aff8-73e33df10a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5800d6478f14bf292b8054198ec9ed6, user_id=b6005b98bfad4b38a177d58e9186e634, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:53.603040 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5bceb-4edf-4775-aff8-73e33df10a4a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:53.652356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1084/2176] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:53 2022] PUT /identity/v3/projects/b5800d6478f14bf292b8054198ec9ed6/users/b6005b98bfad4b38a177d58e9186e634/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:53.663367 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f04544-134a-44f1-a16c-db3ce720d8b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:53.664491 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a9464-bf9d-4ad8-9eaa-9e9cbd9610f1 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:53.664786 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a9464-bf9d-4ad8-9eaa-9e9cbd9610f1 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:53.665067 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a9464-bf9d-4ad8-9eaa-9e9cbd9610f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:53.666635 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f04544-134a-44f1-a16c-db3ce720d8b6 service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:53.679272 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1093/2177] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:53.719341 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-1c5a9464-bf9d-4ad8-9eaa-9e9cbd9610f1 None None] MFA Rules not processed for user `b6005b98bfad4b38a177d58e9186e634`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:53.720930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1c5a9464-bf9d-4ad8-9eaa-9e9cbd9610f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:53.851556 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1085/2178] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:53.857797 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f04544-134a-44f1-a16c-db3ce720d8b6 service nova] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:53.871450 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f04544-134a-44f1-a16c-db3ce720d8b6 service nova] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:53.987758 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e67c6c-404c-4711-925b-75614f79ee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:53.988558 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e67c6c-404c-4711-925b-75614f79ee81 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:53.990030 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e67c6c-404c-4711-925b-75614f79ee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:53.990891 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e67c6c-404c-4711-925b-75614f79ee81 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:53.992300 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e67c6c-404c-4711-925b-75614f79ee81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:53.995178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e67c6c-404c-4711-925b-75614f79ee81 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:54.072762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1094/2179] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:53 2022] POST /identity/v3/projects => generated 397 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:54.075344 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a9464-bf9d-4ad8-9eaa-9e9cbd9610f1 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:54.091890 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a9464-bf9d-4ad8-9eaa-9e9cbd9610f1 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:54.263869 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650fad0-0192-43ec-99e6-f322f01446e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:54.264781 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650fad0-0192-43ec-99e6-f322f01446e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:54.265130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650fad0-0192-43ec-99e6-f322f01446e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:54.265811 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650fad0-0192-43ec-99e6-f322f01446e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:54.266715 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650fad0-0192-43ec-99e6-f322f01446e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:54.278684 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650fad0-0192-43ec-99e6-f322f01446e2 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:54.308190 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1086/2180] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:54 2022] POST /identity/v3/users => generated 305 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:54:54.312479 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e67c6c-404c-4711-925b-75614f79ee81 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:54.328499 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e67c6c-404c-4711-925b-75614f79ee81 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:54.330916 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2609497-45af-41a6-bc7a-30e6c59857e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:54.331676 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2609497-45af-41a6-bc7a-30e6c59857e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:54.332040 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2609497-45af-41a6-bc7a-30e6c59857e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:54.332434 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2609497-45af-41a6-bc7a-30e6c59857e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:54.333244 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2609497-45af-41a6-bc7a-30e6c59857e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:54.335076 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2609497-45af-41a6-bc7a-30e6c59857e1 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:54.351453 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1095/2181] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:54.352902 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650fad0-0192-43ec-99e6-f322f01446e2 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:54.363395 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650fad0-0192-43ec-99e6-f322f01446e2 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:54.368774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7364d06-3427-496d-aca4-41a0bacede2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:54.369731 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7364d06-3427-496d-aca4-41a0bacede2a admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:54.370153 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7364d06-3427-496d-aca4-41a0bacede2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:54.370432 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7364d06-3427-496d-aca4-41a0bacede2a admin admin] PATH_INFO: `/v3/projects/6686ac56f6b64326a57ba15a8d89fa3d/users/f9323889d2d548e096ccbfcd9d6f664c/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:54.409077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7364d06-3427-496d-aca4-41a0bacede2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6686ac56f6b64326a57ba15a8d89fa3d, user_id=f9323889d2d548e096ccbfcd9d6f664c, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:54.412143 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7364d06-3427-496d-aca4-41a0bacede2a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:54.431736 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1087/2182] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:54 2022] PUT /identity/v3/projects/6686ac56f6b64326a57ba15a8d89fa3d/users/f9323889d2d548e096ccbfcd9d6f664c/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:54.433380 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2609497-45af-41a6-bc7a-30e6c59857e1 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:54.444925 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2609497-45af-41a6-bc7a-30e6c59857e1 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:54.517063 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d979f3-64c9-4dae-9d96-f43fe386c7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:54.517791 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d979f3-64c9-4dae-9d96-f43fe386c7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:54.518073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d979f3-64c9-4dae-9d96-f43fe386c7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:54.518347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d979f3-64c9-4dae-9d96-f43fe386c7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:54.519084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d979f3-64c9-4dae-9d96-f43fe386c7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:54.521144 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d979f3-64c9-4dae-9d96-f43fe386c7a4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:54.533192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1096/2183] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:54.537739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7364d06-3427-496d-aca4-41a0bacede2a admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:54.549136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7364d06-3427-496d-aca4-41a0bacede2a admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:54.554211 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e78e65-e921-4fb6-8424-9b2a3419ddf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:54.555128 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e78e65-e921-4fb6-8424-9b2a3419ddf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:54.555405 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e78e65-e921-4fb6-8424-9b2a3419ddf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:54.555681 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e78e65-e921-4fb6-8424-9b2a3419ddf0 admin admin] PATH_INFO: `/v3/projects/6686ac56f6b64326a57ba15a8d89fa3d/users/f9323889d2d548e096ccbfcd9d6f664c/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:54.557971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e78e65-e921-4fb6-8424-9b2a3419ddf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6686ac56f6b64326a57ba15a8d89fa3d, user_id=f9323889d2d548e096ccbfcd9d6f664c, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:54.560873 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e78e65-e921-4fb6-8424-9b2a3419ddf0 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:54.573157 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1088/2184] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:54 2022] PUT /identity/v3/projects/6686ac56f6b64326a57ba15a8d89fa3d/users/f9323889d2d548e096ccbfcd9d6f664c/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:54.587021 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9ac9-7891-4fdb-b2b4-434573780a84 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:54.588027 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9ac9-7891-4fdb-b2b4-434573780a84 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:54.588615 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9ac9-7891-4fdb-b2b4-434573780a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:54.625109 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-495a9ac9-7891-4fdb-b2b4-434573780a84 None None] MFA Rules not processed for user `f9323889d2d548e096ccbfcd9d6f664c`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:54.627386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-495a9ac9-7891-4fdb-b2b4-434573780a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:54.718232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1097/2185] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:54.731091 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e78e65-e921-4fb6-8424-9b2a3419ddf0 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:54.733409 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-29e78e65-e921-4fb6-8424-9b2a3419ddf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:54.893882 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e78e65-e921-4fb6-8424-9b2a3419ddf0 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:54.899439 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aa00f-df5c-4ac4-a432-829cb3c1cd4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:54.900690 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aa00f-df5c-4ac4-a432-829cb3c1cd4b service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:54.901003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aa00f-df5c-4ac4-a432-829cb3c1cd4b service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:54.901465 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aa00f-df5c-4ac4-a432-829cb3c1cd4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:54.912595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aa00f-df5c-4ac4-a432-829cb3c1cd4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:54.914190 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aa00f-df5c-4ac4-a432-829cb3c1cd4b service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:54.927849 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1089/2186] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:55.034829 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a9ac9-7891-4fdb-b2b4-434573780a84 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:55.045407 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a9ac9-7891-4fdb-b2b4-434573780a84 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:55.061338 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1349bb1-2ec1-46f1-91fb-ff361641d9d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:55.062328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1349bb1-2ec1-46f1-91fb-ff361641d9d2 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:55.062807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1349bb1-2ec1-46f1-91fb-ff361641d9d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:55.063278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1349bb1-2ec1-46f1-91fb-ff361641d9d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:55.183214 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1349bb1-2ec1-46f1-91fb-ff361641d9d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:55.184800 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1349bb1-2ec1-46f1-91fb-ff361641d9d2 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:55.196498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1098/2187] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:57.822742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aa00f-df5c-4ac4-a432-829cb3c1cd4b service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:57.826327 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c68aa00f-df5c-4ac4-a432-829cb3c1cd4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:57.950193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aa00f-df5c-4ac4-a432-829cb3c1cd4b service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:57.960735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3deeb-e07a-4ea7-97bd-13fd05010f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:57.961800 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3deeb-e07a-4ea7-97bd-13fd05010f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:57.962461 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3deeb-e07a-4ea7-97bd-13fd05010f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:57.962957 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3deeb-e07a-4ea7-97bd-13fd05010f91 admin admin] PATH_INFO: `/v3/users/51433f18966e4e90942932295ccd52b4` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:57.965451 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3deeb-e07a-4ea7-97bd-13fd05010f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51433f18966e4e90942932295ccd52b4)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:57.968193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3deeb-e07a-4ea7-97bd-13fd05010f91 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:58.039179 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-53b3deeb-e07a-4ea7-97bd-13fd05010f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51433f18966e4e90942932295ccd52b4'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:58.040194 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-53b3deeb-e07a-4ea7-97bd-13fd05010f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51433f18966e4e90942932295ccd52b4'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:58.056680 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-53b3deeb-e07a-4ea7-97bd-13fd05010f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51433f18966e4e90942932295ccd52b4'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:58.057650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-53b3deeb-e07a-4ea7-97bd-13fd05010f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51433f18966e4e90942932295ccd52b4'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:58.069931 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-53b3deeb-e07a-4ea7-97bd-13fd05010f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51433f18966e4e90942932295ccd52b4'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:58.089842 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1090/2188] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:57 2022] DELETE /identity/v3/users/51433f18966e4e90942932295ccd52b4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:58.091404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed960f-6874-47c1-8af4-f72564b2f093 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:58.091855 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed960f-6874-47c1-8af4-f72564b2f093 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:58.092263 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed960f-6874-47c1-8af4-f72564b2f093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:58.111908 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-5aed960f-6874-47c1-8af4-f72564b2f093 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:58.113643 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5aed960f-6874-47c1-8af4-f72564b2f093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:58.226076 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3deeb-e07a-4ea7-97bd-13fd05010f91 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:58.227857 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-53b3deeb-e07a-4ea7-97bd-13fd05010f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:58.244558 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1099/2189] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:54:58.327282 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3deeb-e07a-4ea7-97bd-13fd05010f91 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:58.333670 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcb34e-d2a4-4133-93a0-4c8389c390d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:58.334328 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcb34e-d2a4-4133-93a0-4c8389c390d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:58.334658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcb34e-d2a4-4133-93a0-4c8389c390d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:58.335010 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcb34e-d2a4-4133-93a0-4c8389c390d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:58.346620 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcb34e-d2a4-4133-93a0-4c8389c390d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:58.348954 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcb34e-d2a4-4133-93a0-4c8389c390d0 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:58.373264 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1091/2190] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:54:58.707159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed960f-6874-47c1-8af4-f72564b2f093 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:58.711759 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5aed960f-6874-47c1-8af4-f72564b2f093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:58.751896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed960f-6874-47c1-8af4-f72564b2f093 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:58.763044 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce3765-dd88-4dfe-a45c-91976e0dd024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:58.765317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce3765-dd88-4dfe-a45c-91976e0dd024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:58.766133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce3765-dd88-4dfe-a45c-91976e0dd024 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:58.766624 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce3765-dd88-4dfe-a45c-91976e0dd024 admin admin] PATH_INFO: `/v3/projects/1b12bc906c404d35bc4111149a3c384f` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:58.771246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce3765-dd88-4dfe-a45c-91976e0dd024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b12bc906c404d35bc4111149a3c384f)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:58.773338 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce3765-dd88-4dfe-a45c-91976e0dd024 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:58.826697 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-05ce3765-dd88-4dfe-a45c-91976e0dd024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b12bc906c404d35bc4111149a3c384f', 'request_id': 'req-05ce3765-dd88-4dfe-a45c-91976e0dd024'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:58.839651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-05ce3765-dd88-4dfe-a45c-91976e0dd024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b12bc906c404d35bc4111149a3c384f', 'request_id': 'req-05ce3765-dd88-4dfe-a45c-91976e0dd024'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:58.847444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-05ce3765-dd88-4dfe-a45c-91976e0dd024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b12bc906c404d35bc4111149a3c384f', 'request_id': 'req-05ce3765-dd88-4dfe-a45c-91976e0dd024'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:58.858711 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-05ce3765-dd88-4dfe-a45c-91976e0dd024 admin admin] The token cache is being invalidate because project 1b12bc906c404d35bc4111149a3c384f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:58.858992 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-05ce3765-dd88-4dfe-a45c-91976e0dd024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:58.859677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-05ce3765-dd88-4dfe-a45c-91976e0dd024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:58.861774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1100/2191] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:58 2022] DELETE /identity/v3/projects/1b12bc906c404d35bc4111149a3c384f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:58.866770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413594-846c-4bd9-a128-908b0a514a2e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:58.867783 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413594-846c-4bd9-a128-908b0a514a2e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:58.868537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413594-846c-4bd9-a128-908b0a514a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:58.887931 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-96413594-846c-4bd9-a128-908b0a514a2e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:58.889330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-96413594-846c-4bd9-a128-908b0a514a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:58.966207 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1092/2192] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:58.976335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b38447-bfcf-4cf9-84c2-29e574161003 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:58.976646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b38447-bfcf-4cf9-84c2-29e574161003 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:58.976904 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b38447-bfcf-4cf9-84c2-29e574161003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:58.996288 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-47b38447-bfcf-4cf9-84c2-29e574161003 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:58.997483 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-47b38447-bfcf-4cf9-84c2-29e574161003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:59.009216 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1101/2193] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:59.010909 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96413594-846c-4bd9-a128-908b0a514a2e None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:59.021971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96413594-846c-4bd9-a128-908b0a514a2e None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:59.027473 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f50ce9-00ba-466e-a6d2-97bc96f489b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:59.028232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f50ce9-00ba-466e-a6d2-97bc96f489b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:59.028533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f50ce9-00ba-466e-a6d2-97bc96f489b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:59.028807 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f50ce9-00ba-466e-a6d2-97bc96f489b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:59.029537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f50ce9-00ba-466e-a6d2-97bc96f489b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:59.029845 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f50ce9-00ba-466e-a6d2-97bc96f489b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:59.031876 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f50ce9-00ba-466e-a6d2-97bc96f489b5 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:59.045373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1093/2194] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:54:59.050177 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b38447-bfcf-4cf9-84c2-29e574161003 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:59.060078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b38447-bfcf-4cf9-84c2-29e574161003 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:59.065530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404fa49-d947-4771-8e65-7336c0ae08c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:59.066423 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404fa49-d947-4771-8e65-7336c0ae08c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:59.066564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404fa49-d947-4771-8e65-7336c0ae08c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:59.066730 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404fa49-d947-4771-8e65-7336c0ae08c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:59.067557 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404fa49-d947-4771-8e65-7336c0ae08c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:59.069752 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404fa49-d947-4771-8e65-7336c0ae08c8 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:59.106257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1102/2195] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:59 2022] POST /identity/v3/projects => generated 403 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:54:59.110068 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f50ce9-00ba-466e-a6d2-97bc96f489b5 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:59.122938 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f50ce9-00ba-466e-a6d2-97bc96f489b5 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:59.200542 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0370f1-bbeb-4d4b-9bc6-9383f152b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:59.201235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0370f1-bbeb-4d4b-9bc6-9383f152b9bb admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:59.202193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0370f1-bbeb-4d4b-9bc6-9383f152b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:59.202193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0370f1-bbeb-4d4b-9bc6-9383f152b9bb admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:59.202487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0370f1-bbeb-4d4b-9bc6-9383f152b9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:59.204467 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0370f1-bbeb-4d4b-9bc6-9383f152b9bb admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:59.242268 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1094/2196] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:59 2022] POST /identity/v3/users => generated 302 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:59.246604 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404fa49-d947-4771-8e65-7336c0ae08c8 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:59.272953 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404fa49-d947-4771-8e65-7336c0ae08c8 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:59.280562 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee8383-5367-49d2-bf1f-9cddc6ee1285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:59.281284 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee8383-5367-49d2-bf1f-9cddc6ee1285 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:59.281564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee8383-5367-49d2-bf1f-9cddc6ee1285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:59.281842 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee8383-5367-49d2-bf1f-9cddc6ee1285 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:59.282641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee8383-5367-49d2-bf1f-9cddc6ee1285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:59.284372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee8383-5367-49d2-bf1f-9cddc6ee1285 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:59.304148 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1103/2197] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:59.309453 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0370f1-bbeb-4d4b-9bc6-9383f152b9bb admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:59.324944 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0370f1-bbeb-4d4b-9bc6-9383f152b9bb admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:59.329962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af9b33-fd97-49b5-9c41-345ff9dd5239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:59.335570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af9b33-fd97-49b5-9c41-345ff9dd5239 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:59.335997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af9b33-fd97-49b5-9c41-345ff9dd5239 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:59.336394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af9b33-fd97-49b5-9c41-345ff9dd5239 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:59.337314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af9b33-fd97-49b5-9c41-345ff9dd5239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:59.339233 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af9b33-fd97-49b5-9c41-345ff9dd5239 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:59.351480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1095/2198] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:59.356136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee8383-5367-49d2-bf1f-9cddc6ee1285 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:59.367187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee8383-5367-49d2-bf1f-9cddc6ee1285 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:59.372368 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29edbe-356e-4dab-a5c7-75b4cf4c9ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:59.373298 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29edbe-356e-4dab-a5c7-75b4cf4c9ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:59.373585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29edbe-356e-4dab-a5c7-75b4cf4c9ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:59.373866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29edbe-356e-4dab-a5c7-75b4cf4c9ebe admin admin] PATH_INFO: `/v3/projects/27a1fa5d92b245b3beed97f01e1ac711/users/c740cd714848479ea81f6523b756b414/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:59.422438 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29edbe-356e-4dab-a5c7-75b4cf4c9ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a1fa5d92b245b3beed97f01e1ac711, user_id=c740cd714848479ea81f6523b756b414, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:59.426108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29edbe-356e-4dab-a5c7-75b4cf4c9ebe admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:59.451258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1104/2199] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:59 2022] PUT /identity/v3/projects/27a1fa5d92b245b3beed97f01e1ac711/users/c740cd714848479ea81f6523b756b414/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:59.456532 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cce75c-eb38-4e85-aa76-864781482dac None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:59.456821 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cce75c-eb38-4e85-aa76-864781482dac None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:59.457108 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cce75c-eb38-4e85-aa76-864781482dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:59.485711 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-50cce75c-eb38-4e85-aa76-864781482dac None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:59.487187 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-50cce75c-eb38-4e85-aa76-864781482dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:59.574659 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1096/2200] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:59.585087 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29edbe-356e-4dab-a5c7-75b4cf4c9ebe admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:59.587038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-9e29edbe-356e-4dab-a5c7-75b4cf4c9ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:59.652359 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29edbe-356e-4dab-a5c7-75b4cf4c9ebe admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:59.657516 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bb742-947c-4482-8b58-be780538d7fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:59.658257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bb742-947c-4482-8b58-be780538d7fb service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:59.658545 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bb742-947c-4482-8b58-be780538d7fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:59.658813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bb742-947c-4482-8b58-be780538d7fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:59.669836 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bb742-947c-4482-8b58-be780538d7fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:59.671326 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bb742-947c-4482-8b58-be780538d7fb service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:59.688489 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1105/2201] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:00.384464 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6a781-ba66-4566-b08c-854590307f29 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:00.384464 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6a781-ba66-4566-b08c-854590307f29 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:00.384464 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6a781-ba66-4566-b08c-854590307f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:00.430579 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-99d6a781-ba66-4566-b08c-854590307f29 None None] MFA Rules not processed for user `c740cd714848479ea81f6523b756b414`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:00.432157 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-99d6a781-ba66-4566-b08c-854590307f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:00.515184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1097/2202] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:00.521755 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bb742-947c-4482-8b58-be780538d7fb service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:00.533893 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bb742-947c-4482-8b58-be780538d7fb service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:00.539441 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b3317-688d-4f28-8cee-8ee769215792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:00.540282 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b3317-688d-4f28-8cee-8ee769215792 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:00.540991 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b3317-688d-4f28-8cee-8ee769215792 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:00.541394 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b3317-688d-4f28-8cee-8ee769215792 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:00.542243 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b3317-688d-4f28-8cee-8ee769215792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:00.544384 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b3317-688d-4f28-8cee-8ee769215792 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:00.573438 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1106/2203] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:00 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:00.577794 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6a781-ba66-4566-b08c-854590307f29 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:00.590182 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6a781-ba66-4566-b08c-854590307f29 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:00.661980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008b2e1-3cec-4e5f-a207-3882a1d1b6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:00.663075 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008b2e1-3cec-4e5f-a207-3882a1d1b6cb admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:00.663350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008b2e1-3cec-4e5f-a207-3882a1d1b6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:00.663804 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008b2e1-3cec-4e5f-a207-3882a1d1b6cb admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:00.664581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008b2e1-3cec-4e5f-a207-3882a1d1b6cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:00.666609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008b2e1-3cec-4e5f-a207-3882a1d1b6cb admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:00.688881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1098/2204] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:00 2022] POST /identity/v3/users => generated 309 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:00.693251 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b3317-688d-4f28-8cee-8ee769215792 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:00.704319 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b3317-688d-4f28-8cee-8ee769215792 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:00.709088 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2158c-4fd5-4c9a-a0ba-40ca446e641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:00.709772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2158c-4fd5-4c9a-a0ba-40ca446e641a admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:00.710015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2158c-4fd5-4c9a-a0ba-40ca446e641a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:00.710475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2158c-4fd5-4c9a-a0ba-40ca446e641a admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:00.711223 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2158c-4fd5-4c9a-a0ba-40ca446e641a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:00.712909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2158c-4fd5-4c9a-a0ba-40ca446e641a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:00.724117 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1107/2205] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:00.728501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008b2e1-3cec-4e5f-a207-3882a1d1b6cb admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:00.739583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008b2e1-3cec-4e5f-a207-3882a1d1b6cb admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:00.744562 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4378ef3-806a-4ef9-ac7c-5be533845b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:00.745486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4378ef3-806a-4ef9-ac7c-5be533845b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:00.745839 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4378ef3-806a-4ef9-ac7c-5be533845b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:00.746112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4378ef3-806a-4ef9-ac7c-5be533845b05 admin admin] PATH_INFO: `/v3/projects/0b45d532a30343db9ec3f3fb3017855d/users/97ed53e99878425187997bc5d8078c40/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:00.762114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4378ef3-806a-4ef9-ac7c-5be533845b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b45d532a30343db9ec3f3fb3017855d, user_id=97ed53e99878425187997bc5d8078c40, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:00.764780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4378ef3-806a-4ef9-ac7c-5be533845b05 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:00.779314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1099/2206] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:00 2022] PUT /identity/v3/projects/0b45d532a30343db9ec3f3fb3017855d/users/97ed53e99878425187997bc5d8078c40/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:00.783386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2158c-4fd5-4c9a-a0ba-40ca446e641a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:00.795055 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2158c-4fd5-4c9a-a0ba-40ca446e641a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:00.867542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2469fc-23d3-4ff3-8209-0d6b1e5f6aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:00.868423 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2469fc-23d3-4ff3-8209-0d6b1e5f6aba admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:00.868864 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2469fc-23d3-4ff3-8209-0d6b1e5f6aba admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:00.869295 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2469fc-23d3-4ff3-8209-0d6b1e5f6aba admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:00.870389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2469fc-23d3-4ff3-8209-0d6b1e5f6aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:00.873656 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2469fc-23d3-4ff3-8209-0d6b1e5f6aba admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:00.886812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1108/2207] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:00.891440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4378ef3-806a-4ef9-ac7c-5be533845b05 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:00.904561 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4378ef3-806a-4ef9-ac7c-5be533845b05 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:00.909480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de98bf-ba33-4634-82c5-5d43e429e2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:00.910466 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de98bf-ba33-4634-82c5-5d43e429e2fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:00.910815 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de98bf-ba33-4634-82c5-5d43e429e2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:00.911158 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de98bf-ba33-4634-82c5-5d43e429e2fc admin admin] PATH_INFO: `/v3/projects/0b45d532a30343db9ec3f3fb3017855d/users/97ed53e99878425187997bc5d8078c40/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:00.914373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de98bf-ba33-4634-82c5-5d43e429e2fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b45d532a30343db9ec3f3fb3017855d, user_id=97ed53e99878425187997bc5d8078c40, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:00.917639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de98bf-ba33-4634-82c5-5d43e429e2fc admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:00.930418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1100/2208] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:00 2022] PUT /identity/v3/projects/0b45d532a30343db9ec3f3fb3017855d/users/97ed53e99878425187997bc5d8078c40/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:00.944503 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2469fc-23d3-4ff3-8209-0d6b1e5f6aba admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:00.946390 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6c2469fc-23d3-4ff3-8209-0d6b1e5f6aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:00.961442 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2469fc-23d3-4ff3-8209-0d6b1e5f6aba admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:01.063847 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289117-c344-4cf3-ada5-13b3dfc0cea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:01.064821 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289117-c344-4cf3-ada5-13b3dfc0cea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:01.065107 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289117-c344-4cf3-ada5-13b3dfc0cea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:01.065381 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289117-c344-4cf3-ada5-13b3dfc0cea2 admin admin] PATH_INFO: `/v3/users/b6005b98bfad4b38a177d58e9186e634` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:01.066862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289117-c344-4cf3-ada5-13b3dfc0cea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6005b98bfad4b38a177d58e9186e634)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:01.068940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289117-c344-4cf3-ada5-13b3dfc0cea2 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:01.128169 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-64289117-c344-4cf3-ada5-13b3dfc0cea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6005b98bfad4b38a177d58e9186e634'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:01.128773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-64289117-c344-4cf3-ada5-13b3dfc0cea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6005b98bfad4b38a177d58e9186e634'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:01.146815 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-64289117-c344-4cf3-ada5-13b3dfc0cea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6005b98bfad4b38a177d58e9186e634'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:01.147892 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-64289117-c344-4cf3-ada5-13b3dfc0cea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6005b98bfad4b38a177d58e9186e634'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:01.159992 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-64289117-c344-4cf3-ada5-13b3dfc0cea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6005b98bfad4b38a177d58e9186e634'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:01.175568 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1109/2209] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:00 2022] DELETE /identity/v3/users/b6005b98bfad4b38a177d58e9186e634 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:01.180129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fd426-8f42-46b2-ba37-e552c72de532 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:01.180809 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fd426-8f42-46b2-ba37-e552c72de532 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:01.180809 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fd426-8f42-46b2-ba37-e552c72de532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:01.200111 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-469fd426-8f42-46b2-ba37-e552c72de532 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:01.202051 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-469fd426-8f42-46b2-ba37-e552c72de532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:01.295371 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1101/2210] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:55:01.312345 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289117-c344-4cf3-ada5-13b3dfc0cea2 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:01.313816 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-64289117-c344-4cf3-ada5-13b3dfc0cea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:01.387956 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289117-c344-4cf3-ada5-13b3dfc0cea2 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:01.392494 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41226003-25a4-476e-afbe-1c413b76eae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:01.393274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41226003-25a4-476e-afbe-1c413b76eae4 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:01.396549 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41226003-25a4-476e-afbe-1c413b76eae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:01.396549 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41226003-25a4-476e-afbe-1c413b76eae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:01.413577 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41226003-25a4-476e-afbe-1c413b76eae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:01.415200 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41226003-25a4-476e-afbe-1c413b76eae4 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:01.426179 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1110/2211] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:01.887849 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fd426-8f42-46b2-ba37-e552c72de532 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:01.902494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-469fd426-8f42-46b2-ba37-e552c72de532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:01.929898 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d7a1e-560a-426d-b23a-abb426edbb25 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:01.931191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d7a1e-560a-426d-b23a-abb426edbb25 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:01.931540 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d7a1e-560a-426d-b23a-abb426edbb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:01.933115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fd426-8f42-46b2-ba37-e552c72de532 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:01.937724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:01.938766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:01.939036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:01.939299 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d admin admin] PATH_INFO: `/v3/projects/b5800d6478f14bf292b8054198ec9ed6` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:01.940658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5800d6478f14bf292b8054198ec9ed6)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:01.942722 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:01.962003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-358d7a1e-560a-426d-b23a-abb426edbb25 None None] MFA Rules not processed for user `97ed53e99878425187997bc5d8078c40`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:01.963396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-358d7a1e-560a-426d-b23a-abb426edbb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:01.998552 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5800d6478f14bf292b8054198ec9ed6', 'request_id': 'req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:02.007557 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5800d6478f14bf292b8054198ec9ed6', 'request_id': 'req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:02.018606 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5800d6478f14bf292b8054198ec9ed6', 'request_id': 'req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:02.034312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d admin admin] The token cache is being invalidate because project b5800d6478f14bf292b8054198ec9ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:02.034598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:02.035430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:02.039965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1102/2212] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:01 2022] DELETE /identity/v3/projects/b5800d6478f14bf292b8054198ec9ed6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:02.041383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:02.042954 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:02.072515 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1111/2213] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:01 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:55:02.118805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f37e3-9283-4a4f-afdb-a3eb9adf9d9d admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:02.123734 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5331c3-51bf-41d8-b0fe-8e2989deb2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:02.124663 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5331c3-51bf-41d8-b0fe-8e2989deb2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:02.124939 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5331c3-51bf-41d8-b0fe-8e2989deb2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:02.125397 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5331c3-51bf-41d8-b0fe-8e2989deb2c4 admin admin] PATH_INFO: `/v3/users/f9323889d2d548e096ccbfcd9d6f664c` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:02.126587 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5331c3-51bf-41d8-b0fe-8e2989deb2c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9323889d2d548e096ccbfcd9d6f664c)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:02.128803 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5331c3-51bf-41d8-b0fe-8e2989deb2c4 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:02.185930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8f5331c3-51bf-41d8-b0fe-8e2989deb2c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9323889d2d548e096ccbfcd9d6f664c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:02.186856 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8f5331c3-51bf-41d8-b0fe-8e2989deb2c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9323889d2d548e096ccbfcd9d6f664c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:02.198967 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8f5331c3-51bf-41d8-b0fe-8e2989deb2c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9323889d2d548e096ccbfcd9d6f664c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:02.199682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8f5331c3-51bf-41d8-b0fe-8e2989deb2c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9323889d2d548e096ccbfcd9d6f664c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:02.208533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8f5331c3-51bf-41d8-b0fe-8e2989deb2c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9323889d2d548e096ccbfcd9d6f664c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:02.223156 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1103/2214] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:02 2022] DELETE /identity/v3/users/f9323889d2d548e096ccbfcd9d6f664c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:02.564459 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d7a1e-560a-426d-b23a-abb426edbb25 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:02.575458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d7a1e-560a-426d-b23a-abb426edbb25 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:02.653892 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108622f-8534-48de-837e-9ebdf0d2bc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:02.655392 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108622f-8534-48de-837e-9ebdf0d2bc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:02.656104 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108622f-8534-48de-837e-9ebdf0d2bc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:02.656524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108622f-8534-48de-837e-9ebdf0d2bc50 admin admin] PATH_INFO: `/v3/projects/6686ac56f6b64326a57ba15a8d89fa3d` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:02.658986 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108622f-8534-48de-837e-9ebdf0d2bc50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6686ac56f6b64326a57ba15a8d89fa3d)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:02.663741 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108622f-8534-48de-837e-9ebdf0d2bc50 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:02.741809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6108622f-8534-48de-837e-9ebdf0d2bc50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6686ac56f6b64326a57ba15a8d89fa3d', 'request_id': 'req-6108622f-8534-48de-837e-9ebdf0d2bc50'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:02.748942 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59be125-8494-479f-920e-d7e852265f03 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:02.749273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59be125-8494-479f-920e-d7e852265f03 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:02.749497 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59be125-8494-479f-920e-d7e852265f03 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:02.751533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1104/2215] 10.222.0.90 () {54 vars in 921 bytes} [Wed Nov 2 12:55:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:55:02.756601 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6108622f-8534-48de-837e-9ebdf0d2bc50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6686ac56f6b64326a57ba15a8d89fa3d', 'request_id': 'req-6108622f-8534-48de-837e-9ebdf0d2bc50'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:02.764270 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6108622f-8534-48de-837e-9ebdf0d2bc50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6686ac56f6b64326a57ba15a8d89fa3d', 'request_id': 'req-6108622f-8534-48de-837e-9ebdf0d2bc50'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:02.777857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6108622f-8534-48de-837e-9ebdf0d2bc50 admin admin] The token cache is being invalidate because project 6686ac56f6b64326a57ba15a8d89fa3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:02.778266 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6108622f-8534-48de-837e-9ebdf0d2bc50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:02.779010 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6108622f-8534-48de-837e-9ebdf0d2bc50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:02.781032 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1112/2216] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:02 2022] DELETE /identity/v3/projects/6686ac56f6b64326a57ba15a8d89fa3d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:02.786470 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce896-8fe0-4456-8f22-66f75d6fd7c5 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:02.786923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce896-8fe0-4456-8f22-66f75d6fd7c5 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:02.787335 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce896-8fe0-4456-8f22-66f75d6fd7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:02.790052 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12996b-d054-4994-a33d-34264cc7506d None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:02.790537 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12996b-d054-4994-a33d-34264cc7506d None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:02.790902 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12996b-d054-4994-a33d-34264cc7506d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:02.821459 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-327ce896-8fe0-4456-8f22-66f75d6fd7c5 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:02.822678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-327ce896-8fe0-4456-8f22-66f75d6fd7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:02.904248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-fc12996b-d054-4994-a33d-34264cc7506d None None] MFA Rules not processed for user `65e89359a42b4b0592db48f5a5a6e465`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:02.909119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-fc12996b-d054-4994-a33d-34264cc7506d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:02.918685 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1105/2217] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:02.928824 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476e574-0fdd-478f-9256-ba01579baddd None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:02.929466 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476e574-0fdd-478f-9256-ba01579baddd None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:02.929895 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476e574-0fdd-478f-9256-ba01579baddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:02.954191 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-b476e574-0fdd-478f-9256-ba01579baddd None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:02.955647 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-b476e574-0fdd-478f-9256-ba01579baddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:02.964234 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1106/2218] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:02.967997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476e574-0fdd-478f-9256-ba01579baddd None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:02.978732 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476e574-0fdd-478f-9256-ba01579baddd None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:02.984380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4e806-6f41-410f-98ef-512e183c8076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:02.985049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4e806-6f41-410f-98ef-512e183c8076 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:02.985518 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4e806-6f41-410f-98ef-512e183c8076 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:02.985796 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4e806-6f41-410f-98ef-512e183c8076 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:02.986533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4e806-6f41-410f-98ef-512e183c8076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:55:02.986842 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4e806-6f41-410f-98ef-512e183c8076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:02.995227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4e806-6f41-410f-98ef-512e183c8076 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:03.012904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1107/2219] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:55:03.016924 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4e806-6f41-410f-98ef-512e183c8076 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:03.024391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1113/2220] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Nov 2 12:55:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:03.029076 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4e806-6f41-410f-98ef-512e183c8076 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:03.034864 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12996b-d054-4994-a33d-34264cc7506d None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:03.036678 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-fc12996b-d054-4994-a33d-34264cc7506d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:03.041227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600714d-71ce-4203-9b30-4e99657e0f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:03.042270 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600714d-71ce-4203-9b30-4e99657e0f49 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:03.042628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600714d-71ce-4203-9b30-4e99657e0f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:03.042925 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600714d-71ce-4203-9b30-4e99657e0f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:03.043762 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600714d-71ce-4203-9b30-4e99657e0f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:03.046005 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600714d-71ce-4203-9b30-4e99657e0f49 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:03.056640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12996b-d054-4994-a33d-34264cc7506d None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:03.068431 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad55f85-a279-4a50-94cb-beaf6e07951c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:03.069157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad55f85-a279-4a50-94cb-beaf6e07951c service placement] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:03.069573 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad55f85-a279-4a50-94cb-beaf6e07951c service placement] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:03.069807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad55f85-a279-4a50-94cb-beaf6e07951c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:03.079144 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad55f85-a279-4a50-94cb-beaf6e07951c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:03.080818 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad55f85-a279-4a50-94cb-beaf6e07951c service placement] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:03.081888 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1108/2221] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:03 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:03.091092 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600714d-71ce-4203-9b30-4e99657e0f49 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:03.098986 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1114/2222] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:55:03.188225 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600714d-71ce-4203-9b30-4e99657e0f49 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:03.195242 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e074a-0724-40bb-ac13-e764653dc366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:03.195999 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e074a-0724-40bb-ac13-e764653dc366 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:03.196302 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e074a-0724-40bb-ac13-e764653dc366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:03.196572 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e074a-0724-40bb-ac13-e764653dc366 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:03.197398 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e074a-0724-40bb-ac13-e764653dc366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:03.199473 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e074a-0724-40bb-ac13-e764653dc366 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:03.225322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1109/2223] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:03 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:03.229614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad55f85-a279-4a50-94cb-beaf6e07951c service placement] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:03.249399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad55f85-a279-4a50-94cb-beaf6e07951c service placement] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:03.255350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695be52-cdc4-4880-87f9-f9183e71f6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:03.256020 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695be52-cdc4-4880-87f9-f9183e71f6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:03.256363 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695be52-cdc4-4880-87f9-f9183e71f6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:03.256680 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695be52-cdc4-4880-87f9-f9183e71f6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:03.257405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695be52-cdc4-4880-87f9-f9183e71f6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:03.258997 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695be52-cdc4-4880-87f9-f9183e71f6a7 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:03.270288 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1115/2224] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:55:03.274514 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e074a-0724-40bb-ac13-e764653dc366 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:03.290216 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e074a-0724-40bb-ac13-e764653dc366 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:03.298745 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed662734-e740-474e-8e00-cde0294e0fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:03.299477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed662734-e740-474e-8e00-cde0294e0fdf admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:03.299703 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed662734-e740-474e-8e00-cde0294e0fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:03.299972 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed662734-e740-474e-8e00-cde0294e0fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:03.300738 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed662734-e740-474e-8e00-cde0294e0fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:03.302451 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed662734-e740-474e-8e00-cde0294e0fdf admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:03.316236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1110/2225] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:03.319093 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695be52-cdc4-4880-87f9-f9183e71f6a7 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:03.331188 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695be52-cdc4-4880-87f9-f9183e71f6a7 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:03.337077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c8adb-0102-47b3-be80-600be72de62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:03.337704 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8adb-0102-47b3-be80-600be72de62e admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:03.338304 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8adb-0102-47b3-be80-600be72de62e admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:03.338581 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8adb-0102-47b3-be80-600be72de62e admin admin] PATH_INFO: `/v3/projects/61bfaedafb1743a4925865288358a640/users/e5ace74f740c44dcb4b129e8c63b36a3/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:03.354191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c8adb-0102-47b3-be80-600be72de62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61bfaedafb1743a4925865288358a640, user_id=e5ace74f740c44dcb4b129e8c63b36a3, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:03.357020 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c8adb-0102-47b3-be80-600be72de62e admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:03.372594 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1116/2226] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:03 2022] PUT /identity/v3/projects/61bfaedafb1743a4925865288358a640/users/e5ace74f740c44dcb4b129e8c63b36a3/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:03.383020 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc1245-4997-4fac-a78e-772e1f207054 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:03.383375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc1245-4997-4fac-a78e-772e1f207054 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:03.383718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc1245-4997-4fac-a78e-772e1f207054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:03.419689 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-98bc1245-4997-4fac-a78e-772e1f207054 None None] MFA Rules not processed for user `e5ace74f740c44dcb4b129e8c63b36a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:03.420994 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-98bc1245-4997-4fac-a78e-772e1f207054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:03.525618 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1111/2227] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:03.531868 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c8adb-0102-47b3-be80-600be72de62e admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:03.540670 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc1245-4997-4fac-a78e-772e1f207054 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:03.544762 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-98bc1245-4997-4fac-a78e-772e1f207054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:03.605453 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c8adb-0102-47b3-be80-600be72de62e admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:03.611873 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba42cd-7671-4c2f-83ac-8109cda3beac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:03.612570 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba42cd-7671-4c2f-83ac-8109cda3beac admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:03.612854 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba42cd-7671-4c2f-83ac-8109cda3beac admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:03.613155 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba42cd-7671-4c2f-83ac-8109cda3beac admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:03.613848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba42cd-7671-4c2f-83ac-8109cda3beac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:03.615791 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba42cd-7671-4c2f-83ac-8109cda3beac admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:03.621928 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc1245-4997-4fac-a78e-772e1f207054 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:03.627768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729e723-f3fa-4fc8-a127-e983a952d3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:03.628699 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729e723-f3fa-4fc8-a127-e983a952d3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:03.628981 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729e723-f3fa-4fc8-a127-e983a952d3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:03.629252 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729e723-f3fa-4fc8-a127-e983a952d3ac admin admin] PATH_INFO: `/v3/users/c740cd714848479ea81f6523b756b414` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:03.630827 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729e723-f3fa-4fc8-a127-e983a952d3ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c740cd714848479ea81f6523b756b414)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:03.633785 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729e723-f3fa-4fc8-a127-e983a952d3ac admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:03.646775 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1117/2228] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:03 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:03.650791 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba42cd-7671-4c2f-83ac-8109cda3beac admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:03.684573 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e729e723-f3fa-4fc8-a127-e983a952d3ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c740cd714848479ea81f6523b756b414'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:03.685277 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e729e723-f3fa-4fc8-a127-e983a952d3ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c740cd714848479ea81f6523b756b414'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:03.698404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e729e723-f3fa-4fc8-a127-e983a952d3ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c740cd714848479ea81f6523b756b414'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:03.699312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e729e723-f3fa-4fc8-a127-e983a952d3ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c740cd714848479ea81f6523b756b414'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:03.709680 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e729e723-f3fa-4fc8-a127-e983a952d3ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c740cd714848479ea81f6523b756b414'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:03.721339 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba42cd-7671-4c2f-83ac-8109cda3beac admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:03.726499 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1112/2229] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:03 2022] DELETE /identity/v3/users/c740cd714848479ea81f6523b756b414 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:03.800415 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bb1a1-31aa-4849-b25e-fdd43ed0c527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:03.801103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bb1a1-31aa-4849-b25e-fdd43ed0c527 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:03.801382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bb1a1-31aa-4849-b25e-fdd43ed0c527 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:03.801661 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bb1a1-31aa-4849-b25e-fdd43ed0c527 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:03.802356 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bb1a1-31aa-4849-b25e-fdd43ed0c527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:03.804366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bb1a1-31aa-4849-b25e-fdd43ed0c527 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:03.825867 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1118/2230] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:03 2022] POST /identity/v3/users => generated 301 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:03.830321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729e723-f3fa-4fc8-a127-e983a952d3ac admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:03.832764 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e729e723-f3fa-4fc8-a127-e983a952d3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:03.853544 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729e723-f3fa-4fc8-a127-e983a952d3ac admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:03.858810 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6328f-e73e-4b7b-9bee-e3bd009784b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:03.859623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6328f-e73e-4b7b-9bee-e3bd009784b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:03.859903 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6328f-e73e-4b7b-9bee-e3bd009784b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:03.860178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6328f-e73e-4b7b-9bee-e3bd009784b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:03.861196 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6328f-e73e-4b7b-9bee-e3bd009784b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:03.862838 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6328f-e73e-4b7b-9bee-e3bd009784b7 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:03.876247 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1113/2231] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:55:03.877949 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bb1a1-31aa-4849-b25e-fdd43ed0c527 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:03.889243 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bb1a1-31aa-4849-b25e-fdd43ed0c527 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:03.894905 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8c917-33ae-4e0c-80e6-38a3bdeec93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:03.896065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8c917-33ae-4e0c-80e6-38a3bdeec93a admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:03.896438 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8c917-33ae-4e0c-80e6-38a3bdeec93a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:03.896610 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8c917-33ae-4e0c-80e6-38a3bdeec93a admin admin] PATH_INFO: `/v3/projects/5abc59e42e4a4d9fbd181914666d9dfc/users/0818ccfbb0cc421bb99f5be99dd644f6/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:03.914093 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8c917-33ae-4e0c-80e6-38a3bdeec93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5abc59e42e4a4d9fbd181914666d9dfc, user_id=0818ccfbb0cc421bb99f5be99dd644f6, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:03.917014 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8c917-33ae-4e0c-80e6-38a3bdeec93a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:03.933295 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6328f-e73e-4b7b-9bee-e3bd009784b7 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:03.935548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ecd6328f-e73e-4b7b-9bee-e3bd009784b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:03.955409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1119/2232] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:03 2022] PUT /identity/v3/projects/5abc59e42e4a4d9fbd181914666d9dfc/users/0818ccfbb0cc421bb99f5be99dd644f6/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:03.956359 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6328f-e73e-4b7b-9bee-e3bd009784b7 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:03.962005 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8c917-33ae-4e0c-80e6-38a3bdeec93a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:04.031115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda41e1f-4f83-4af0-89e0-8e122f097435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:04.031975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda41e1f-4f83-4af0-89e0-8e122f097435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:04.032449 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda41e1f-4f83-4af0-89e0-8e122f097435 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:04.032724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda41e1f-4f83-4af0-89e0-8e122f097435 admin admin] PATH_INFO: `/v3/projects/27a1fa5d92b245b3beed97f01e1ac711` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:04.033926 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda41e1f-4f83-4af0-89e0-8e122f097435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a1fa5d92b245b3beed97f01e1ac711)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:04.036070 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda41e1f-4f83-4af0-89e0-8e122f097435 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:04.040276 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8c917-33ae-4e0c-80e6-38a3bdeec93a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:04.044987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b3876-f79d-46a2-977a-223e28968d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:04.045657 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b3876-f79d-46a2-977a-223e28968d66 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:04.045936 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b3876-f79d-46a2-977a-223e28968d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:04.046209 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b3876-f79d-46a2-977a-223e28968d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:04.046941 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b3876-f79d-46a2-977a-223e28968d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:04.048627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b3876-f79d-46a2-977a-223e28968d66 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:04.058467 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1120/2233] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:04.062879 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b3876-f79d-46a2-977a-223e28968d66 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:04.073272 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b3876-f79d-46a2-977a-223e28968d66 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:04.083431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fda41e1f-4f83-4af0-89e0-8e122f097435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a1fa5d92b245b3beed97f01e1ac711', 'request_id': 'req-fda41e1f-4f83-4af0-89e0-8e122f097435'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.091636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fda41e1f-4f83-4af0-89e0-8e122f097435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a1fa5d92b245b3beed97f01e1ac711', 'request_id': 'req-fda41e1f-4f83-4af0-89e0-8e122f097435'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.097249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fda41e1f-4f83-4af0-89e0-8e122f097435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a1fa5d92b245b3beed97f01e1ac711', 'request_id': 'req-fda41e1f-4f83-4af0-89e0-8e122f097435'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.108489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fda41e1f-4f83-4af0-89e0-8e122f097435 admin admin] The token cache is being invalidate because project 27a1fa5d92b245b3beed97f01e1ac711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:04.108778 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fda41e1f-4f83-4af0-89e0-8e122f097435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.109534 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fda41e1f-4f83-4af0-89e0-8e122f097435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.111259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1114/2234] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:03 2022] DELETE /identity/v3/projects/27a1fa5d92b245b3beed97f01e1ac711 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:04.114955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda41e1f-4f83-4af0-89e0-8e122f097435 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:04.116328 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-fda41e1f-4f83-4af0-89e0-8e122f097435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:04.128453 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66e5e7-7b98-46af-93d6-4e10b59e9db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:04.129368 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66e5e7-7b98-46af-93d6-4e10b59e9db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:04.129645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66e5e7-7b98-46af-93d6-4e10b59e9db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:04.130091 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66e5e7-7b98-46af-93d6-4e10b59e9db1 admin admin] PATH_INFO: `/v3/projects/5abc59e42e4a4d9fbd181914666d9dfc/users/0818ccfbb0cc421bb99f5be99dd644f6/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:04.132092 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66e5e7-7b98-46af-93d6-4e10b59e9db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5abc59e42e4a4d9fbd181914666d9dfc, user_id=0818ccfbb0cc421bb99f5be99dd644f6, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:04.135023 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66e5e7-7b98-46af-93d6-4e10b59e9db1 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:04.145755 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1121/2235] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:04 2022] PUT /identity/v3/projects/5abc59e42e4a4d9fbd181914666d9dfc/users/0818ccfbb0cc421bb99f5be99dd644f6/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:04.156579 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecea13-1d4d-406b-ac6e-3dac48a77689 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:04.156866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecea13-1d4d-406b-ac6e-3dac48a77689 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:04.157138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecea13-1d4d-406b-ac6e-3dac48a77689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:04.188569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda41e1f-4f83-4af0-89e0-8e122f097435 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:04.191646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-1cecea13-1d4d-406b-ac6e-3dac48a77689 None None] MFA Rules not processed for user `0818ccfbb0cc421bb99f5be99dd644f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:04.192895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1cecea13-1d4d-406b-ac6e-3dac48a77689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:04.249250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6635c8-c158-4cdb-a619-060e28467548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:04.250146 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6635c8-c158-4cdb-a619-060e28467548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:04.250427 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6635c8-c158-4cdb-a619-060e28467548 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:04.250697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6635c8-c158-4cdb-a619-060e28467548 admin admin] PATH_INFO: `/v3/users/97ed53e99878425187997bc5d8078c40` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:04.251891 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6635c8-c158-4cdb-a619-060e28467548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ed53e99878425187997bc5d8078c40)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:04.253873 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6635c8-c158-4cdb-a619-060e28467548 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:04.261349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1122/2236] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:55:04.272173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecea13-1d4d-406b-ac6e-3dac48a77689 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:04.273670 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1cecea13-1d4d-406b-ac6e-3dac48a77689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:04.307553 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5d6635c8-c158-4cdb-a619-060e28467548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ed53e99878425187997bc5d8078c40'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.308285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5d6635c8-c158-4cdb-a619-060e28467548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ed53e99878425187997bc5d8078c40'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.325436 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5d6635c8-c158-4cdb-a619-060e28467548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ed53e99878425187997bc5d8078c40'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.326215 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5d6635c8-c158-4cdb-a619-060e28467548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ed53e99878425187997bc5d8078c40'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.334487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5d6635c8-c158-4cdb-a619-060e28467548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ed53e99878425187997bc5d8078c40'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.342285 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecea13-1d4d-406b-ac6e-3dac48a77689 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:04.345824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6fd54-5ce1-4bdf-847b-afe85db7ae18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:04.346467 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6fd54-5ce1-4bdf-847b-afe85db7ae18 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:04.346746 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6fd54-5ce1-4bdf-847b-afe85db7ae18 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:04.347020 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6fd54-5ce1-4bdf-847b-afe85db7ae18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:04.347127 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1115/2237] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:04 2022] DELETE /identity/v3/users/97ed53e99878425187997bc5d8078c40 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:04.350118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-97a6fd54-5ce1-4bdf-847b-afe85db7ae18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:04.362197 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6fd54-5ce1-4bdf-847b-afe85db7ae18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:04.363979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6fd54-5ce1-4bdf-847b-afe85db7ae18 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:04.375290 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1123/2238] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:55:04.506055 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6635c8-c158-4cdb-a619-060e28467548 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:04.507724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5d6635c8-c158-4cdb-a619-060e28467548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:04.546775 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6fd54-5ce1-4bdf-847b-afe85db7ae18 service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:04.548317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-97a6fd54-5ce1-4bdf-847b-afe85db7ae18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:04.561966 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6fd54-5ce1-4bdf-847b-afe85db7ae18 service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:04.581322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6635c8-c158-4cdb-a619-060e28467548 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:04.587013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110d59b-691c-4b5f-b193-0eac7dfa6c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:04.587976 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110d59b-691c-4b5f-b193-0eac7dfa6c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:04.588397 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110d59b-691c-4b5f-b193-0eac7dfa6c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:04.588669 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110d59b-691c-4b5f-b193-0eac7dfa6c9b admin admin] PATH_INFO: `/v3/users/e5ace74f740c44dcb4b129e8c63b36a3` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:04.589874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110d59b-691c-4b5f-b193-0eac7dfa6c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ace74f740c44dcb4b129e8c63b36a3)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:04.592250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110d59b-691c-4b5f-b193-0eac7dfa6c9b admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:04.633542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748a422-8c9d-4088-8f7f-f3b1e506de65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:04.634464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748a422-8c9d-4088-8f7f-f3b1e506de65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:04.634746 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748a422-8c9d-4088-8f7f-f3b1e506de65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:04.635046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748a422-8c9d-4088-8f7f-f3b1e506de65 admin admin] PATH_INFO: `/v3/projects/0b45d532a30343db9ec3f3fb3017855d` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:04.636268 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748a422-8c9d-4088-8f7f-f3b1e506de65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b45d532a30343db9ec3f3fb3017855d)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:04.638186 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748a422-8c9d-4088-8f7f-f3b1e506de65 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:04.648735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e110d59b-691c-4b5f-b193-0eac7dfa6c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ace74f740c44dcb4b129e8c63b36a3'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.649419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e110d59b-691c-4b5f-b193-0eac7dfa6c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ace74f740c44dcb4b129e8c63b36a3'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.661265 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e110d59b-691c-4b5f-b193-0eac7dfa6c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ace74f740c44dcb4b129e8c63b36a3'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.661911 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e110d59b-691c-4b5f-b193-0eac7dfa6c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ace74f740c44dcb4b129e8c63b36a3'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.669779 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e110d59b-691c-4b5f-b193-0eac7dfa6c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ace74f740c44dcb4b129e8c63b36a3'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.683594 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1116/2239] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:04 2022] DELETE /identity/v3/users/e5ace74f740c44dcb4b129e8c63b36a3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:04.687788 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f86e6-37ee-47d3-a469-538b0b58d6b1 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:04.688072 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f86e6-37ee-47d3-a469-538b0b58d6b1 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:04.688382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f86e6-37ee-47d3-a469-538b0b58d6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:04.692054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3748a422-8c9d-4088-8f7f-f3b1e506de65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b45d532a30343db9ec3f3fb3017855d', 'request_id': 'req-3748a422-8c9d-4088-8f7f-f3b1e506de65'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.702419 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3748a422-8c9d-4088-8f7f-f3b1e506de65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b45d532a30343db9ec3f3fb3017855d', 'request_id': 'req-3748a422-8c9d-4088-8f7f-f3b1e506de65'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.707749 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-1d2f86e6-37ee-47d3-a469-538b0b58d6b1 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:04.708919 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3748a422-8c9d-4088-8f7f-f3b1e506de65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b45d532a30343db9ec3f3fb3017855d', 'request_id': 'req-3748a422-8c9d-4088-8f7f-f3b1e506de65'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.709112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1d2f86e6-37ee-47d3-a469-538b0b58d6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:04.719458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3748a422-8c9d-4088-8f7f-f3b1e506de65 admin admin] The token cache is being invalidate because project 0b45d532a30343db9ec3f3fb3017855d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:04.719743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3748a422-8c9d-4088-8f7f-f3b1e506de65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.720403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3748a422-8c9d-4088-8f7f-f3b1e506de65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.721933 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1124/2240] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:04 2022] DELETE /identity/v3/projects/0b45d532a30343db9ec3f3fb3017855d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:04.726760 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eab072-7c19-4bb9-8a52-ac796b5c9c54 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:04.727392 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eab072-7c19-4bb9-8a52-ac796b5c9c54 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:04.727392 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eab072-7c19-4bb9-8a52-ac796b5c9c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:04.745053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-98eab072-7c19-4bb9-8a52-ac796b5c9c54 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:04.746282 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-98eab072-7c19-4bb9-8a52-ac796b5c9c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:04.776147 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1117/2241] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:55:04.781694 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f86e6-37ee-47d3-a469-538b0b58d6b1 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:04.783073 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1d2f86e6-37ee-47d3-a469-538b0b58d6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:04.813396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1125/2242] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:55:04.821492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61e6fb-5bf7-4947-b7ac-5190731a0a78 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:04.821850 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61e6fb-5bf7-4947-b7ac-5190731a0a78 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:04.822241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61e6fb-5bf7-4947-b7ac-5190731a0a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:04.840224 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-3b61e6fb-5bf7-4947-b7ac-5190731a0a78 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:04.841459 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-3b61e6fb-5bf7-4947-b7ac-5190731a0a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:04.843538 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f86e6-37ee-47d3-a469-538b0b58d6b1 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:04.847161 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235c365-b8f4-4b4f-9b66-55cd31db38cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:04.847808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235c365-b8f4-4b4f-9b66-55cd31db38cd service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:04.848081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235c365-b8f4-4b4f-9b66-55cd31db38cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:04.848378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235c365-b8f4-4b4f-9b66-55cd31db38cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:04.850008 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1126/2243] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:04.854221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61e6fb-5bf7-4947-b7ac-5190731a0a78 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:04.862028 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235c365-b8f4-4b4f-9b66-55cd31db38cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:04.862028 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235c365-b8f4-4b4f-9b66-55cd31db38cd service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:04.866471 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61e6fb-5bf7-4947-b7ac-5190731a0a78 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:04.870422 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1118/2244] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:55:04.871201 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cc74c-0aee-414b-aa51-8be311783c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:04.871853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cc74c-0aee-414b-aa51-8be311783c9d admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:04.872127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cc74c-0aee-414b-aa51-8be311783c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:04.872424 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cc74c-0aee-414b-aa51-8be311783c9d admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:04.873175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cc74c-0aee-414b-aa51-8be311783c9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:55:04.873474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cc74c-0aee-414b-aa51-8be311783c9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:04.875263 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cc74c-0aee-414b-aa51-8be311783c9d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:04.887351 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1127/2245] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:55:04.891892 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235c365-b8f4-4b4f-9b66-55cd31db38cd service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:04.902070 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235c365-b8f4-4b4f-9b66-55cd31db38cd service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:04.907567 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf548639-6cc4-438d-a4ec-4ea11798d786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:04.908405 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf548639-6cc4-438d-a4ec-4ea11798d786 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:04.908685 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf548639-6cc4-438d-a4ec-4ea11798d786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:04.908957 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf548639-6cc4-438d-a4ec-4ea11798d786 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:04.909720 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf548639-6cc4-438d-a4ec-4ea11798d786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:04.911951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf548639-6cc4-438d-a4ec-4ea11798d786 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:04.948707 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1119/2246] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:04 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:04.950144 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cc74c-0aee-414b-aa51-8be311783c9d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:04.961558 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cc74c-0aee-414b-aa51-8be311783c9d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.024514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee0690-9835-4b4f-8284-cace8dd43a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.025206 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee0690-9835-4b4f-8284-cace8dd43a3d admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.025485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee0690-9835-4b4f-8284-cace8dd43a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.025793 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee0690-9835-4b4f-8284-cace8dd43a3d admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.029385 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee0690-9835-4b4f-8284-cace8dd43a3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.029385 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee0690-9835-4b4f-8284-cace8dd43a3d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:05.059389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1128/2247] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:04 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:05.063347 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf548639-6cc4-438d-a4ec-4ea11798d786 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.076949 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf548639-6cc4-438d-a4ec-4ea11798d786 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.082106 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc827da-52b2-425e-9c28-24793cbecbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.082787 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc827da-52b2-425e-9c28-24793cbecbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.083730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc827da-52b2-425e-9c28-24793cbecbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.084191 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc827da-52b2-425e-9c28-24793cbecbd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.084913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc827da-52b2-425e-9c28-24793cbecbd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.086603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc827da-52b2-425e-9c28-24793cbecbd6 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:05.097997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1120/2248] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:05.101855 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee0690-9835-4b4f-8284-cace8dd43a3d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.115510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee0690-9835-4b4f-8284-cace8dd43a3d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.124554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b06357-5f4c-4470-8bce-8f28e253fa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.124554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b06357-5f4c-4470-8bce-8f28e253fa14 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.124554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b06357-5f4c-4470-8bce-8f28e253fa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.124554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b06357-5f4c-4470-8bce-8f28e253fa14 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.125026 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b06357-5f4c-4470-8bce-8f28e253fa14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.125026 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b06357-5f4c-4470-8bce-8f28e253fa14 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:05.136585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1129/2249] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:05.141169 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc827da-52b2-425e-9c28-24793cbecbd6 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.153323 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc827da-52b2-425e-9c28-24793cbecbd6 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.158950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1785200-dffe-42fd-8771-453739d90988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.160033 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1785200-dffe-42fd-8771-453739d90988 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.160477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1785200-dffe-42fd-8771-453739d90988 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.161000 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1785200-dffe-42fd-8771-453739d90988 admin admin] PATH_INFO: `/v3/projects/85ea8ab432d145bf8013f2aa18446393/users/b9b7a2b112dc4a59b2bca502538dcf4f/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.178490 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1785200-dffe-42fd-8771-453739d90988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ea8ab432d145bf8013f2aa18446393, user_id=b9b7a2b112dc4a59b2bca502538dcf4f, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.181910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1785200-dffe-42fd-8771-453739d90988 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:05.185098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b06357-5f4c-4470-8bce-8f28e253fa14 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.187000 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-69b06357-5f4c-4470-8bce-8f28e253fa14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:05.201791 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1121/2250] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:05 2022] PUT /identity/v3/projects/85ea8ab432d145bf8013f2aa18446393/users/b9b7a2b112dc4a59b2bca502538dcf4f/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:05.214903 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a69042-0e4e-4d85-bed4-4616e07c8b4d None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.214903 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a69042-0e4e-4d85-bed4-4616e07c8b4d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.214903 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a69042-0e4e-4d85-bed4-4616e07c8b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.225584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b06357-5f4c-4470-8bce-8f28e253fa14 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.256673 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-54a69042-0e4e-4d85-bed4-4616e07c8b4d None None] MFA Rules not processed for user `b9b7a2b112dc4a59b2bca502538dcf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:05.257974 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-54a69042-0e4e-4d85-bed4-4616e07c8b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:05.288325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.289187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.289460 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.289731 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e admin admin] PATH_INFO: `/v3/projects/61bfaedafb1743a4925865288358a640` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.290921 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=61bfaedafb1743a4925865288358a640)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.293040 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:05.325469 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1122/2251] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:55:05.330004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a69042-0e4e-4d85-bed4-4616e07c8b4d None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.340150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a69042-0e4e-4d85-bed4-4616e07c8b4d None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.341841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61bfaedafb1743a4925865288358a640', 'request_id': 'req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:05.350846 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61bfaedafb1743a4925865288358a640', 'request_id': 'req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:05.358439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61bfaedafb1743a4925865288358a640', 'request_id': 'req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:05.377462 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e admin admin] The token cache is being invalidate because project 61bfaedafb1743a4925865288358a640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:05.377689 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:05.378391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:05.381808 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1130/2252] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:05 2022] DELETE /identity/v3/projects/61bfaedafb1743a4925865288358a640 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:05.385916 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.387354 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:05.397691 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddb29a-98e4-450d-9c16-c1e99850efe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.398363 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddb29a-98e4-450d-9c16-c1e99850efe1 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.398641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddb29a-98e4-450d-9c16-c1e99850efe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.398916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddb29a-98e4-450d-9c16-c1e99850efe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.399608 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddb29a-98e4-450d-9c16-c1e99850efe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.401551 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddb29a-98e4-450d-9c16-c1e99850efe1 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:05.427904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1123/2253] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:05 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:05.432063 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddb29a-98e4-450d-9c16-c1e99850efe1 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.433893 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-d2ddb29a-98e4-450d-9c16-c1e99850efe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:05.456733 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9a26d-f3c5-44c3-9556-3d087ee25b5e admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.506794 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddb29a-98e4-450d-9c16-c1e99850efe1 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.511747 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c232f3-4d52-4c6c-8169-42455d415795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.512530 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c232f3-4d52-4c6c-8169-42455d415795 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.512833 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c232f3-4d52-4c6c-8169-42455d415795 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.513072 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c232f3-4d52-4c6c-8169-42455d415795 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.513821 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c232f3-4d52-4c6c-8169-42455d415795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.515834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c232f3-4d52-4c6c-8169-42455d415795 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:05.516262 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ba2cb-bae1-46fc-9555-5dec33c26d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.517142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ba2cb-bae1-46fc-9555-5dec33c26d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.517422 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ba2cb-bae1-46fc-9555-5dec33c26d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.517723 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ba2cb-bae1-46fc-9555-5dec33c26d5e admin admin] PATH_INFO: `/v3/users/0818ccfbb0cc421bb99f5be99dd644f6` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.518943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ba2cb-bae1-46fc-9555-5dec33c26d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0818ccfbb0cc421bb99f5be99dd644f6)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.521200 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ba2cb-bae1-46fc-9555-5dec33c26d5e admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:05.540628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1124/2254] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:05 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:05.541715 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c232f3-4d52-4c6c-8169-42455d415795 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.552401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c232f3-4d52-4c6c-8169-42455d415795 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.557910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0846bdb-de14-4f03-bd7c-6f7a16ae090a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.558943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0846bdb-de14-4f03-bd7c-6f7a16ae090a admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.559487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0846bdb-de14-4f03-bd7c-6f7a16ae090a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.559933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0846bdb-de14-4f03-bd7c-6f7a16ae090a admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.561178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0846bdb-de14-4f03-bd7c-6f7a16ae090a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.564017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0846bdb-de14-4f03-bd7c-6f7a16ae090a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:05.573360 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dd4ba2cb-bae1-46fc-9555-5dec33c26d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0818ccfbb0cc421bb99f5be99dd644f6'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:05.574088 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dd4ba2cb-bae1-46fc-9555-5dec33c26d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0818ccfbb0cc421bb99f5be99dd644f6'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:05.575353 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1125/2255] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:05.579647 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0846bdb-de14-4f03-bd7c-6f7a16ae090a admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.586274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dd4ba2cb-bae1-46fc-9555-5dec33c26d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0818ccfbb0cc421bb99f5be99dd644f6'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:05.586962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dd4ba2cb-bae1-46fc-9555-5dec33c26d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0818ccfbb0cc421bb99f5be99dd644f6'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:05.589428 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0846bdb-de14-4f03-bd7c-6f7a16ae090a admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.594495 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39569271-d45d-4b6f-b598-bcb5c80691b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.595411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39569271-d45d-4b6f-b598-bcb5c80691b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.595695 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39569271-d45d-4b6f-b598-bcb5c80691b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.595971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39569271-d45d-4b6f-b598-bcb5c80691b1 admin admin] PATH_INFO: `/v3/projects/4449a20ba22046dc90a871cb1ca9c8c8/users/604826a821034f278dfce0c2348d2785/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.596085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-dd4ba2cb-bae1-46fc-9555-5dec33c26d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0818ccfbb0cc421bb99f5be99dd644f6'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:05.609356 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1131/2256] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:05 2022] DELETE /identity/v3/users/0818ccfbb0cc421bb99f5be99dd644f6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:05.612758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39569271-d45d-4b6f-b598-bcb5c80691b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4449a20ba22046dc90a871cb1ca9c8c8, user_id=604826a821034f278dfce0c2348d2785, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.615601 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39569271-d45d-4b6f-b598-bcb5c80691b1 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:05.632424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1126/2257] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:05 2022] PUT /identity/v3/projects/4449a20ba22046dc90a871cb1ca9c8c8/users/604826a821034f278dfce0c2348d2785/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:05.636893 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ba2cb-bae1-46fc-9555-5dec33c26d5e admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.638586 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-dd4ba2cb-bae1-46fc-9555-5dec33c26d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:05.714241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ba2cb-bae1-46fc-9555-5dec33c26d5e admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.769447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ff669-8302-4a3f-88ee-22732d4a4c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.770129 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ff669-8302-4a3f-88ee-22732d4a4c30 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.770407 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ff669-8302-4a3f-88ee-22732d4a4c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.770675 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ff669-8302-4a3f-88ee-22732d4a4c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.771537 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ff669-8302-4a3f-88ee-22732d4a4c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.773167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ff669-8302-4a3f-88ee-22732d4a4c30 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:05.787555 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1132/2258] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:05.789062 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39569271-d45d-4b6f-b598-bcb5c80691b1 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.802732 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39569271-d45d-4b6f-b598-bcb5c80691b1 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.807808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589d171-b7c6-4c80-b3fe-25a28adf19dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.808759 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589d171-b7c6-4c80-b3fe-25a28adf19dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.809036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589d171-b7c6-4c80-b3fe-25a28adf19dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.809331 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589d171-b7c6-4c80-b3fe-25a28adf19dc admin admin] PATH_INFO: `/v3/projects/4449a20ba22046dc90a871cb1ca9c8c8/users/604826a821034f278dfce0c2348d2785/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.811308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589d171-b7c6-4c80-b3fe-25a28adf19dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4449a20ba22046dc90a871cb1ca9c8c8, user_id=604826a821034f278dfce0c2348d2785, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.813979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589d171-b7c6-4c80-b3fe-25a28adf19dc admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:05.828301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1127/2259] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:05 2022] PUT /identity/v3/projects/4449a20ba22046dc90a871cb1ca9c8c8/users/604826a821034f278dfce0c2348d2785/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:05.840008 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3ff47-008f-40b6-b0bd-9a7ac840cf2e None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.840329 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3ff47-008f-40b6-b0bd-9a7ac840cf2e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.840609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3ff47-008f-40b6-b0bd-9a7ac840cf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.877191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-7ff3ff47-008f-40b6-b0bd-9a7ac840cf2e None None] MFA Rules not processed for user `604826a821034f278dfce0c2348d2785`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:05.878636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-7ff3ff47-008f-40b6-b0bd-9a7ac840cf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:05.899366 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589d171-b7c6-4c80-b3fe-25a28adf19dc admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.901173 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-8589d171-b7c6-4c80-b3fe-25a28adf19dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:05.953230 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1133/2260] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:05.964657 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3ff47-008f-40b6-b0bd-9a7ac840cf2e None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.965995 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-7ff3ff47-008f-40b6-b0bd-9a7ac840cf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:05.973237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589d171-b7c6-4c80-b3fe-25a28adf19dc admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.978191 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315b994-7261-4fc9-a844-7918c9ebc766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.979048 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315b994-7261-4fc9-a844-7918c9ebc766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.979327 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315b994-7261-4fc9-a844-7918c9ebc766 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.979599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315b994-7261-4fc9-a844-7918c9ebc766 admin admin] PATH_INFO: `/v3/projects/5abc59e42e4a4d9fbd181914666d9dfc` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.981390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315b994-7261-4fc9-a844-7918c9ebc766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5abc59e42e4a4d9fbd181914666d9dfc)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.983398 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315b994-7261-4fc9-a844-7918c9ebc766 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:06.025157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3ff47-008f-40b6-b0bd-9a7ac840cf2e None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:06.032860 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6315b994-7261-4fc9-a844-7918c9ebc766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5abc59e42e4a4d9fbd181914666d9dfc', 'request_id': 'req-6315b994-7261-4fc9-a844-7918c9ebc766'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:06.043928 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6315b994-7261-4fc9-a844-7918c9ebc766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5abc59e42e4a4d9fbd181914666d9dfc', 'request_id': 'req-6315b994-7261-4fc9-a844-7918c9ebc766'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:06.050838 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6315b994-7261-4fc9-a844-7918c9ebc766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5abc59e42e4a4d9fbd181914666d9dfc', 'request_id': 'req-6315b994-7261-4fc9-a844-7918c9ebc766'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:06.062895 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6315b994-7261-4fc9-a844-7918c9ebc766 admin admin] The token cache is being invalidate because project 5abc59e42e4a4d9fbd181914666d9dfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:06.063176 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6315b994-7261-4fc9-a844-7918c9ebc766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:06.063822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6315b994-7261-4fc9-a844-7918c9ebc766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:06.065456 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1128/2261] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:05 2022] DELETE /identity/v3/projects/5abc59e42e4a4d9fbd181914666d9dfc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:06.070321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a301c7-1a36-4d4c-b269-a0163992a59a None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.070679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a301c7-1a36-4d4c-b269-a0163992a59a None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.070955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a301c7-1a36-4d4c-b269-a0163992a59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.077661 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38625af7-39ea-4b62-95a7-b6ad22359e3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:06.078307 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38625af7-39ea-4b62-95a7-b6ad22359e3c service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.078584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38625af7-39ea-4b62-95a7-b6ad22359e3c service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.078851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38625af7-39ea-4b62-95a7-b6ad22359e3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.080690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-38625af7-39ea-4b62-95a7-b6ad22359e3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:06.089037 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e3a301c7-1a36-4d4c-b269-a0163992a59a None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:06.090320 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e3a301c7-1a36-4d4c-b269-a0163992a59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:06.145824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38625af7-39ea-4b62-95a7-b6ad22359e3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:06.147381 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38625af7-39ea-4b62-95a7-b6ad22359e3c service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:06.157678 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1134/2262] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:55:06.160347 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1129/2263] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:55:06.164500 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e48233-3aa2-44dd-aa92-f5d98b1d2af5 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.164791 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e48233-3aa2-44dd-aa92-f5d98b1d2af5 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.165063 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e48233-3aa2-44dd-aa92-f5d98b1d2af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.182653 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-83e48233-3aa2-44dd-aa92-f5d98b1d2af5 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:06.183951 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-83e48233-3aa2-44dd-aa92-f5d98b1d2af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:06.194980 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1135/2264] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:06.196252 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a301c7-1a36-4d4c-b269-a0163992a59a None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:06.206046 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a301c7-1a36-4d4c-b269-a0163992a59a None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:06.211081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cf3f1-39fc-4288-834c-b2a50b5d0b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:06.211806 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cf3f1-39fc-4288-834c-b2a50b5d0b5a admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.212105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cf3f1-39fc-4288-834c-b2a50b5d0b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.212548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cf3f1-39fc-4288-834c-b2a50b5d0b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.213251 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cf3f1-39fc-4288-834c-b2a50b5d0b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:55:06.213583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cf3f1-39fc-4288-834c-b2a50b5d0b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:06.215235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cf3f1-39fc-4288-834c-b2a50b5d0b5a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:06.228285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1130/2265] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:55:06.232641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e48233-3aa2-44dd-aa92-f5d98b1d2af5 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:06.236632 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cf3f1-39fc-4288-834c-b2a50b5d0b5a admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:06.238375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-295cf3f1-39fc-4288-834c-b2a50b5d0b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:06.243706 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e48233-3aa2-44dd-aa92-f5d98b1d2af5 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:06.248669 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97ebc2-a4f9-4b0b-8e1a-061e1607565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:06.249323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97ebc2-a4f9-4b0b-8e1a-061e1607565d admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.249602 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97ebc2-a4f9-4b0b-8e1a-061e1607565d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.249937 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97ebc2-a4f9-4b0b-8e1a-061e1607565d admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.250636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97ebc2-a4f9-4b0b-8e1a-061e1607565d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:06.252359 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cf3f1-39fc-4288-834c-b2a50b5d0b5a admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:06.252610 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97ebc2-a4f9-4b0b-8e1a-061e1607565d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:06.260507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b5692-4ee9-4eb6-8c9b-f80764608e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:06.260507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b5692-4ee9-4eb6-8c9b-f80764608e7a service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.260507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b5692-4ee9-4eb6-8c9b-f80764608e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.260507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b5692-4ee9-4eb6-8c9b-f80764608e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.263163 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-9f6b5692-4ee9-4eb6-8c9b-f80764608e7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:06.284244 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1136/2266] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:06 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:06.288105 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97ebc2-a4f9-4b0b-8e1a-061e1607565d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:06.336498 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b5692-4ee9-4eb6-8c9b-f80764608e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:06.338201 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b5692-4ee9-4eb6-8c9b-f80764608e7a service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:06.349131 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1131/2267] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:55:06.350858 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97ebc2-a4f9-4b0b-8e1a-061e1607565d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:06.357420 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd3359-f53e-4d91-b11c-5812c6654467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:06.358103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd3359-f53e-4d91-b11c-5812c6654467 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.358382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd3359-f53e-4d91-b11c-5812c6654467 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.358654 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd3359-f53e-4d91-b11c-5812c6654467 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.359344 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd3359-f53e-4d91-b11c-5812c6654467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:06.361299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd3359-f53e-4d91-b11c-5812c6654467 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:06.392513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1137/2268] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:06 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:06.392746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b5692-4ee9-4eb6-8c9b-f80764608e7a service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:06.402770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b5692-4ee9-4eb6-8c9b-f80764608e7a service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:06.409840 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57146c8d-bc97-4e8e-a715-5bb0c88e3ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:06.410627 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57146c8d-bc97-4e8e-a715-5bb0c88e3ffb admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.410960 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57146c8d-bc97-4e8e-a715-5bb0c88e3ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.411296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57146c8d-bc97-4e8e-a715-5bb0c88e3ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.412192 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57146c8d-bc97-4e8e-a715-5bb0c88e3ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:06.414489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57146c8d-bc97-4e8e-a715-5bb0c88e3ffb admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:06.426795 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1132/2269] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:06.431084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd3359-f53e-4d91-b11c-5812c6654467 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:06.441847 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd3359-f53e-4d91-b11c-5812c6654467 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:06.447116 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc194494-8317-4799-89d0-c27e811fc1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:06.447915 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194494-8317-4799-89d0-c27e811fc1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.448297 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194494-8317-4799-89d0-c27e811fc1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.448690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194494-8317-4799-89d0-c27e811fc1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.449762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc194494-8317-4799-89d0-c27e811fc1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:06.451424 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc194494-8317-4799-89d0-c27e811fc1a2 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:06.462853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1138/2270] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:55:06.468248 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57146c8d-bc97-4e8e-a715-5bb0c88e3ffb admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:06.480374 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57146c8d-bc97-4e8e-a715-5bb0c88e3ffb admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:06.485840 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded162f-e4df-4b53-8209-b274f3b4819d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:06.486680 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded162f-e4df-4b53-8209-b274f3b4819d admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.486680 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded162f-e4df-4b53-8209-b274f3b4819d admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.487072 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded162f-e4df-4b53-8209-b274f3b4819d admin admin] PATH_INFO: `/v3/projects/032cf00fe568430e852b910fb8693cf1/users/adfa9dd8e6c54a98bd93ad8b0bcfdd99/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.507164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded162f-e4df-4b53-8209-b274f3b4819d admin admin] RBAC: Authorizing `identity:create_grant(project_id=032cf00fe568430e852b910fb8693cf1, user_id=adfa9dd8e6c54a98bd93ad8b0bcfdd99, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:06.510011 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded162f-e4df-4b53-8209-b274f3b4819d admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:06.524194 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1133/2271] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:06 2022] PUT /identity/v3/projects/032cf00fe568430e852b910fb8693cf1/users/adfa9dd8e6c54a98bd93ad8b0bcfdd99/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:06.537237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e0942-b447-420d-b9da-cb8d48b63c75 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.537514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e0942-b447-420d-b9da-cb8d48b63c75 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.537788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e0942-b447-420d-b9da-cb8d48b63c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.563788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-076e0942-b447-420d-b9da-cb8d48b63c75 None None] MFA Rules not processed for user `adfa9dd8e6c54a98bd93ad8b0bcfdd99`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:06.565005 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-076e0942-b447-420d-b9da-cb8d48b63c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:06.637499 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1139/2272] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:06.649486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded162f-e4df-4b53-8209-b274f3b4819d admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:06.706719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded162f-e4df-4b53-8209-b274f3b4819d admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:06.710692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95aad1-092f-45b0-95fb-51f9ad20afd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:06.711336 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95aad1-092f-45b0-95fb-51f9ad20afd6 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.711617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95aad1-092f-45b0-95fb-51f9ad20afd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.711902 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95aad1-092f-45b0-95fb-51f9ad20afd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.721341 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95aad1-092f-45b0-95fb-51f9ad20afd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:06.722779 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95aad1-092f-45b0-95fb-51f9ad20afd6 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:06.732022 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1134/2273] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:06.755470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e0942-b447-420d-b9da-cb8d48b63c75 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:06.819189 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e0942-b447-420d-b9da-cb8d48b63c75 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:06.823827 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cc623-36f6-4927-9818-ed53331daab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:06.824722 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cc623-36f6-4927-9818-ed53331daab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.825073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cc623-36f6-4927-9818-ed53331daab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.825271 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cc623-36f6-4927-9818-ed53331daab4 admin admin] PATH_INFO: `/v3/users/adfa9dd8e6c54a98bd93ad8b0bcfdd99` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.826499 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cc623-36f6-4927-9818-ed53331daab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adfa9dd8e6c54a98bd93ad8b0bcfdd99)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:06.828488 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cc623-36f6-4927-9818-ed53331daab4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:06.883068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-cb9cc623-36f6-4927-9818-ed53331daab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adfa9dd8e6c54a98bd93ad8b0bcfdd99'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:06.883173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-cb9cc623-36f6-4927-9818-ed53331daab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adfa9dd8e6c54a98bd93ad8b0bcfdd99'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:06.895844 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-cb9cc623-36f6-4927-9818-ed53331daab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adfa9dd8e6c54a98bd93ad8b0bcfdd99'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:06.896671 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-cb9cc623-36f6-4927-9818-ed53331daab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adfa9dd8e6c54a98bd93ad8b0bcfdd99'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:06.907556 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-cb9cc623-36f6-4927-9818-ed53331daab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adfa9dd8e6c54a98bd93ad8b0bcfdd99'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:06.921546 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1140/2274] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:06 2022] DELETE /identity/v3/users/adfa9dd8e6c54a98bd93ad8b0bcfdd99 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:06.930124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59532b-bc6c-4498-9c3b-57b8aab46491 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.930407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59532b-bc6c-4498-9c3b-57b8aab46491 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.930685 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59532b-bc6c-4498-9c3b-57b8aab46491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.949040 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-3b59532b-bc6c-4498-9c3b-57b8aab46491 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:06.950244 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-3b59532b-bc6c-4498-9c3b-57b8aab46491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:07.017698 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1135/2275] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:07.027950 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cc623-36f6-4927-9818-ed53331daab4 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:07.029504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-cb9cc623-36f6-4927-9818-ed53331daab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:07.090882 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cc623-36f6-4927-9818-ed53331daab4 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:07.095680 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6841b1-c4e9-4314-bec1-3992054b9c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:07.096368 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6841b1-c4e9-4314-bec1-3992054b9c0c service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:07.096674 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6841b1-c4e9-4314-bec1-3992054b9c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:07.096943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6841b1-c4e9-4314-bec1-3992054b9c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:07.106207 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6841b1-c4e9-4314-bec1-3992054b9c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:07.107654 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6841b1-c4e9-4314-bec1-3992054b9c0c service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:07.117075 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1141/2276] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:07.399355 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59532b-bc6c-4498-9c3b-57b8aab46491 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:07.400791 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-3b59532b-bc6c-4498-9c3b-57b8aab46491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:07.414886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59532b-bc6c-4498-9c3b-57b8aab46491 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:07.420635 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193c5e5-122a-48aa-891b-a8b0ff89ad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:07.421512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193c5e5-122a-48aa-891b-a8b0ff89ad09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:07.421796 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193c5e5-122a-48aa-891b-a8b0ff89ad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:07.422067 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193c5e5-122a-48aa-891b-a8b0ff89ad09 admin admin] PATH_INFO: `/v3/projects/032cf00fe568430e852b910fb8693cf1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:07.423289 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193c5e5-122a-48aa-891b-a8b0ff89ad09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=032cf00fe568430e852b910fb8693cf1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:07.425259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193c5e5-122a-48aa-891b-a8b0ff89ad09 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:07.480265 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-3193c5e5-122a-48aa-891b-a8b0ff89ad09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032cf00fe568430e852b910fb8693cf1', 'request_id': 'req-3193c5e5-122a-48aa-891b-a8b0ff89ad09'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:07.489404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-3193c5e5-122a-48aa-891b-a8b0ff89ad09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032cf00fe568430e852b910fb8693cf1', 'request_id': 'req-3193c5e5-122a-48aa-891b-a8b0ff89ad09'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:07.495257 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-3193c5e5-122a-48aa-891b-a8b0ff89ad09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032cf00fe568430e852b910fb8693cf1', 'request_id': 'req-3193c5e5-122a-48aa-891b-a8b0ff89ad09'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:07.513061 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-3193c5e5-122a-48aa-891b-a8b0ff89ad09 admin admin] The token cache is being invalidate because project 032cf00fe568430e852b910fb8693cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:07.513301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-3193c5e5-122a-48aa-891b-a8b0ff89ad09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:07.514084 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-3193c5e5-122a-48aa-891b-a8b0ff89ad09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:07.515915 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1136/2277] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:07 2022] DELETE /identity/v3/projects/032cf00fe568430e852b910fb8693cf1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:07.521170 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b2ec1-651f-416d-a182-5fafc0dc1bae None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:07.521589 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b2ec1-651f-416d-a182-5fafc0dc1bae None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:07.521933 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b2ec1-651f-416d-a182-5fafc0dc1bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:07.543983 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-fd4b2ec1-651f-416d-a182-5fafc0dc1bae None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:07.545325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-fd4b2ec1-651f-416d-a182-5fafc0dc1bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:07.616872 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1142/2278] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:07.633688 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c0b80-ef42-4363-8ee7-eee437ab995e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:07.633802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c0b80-ef42-4363-8ee7-eee437ab995e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:07.634035 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c0b80-ef42-4363-8ee7-eee437ab995e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:07.659521 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-5f1c0b80-ef42-4363-8ee7-eee437ab995e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:07.663734 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5f1c0b80-ef42-4363-8ee7-eee437ab995e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:07.671764 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1137/2279] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:07.675895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b2ec1-651f-416d-a182-5fafc0dc1bae None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:07.686335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b2ec1-651f-416d-a182-5fafc0dc1bae None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:07.697105 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1b618-745e-45e5-aea8-6c105dcaa0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:07.697778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1b618-745e-45e5-aea8-6c105dcaa0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:07.698055 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1b618-745e-45e5-aea8-6c105dcaa0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:07.698320 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1b618-745e-45e5-aea8-6c105dcaa0b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:07.699129 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1b618-745e-45e5-aea8-6c105dcaa0b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:55:07.699510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1b618-745e-45e5-aea8-6c105dcaa0b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:07.701128 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1b618-745e-45e5-aea8-6c105dcaa0b7 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:07.717220 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1143/2280] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:55:07.718395 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c0b80-ef42-4363-8ee7-eee437ab995e None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:07.734975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c0b80-ef42-4363-8ee7-eee437ab995e None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:07.739846 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47f57e-7eb4-43d9-b214-14d004ee52c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:07.740619 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47f57e-7eb4-43d9-b214-14d004ee52c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:07.740967 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47f57e-7eb4-43d9-b214-14d004ee52c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:07.741245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47f57e-7eb4-43d9-b214-14d004ee52c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:07.742054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47f57e-7eb4-43d9-b214-14d004ee52c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:07.744021 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47f57e-7eb4-43d9-b214-14d004ee52c2 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:07.771378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1138/2281] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:07 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:07.775635 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1b618-745e-45e5-aea8-6c105dcaa0b7 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:07.787381 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1b618-745e-45e5-aea8-6c105dcaa0b7 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:07.846685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0865a03-ead5-463d-9c84-b38c24b19a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:07.847460 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0865a03-ead5-463d-9c84-b38c24b19a4a admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:07.847749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0865a03-ead5-463d-9c84-b38c24b19a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:07.848015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0865a03-ead5-463d-9c84-b38c24b19a4a admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:07.848977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0865a03-ead5-463d-9c84-b38c24b19a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:07.851376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0865a03-ead5-463d-9c84-b38c24b19a4a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:07.874486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1144/2282] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:07 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:07.878877 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47f57e-7eb4-43d9-b214-14d004ee52c2 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:07.890001 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47f57e-7eb4-43d9-b214-14d004ee52c2 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:07.894918 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6170b-253e-45f3-b74c-6375c75c0c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:07.895594 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6170b-253e-45f3-b74c-6375c75c0c3b admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:07.895879 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6170b-253e-45f3-b74c-6375c75c0c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:07.896152 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6170b-253e-45f3-b74c-6375c75c0c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:07.897043 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6170b-253e-45f3-b74c-6375c75c0c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:07.898641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6170b-253e-45f3-b74c-6375c75c0c3b admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:07.912738 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1139/2283] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:07.914717 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0865a03-ead5-463d-9c84-b38c24b19a4a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:07.926695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0865a03-ead5-463d-9c84-b38c24b19a4a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:07.931432 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ce004-c655-44f8-8553-45818a6d280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:07.932100 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ce004-c655-44f8-8553-45818a6d280e admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:07.932423 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ce004-c655-44f8-8553-45818a6d280e admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:07.932720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ce004-c655-44f8-8553-45818a6d280e admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:07.933553 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ce004-c655-44f8-8553-45818a6d280e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:07.935199 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ce004-c655-44f8-8553-45818a6d280e admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:07.945633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1145/2284] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:07.949905 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6170b-253e-45f3-b74c-6375c75c0c3b admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:07.960067 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6170b-253e-45f3-b74c-6375c75c0c3b admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:07.964777 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6b7ca-be04-480c-acd5-99522848c5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:07.965663 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6b7ca-be04-480c-acd5-99522848c5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:07.965943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6b7ca-be04-480c-acd5-99522848c5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:07.966214 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6b7ca-be04-480c-acd5-99522848c5a1 admin admin] PATH_INFO: `/v3/projects/dd991a5e73f8448ebeed792cac973318/users/a7251524be714e9fa4757bd2cf05bc8c/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:07.981170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6b7ca-be04-480c-acd5-99522848c5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd991a5e73f8448ebeed792cac973318, user_id=a7251524be714e9fa4757bd2cf05bc8c, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:07.984119 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6b7ca-be04-480c-acd5-99522848c5a1 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:08.002921 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1140/2285] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:07 2022] PUT /identity/v3/projects/dd991a5e73f8448ebeed792cac973318/users/a7251524be714e9fa4757bd2cf05bc8c/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:08.011582 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea122ab4-7959-4a42-a50e-0b50cebe0403 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:08.011906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea122ab4-7959-4a42-a50e-0b50cebe0403 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:08.012145 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea122ab4-7959-4a42-a50e-0b50cebe0403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:08.046557 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-ea122ab4-7959-4a42-a50e-0b50cebe0403 None None] MFA Rules not processed for user `a7251524be714e9fa4757bd2cf05bc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:08.047760 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ea122ab4-7959-4a42-a50e-0b50cebe0403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:08.115110 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1146/2286] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:08.126687 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6b7ca-be04-480c-acd5-99522848c5a1 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:08.128401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-aac6b7ca-be04-480c-acd5-99522848c5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:08.215713 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6b7ca-be04-480c-acd5-99522848c5a1 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:08.222555 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d2436-922f-467d-a7a3-a68bae738d0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:08.223501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d2436-922f-467d-a7a3-a68bae738d0c service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:08.223872 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d2436-922f-467d-a7a3-a68bae738d0c service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:08.224191 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d2436-922f-467d-a7a3-a68bae738d0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:08.235462 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d2436-922f-467d-a7a3-a68bae738d0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:08.236943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d2436-922f-467d-a7a3-a68bae738d0c service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:08.245925 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1141/2287] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:09.213409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea122ab4-7959-4a42-a50e-0b50cebe0403 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:09.214963 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ea122ab4-7959-4a42-a50e-0b50cebe0403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:09.424880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea122ab4-7959-4a42-a50e-0b50cebe0403 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:09.429841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570eca06-bb17-4edd-9a7b-bbe299970fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:09.430721 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570eca06-bb17-4edd-9a7b-bbe299970fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:09.431023 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570eca06-bb17-4edd-9a7b-bbe299970fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:09.431295 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570eca06-bb17-4edd-9a7b-bbe299970fb7 admin admin] PATH_INFO: `/v3/users/b9b7a2b112dc4a59b2bca502538dcf4f` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:09.432521 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570eca06-bb17-4edd-9a7b-bbe299970fb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b7a2b112dc4a59b2bca502538dcf4f)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:09.434447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570eca06-bb17-4edd-9a7b-bbe299970fb7 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:09.482342 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-570eca06-bb17-4edd-9a7b-bbe299970fb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b7a2b112dc4a59b2bca502538dcf4f'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:09.482992 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-570eca06-bb17-4edd-9a7b-bbe299970fb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b7a2b112dc4a59b2bca502538dcf4f'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:09.494302 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-570eca06-bb17-4edd-9a7b-bbe299970fb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b7a2b112dc4a59b2bca502538dcf4f'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:09.495007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-570eca06-bb17-4edd-9a7b-bbe299970fb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b7a2b112dc4a59b2bca502538dcf4f'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:09.503996 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-570eca06-bb17-4edd-9a7b-bbe299970fb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b7a2b112dc4a59b2bca502538dcf4f'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:09.518731 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1147/2288] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:09 2022] DELETE /identity/v3/users/b9b7a2b112dc4a59b2bca502538dcf4f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:09.523641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f9139-79b2-4189-8455-837dbf2e1a8f None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:09.524160 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f9139-79b2-4189-8455-837dbf2e1a8f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:09.524367 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f9139-79b2-4189-8455-837dbf2e1a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:09.541472 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-7f8f9139-79b2-4189-8455-837dbf2e1a8f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:09.542881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7f8f9139-79b2-4189-8455-837dbf2e1a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:09.606398 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1142/2289] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:09.616185 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570eca06-bb17-4edd-9a7b-bbe299970fb7 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:09.617664 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-570eca06-bb17-4edd-9a7b-bbe299970fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:09.680150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570eca06-bb17-4edd-9a7b-bbe299970fb7 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:09.684553 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eead64-f2e6-4af9-b1a6-c1d9ead2dfc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:09.685221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eead64-f2e6-4af9-b1a6-c1d9ead2dfc1 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:09.685503 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eead64-f2e6-4af9-b1a6-c1d9ead2dfc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:09.685781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eead64-f2e6-4af9-b1a6-c1d9ead2dfc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:09.697379 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eead64-f2e6-4af9-b1a6-c1d9ead2dfc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:09.698906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eead64-f2e6-4af9-b1a6-c1d9ead2dfc1 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:09.708717 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1148/2290] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:10.029858 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f9139-79b2-4189-8455-837dbf2e1a8f None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:10.032248 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7f8f9139-79b2-4189-8455-837dbf2e1a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:10.055876 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f9139-79b2-4189-8455-837dbf2e1a8f None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:10.068986 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a8e5b-778e-4afb-9e1c-216bcfe817cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:10.069918 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a8e5b-778e-4afb-9e1c-216bcfe817cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:10.070198 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a8e5b-778e-4afb-9e1c-216bcfe817cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:10.070465 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a8e5b-778e-4afb-9e1c-216bcfe817cf admin admin] PATH_INFO: `/v3/projects/85ea8ab432d145bf8013f2aa18446393` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:10.071819 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a8e5b-778e-4afb-9e1c-216bcfe817cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ea8ab432d145bf8013f2aa18446393)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:10.074071 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a8e5b-778e-4afb-9e1c-216bcfe817cf admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:10.136558 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-438a8e5b-778e-4afb-9e1c-216bcfe817cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ea8ab432d145bf8013f2aa18446393', 'request_id': 'req-438a8e5b-778e-4afb-9e1c-216bcfe817cf'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:10.145705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-438a8e5b-778e-4afb-9e1c-216bcfe817cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ea8ab432d145bf8013f2aa18446393', 'request_id': 'req-438a8e5b-778e-4afb-9e1c-216bcfe817cf'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:10.152257 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-438a8e5b-778e-4afb-9e1c-216bcfe817cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ea8ab432d145bf8013f2aa18446393', 'request_id': 'req-438a8e5b-778e-4afb-9e1c-216bcfe817cf'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:10.166577 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-438a8e5b-778e-4afb-9e1c-216bcfe817cf admin admin] The token cache is being invalidate because project 85ea8ab432d145bf8013f2aa18446393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:10.166871 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-438a8e5b-778e-4afb-9e1c-216bcfe817cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:10.167571 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-438a8e5b-778e-4afb-9e1c-216bcfe817cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:10.169146 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1143/2291] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:10 2022] DELETE /identity/v3/projects/85ea8ab432d145bf8013f2aa18446393 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:10.173338 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eead64-f2e6-4af9-b1a6-c1d9ead2dfc1 service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:10.183073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eead64-f2e6-4af9-b1a6-c1d9ead2dfc1 service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:10.248071 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9423ed4-d0b2-41fe-af5f-7c4d3126534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:10.249054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423ed4-d0b2-41fe-af5f-7c4d3126534f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:10.249426 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423ed4-d0b2-41fe-af5f-7c4d3126534f admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:10.249830 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9423ed4-d0b2-41fe-af5f-7c4d3126534f admin admin] PATH_INFO: `/v3/users/604826a821034f278dfce0c2348d2785` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:10.251871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9423ed4-d0b2-41fe-af5f-7c4d3126534f admin admin] RBAC: Authorizing `identity:delete_user(user_id=604826a821034f278dfce0c2348d2785)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:10.255066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9423ed4-d0b2-41fe-af5f-7c4d3126534f admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:10.305914 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e9423ed4-d0b2-41fe-af5f-7c4d3126534f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '604826a821034f278dfce0c2348d2785'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:10.306589 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e9423ed4-d0b2-41fe-af5f-7c4d3126534f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '604826a821034f278dfce0c2348d2785'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:10.320634 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e9423ed4-d0b2-41fe-af5f-7c4d3126534f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '604826a821034f278dfce0c2348d2785'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:10.321450 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e9423ed4-d0b2-41fe-af5f-7c4d3126534f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '604826a821034f278dfce0c2348d2785'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:10.329430 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e9423ed4-d0b2-41fe-af5f-7c4d3126534f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '604826a821034f278dfce0c2348d2785'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:10.343424 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1149/2292] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:10 2022] DELETE /identity/v3/users/604826a821034f278dfce0c2348d2785 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:10.626022 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a8e5b-778e-4afb-9e1c-216bcfe817cf admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:10.627481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-438a8e5b-778e-4afb-9e1c-216bcfe817cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:10.640700 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a8e5b-778e-4afb-9e1c-216bcfe817cf admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:10.714404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b76a1-f792-4a44-84cc-2cbeed12f6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:10.715362 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b76a1-f792-4a44-84cc-2cbeed12f6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:10.715713 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b76a1-f792-4a44-84cc-2cbeed12f6de admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:10.716056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b76a1-f792-4a44-84cc-2cbeed12f6de admin admin] PATH_INFO: `/v3/projects/4449a20ba22046dc90a871cb1ca9c8c8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:10.717354 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b76a1-f792-4a44-84cc-2cbeed12f6de admin admin] RBAC: Authorizing `identity:delete_project(project_id=4449a20ba22046dc90a871cb1ca9c8c8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:10.719331 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b76a1-f792-4a44-84cc-2cbeed12f6de admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:10.772027 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-641b76a1-f792-4a44-84cc-2cbeed12f6de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4449a20ba22046dc90a871cb1ca9c8c8', 'request_id': 'req-641b76a1-f792-4a44-84cc-2cbeed12f6de'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:10.780154 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-641b76a1-f792-4a44-84cc-2cbeed12f6de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4449a20ba22046dc90a871cb1ca9c8c8', 'request_id': 'req-641b76a1-f792-4a44-84cc-2cbeed12f6de'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:10.785886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-641b76a1-f792-4a44-84cc-2cbeed12f6de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4449a20ba22046dc90a871cb1ca9c8c8', 'request_id': 'req-641b76a1-f792-4a44-84cc-2cbeed12f6de'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:10.796935 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-641b76a1-f792-4a44-84cc-2cbeed12f6de admin admin] The token cache is being invalidate because project 4449a20ba22046dc90a871cb1ca9c8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:10.797226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-641b76a1-f792-4a44-84cc-2cbeed12f6de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:10.797913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-641b76a1-f792-4a44-84cc-2cbeed12f6de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:10.799464 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1144/2293] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:10 2022] DELETE /identity/v3/projects/4449a20ba22046dc90a871cb1ca9c8c8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:10.804869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14d1d4-94ed-4271-a256-9d3396f330aa None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:10.805387 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14d1d4-94ed-4271-a256-9d3396f330aa None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:10.805853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14d1d4-94ed-4271-a256-9d3396f330aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:10.834266 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-fa14d1d4-94ed-4271-a256-9d3396f330aa None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:10.836059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-fa14d1d4-94ed-4271-a256-9d3396f330aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:10.896235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1150/2294] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:10.903978 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c9778-8520-4b30-9e2c-c437944ce511 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:10.904285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c9778-8520-4b30-9e2c-c437944ce511 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:10.904558 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c9778-8520-4b30-9e2c-c437944ce511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:10.923185 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e51c9778-8520-4b30-9e2c-c437944ce511 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:10.924554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e51c9778-8520-4b30-9e2c-c437944ce511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:10.936515 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1145/2295] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:10.941026 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14d1d4-94ed-4271-a256-9d3396f330aa None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:10.950929 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14d1d4-94ed-4271-a256-9d3396f330aa None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:10.955702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c2488-61b3-463f-b375-e2ebae2c55c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:10.956386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c2488-61b3-463f-b375-e2ebae2c55c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:10.956663 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c2488-61b3-463f-b375-e2ebae2c55c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:10.956932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c2488-61b3-463f-b375-e2ebae2c55c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:10.957676 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c2488-61b3-463f-b375-e2ebae2c55c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:55:10.957957 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c2488-61b3-463f-b375-e2ebae2c55c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:10.959529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c2488-61b3-463f-b375-e2ebae2c55c2 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:10.972587 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1151/2296] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:55:10.976734 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c9778-8520-4b30-9e2c-c437944ce511 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:10.989177 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c9778-8520-4b30-9e2c-c437944ce511 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:10.995133 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bced28d-93b4-4c20-8b28-96ac3ec02d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:10.995905 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bced28d-93b4-4c20-8b28-96ac3ec02d4d admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:10.996275 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bced28d-93b4-4c20-8b28-96ac3ec02d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:10.996611 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bced28d-93b4-4c20-8b28-96ac3ec02d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:10.997377 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bced28d-93b4-4c20-8b28-96ac3ec02d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:10.999369 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bced28d-93b4-4c20-8b28-96ac3ec02d4d admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:11.028812 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1146/2297] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:10 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:11.033218 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c2488-61b3-463f-b375-e2ebae2c55c2 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:11.043700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c2488-61b3-463f-b375-e2ebae2c55c2 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:11.106772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd11de1-335e-4c2a-926d-a77ce39cbc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:11.107452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11de1-335e-4c2a-926d-a77ce39cbc68 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:11.107749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11de1-335e-4c2a-926d-a77ce39cbc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:11.108034 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11de1-335e-4c2a-926d-a77ce39cbc68 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:11.109098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd11de1-335e-4c2a-926d-a77ce39cbc68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:11.111031 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd11de1-335e-4c2a-926d-a77ce39cbc68 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:11.143600 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1152/2298] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:11 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:11.145910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bced28d-93b4-4c20-8b28-96ac3ec02d4d admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:11.157010 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bced28d-93b4-4c20-8b28-96ac3ec02d4d admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:11.165735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9730d7-c211-4cc5-a75f-70be70298504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:11.165735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9730d7-c211-4cc5-a75f-70be70298504 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:11.165735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9730d7-c211-4cc5-a75f-70be70298504 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:11.165735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9730d7-c211-4cc5-a75f-70be70298504 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:11.166246 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9730d7-c211-4cc5-a75f-70be70298504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:11.168020 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9730d7-c211-4cc5-a75f-70be70298504 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:11.189723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1147/2299] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:55:11.193786 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd11de1-335e-4c2a-926d-a77ce39cbc68 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:11.204258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd11de1-335e-4c2a-926d-a77ce39cbc68 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:11.211178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e218d-5817-4264-9233-50a9bd8a67da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:11.211864 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e218d-5817-4264-9233-50a9bd8a67da admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:11.212237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e218d-5817-4264-9233-50a9bd8a67da admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:11.212453 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e218d-5817-4264-9233-50a9bd8a67da admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:11.213672 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e218d-5817-4264-9233-50a9bd8a67da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:11.215066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e218d-5817-4264-9233-50a9bd8a67da admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:11.234692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1153/2300] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:55:11.235991 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9730d7-c211-4cc5-a75f-70be70298504 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:11.247065 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9730d7-c211-4cc5-a75f-70be70298504 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:11.253789 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3043d-f085-415c-bd40-d2b300aacdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:11.254691 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3043d-f085-415c-bd40-d2b300aacdee admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:11.255020 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3043d-f085-415c-bd40-d2b300aacdee admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:11.255301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3043d-f085-415c-bd40-d2b300aacdee admin admin] PATH_INFO: `/v3/projects/c74b4e29bba644fab9a14f541989255e/users/4ee793304b4340e487b89a044a8d768d/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:11.275065 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3043d-f085-415c-bd40-d2b300aacdee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74b4e29bba644fab9a14f541989255e, user_id=4ee793304b4340e487b89a044a8d768d, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:11.278400 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3043d-f085-415c-bd40-d2b300aacdee admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:11.297472 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1148/2301] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:11 2022] PUT /identity/v3/projects/c74b4e29bba644fab9a14f541989255e/users/4ee793304b4340e487b89a044a8d768d/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:11.307788 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24677c8b-58ed-404c-84d0-2f7b97297c3e None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:11.308393 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24677c8b-58ed-404c-84d0-2f7b97297c3e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:11.309315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24677c8b-58ed-404c-84d0-2f7b97297c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:11.339925 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-24677c8b-58ed-404c-84d0-2f7b97297c3e None None] MFA Rules not processed for user `4ee793304b4340e487b89a044a8d768d`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:11.341170 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-24677c8b-58ed-404c-84d0-2f7b97297c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:11.407214 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1154/2302] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:11.412088 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3043d-f085-415c-bd40-d2b300aacdee admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:11.476401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3043d-f085-415c-bd40-d2b300aacdee admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:11.482061 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e2a08-bca4-4e3e-8555-b77a04f57874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:11.482752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e2a08-bca4-4e3e-8555-b77a04f57874 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:11.483036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e2a08-bca4-4e3e-8555-b77a04f57874 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:11.483312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e2a08-bca4-4e3e-8555-b77a04f57874 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:11.484017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e2a08-bca4-4e3e-8555-b77a04f57874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:11.486050 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e2a08-bca4-4e3e-8555-b77a04f57874 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:11.514828 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1149/2303] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:11 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:11.520445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24677c8b-58ed-404c-84d0-2f7b97297c3e None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:11.532694 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24677c8b-58ed-404c-84d0-2f7b97297c3e None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:11.596240 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4205fe-b3c5-4073-96ea-a51d7cb27ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:11.596934 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4205fe-b3c5-4073-96ea-a51d7cb27ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:11.597227 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4205fe-b3c5-4073-96ea-a51d7cb27ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:11.597513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4205fe-b3c5-4073-96ea-a51d7cb27ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:11.598215 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4205fe-b3c5-4073-96ea-a51d7cb27ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:11.600169 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4205fe-b3c5-4073-96ea-a51d7cb27ad4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:11.623275 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1155/2304] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:11 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:11.627783 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e2a08-bca4-4e3e-8555-b77a04f57874 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:11.639330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e2a08-bca4-4e3e-8555-b77a04f57874 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:11.644994 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153a840-8e90-4b13-96e5-37b8dcbfaca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:11.645693 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153a840-8e90-4b13-96e5-37b8dcbfaca5 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:11.645970 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153a840-8e90-4b13-96e5-37b8dcbfaca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:11.646240 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153a840-8e90-4b13-96e5-37b8dcbfaca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:11.646977 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153a840-8e90-4b13-96e5-37b8dcbfaca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:11.648866 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153a840-8e90-4b13-96e5-37b8dcbfaca5 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:11.660454 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1150/2305] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:11.664885 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4205fe-b3c5-4073-96ea-a51d7cb27ad4 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:11.676039 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4205fe-b3c5-4073-96ea-a51d7cb27ad4 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:11.681886 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a66404-1012-4f8f-b0ba-ecedc2c324c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:11.682890 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a66404-1012-4f8f-b0ba-ecedc2c324c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:11.683209 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a66404-1012-4f8f-b0ba-ecedc2c324c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:11.683612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a66404-1012-4f8f-b0ba-ecedc2c324c8 admin admin] PATH_INFO: `/v3/projects/7c9980d1b3d24ee1b2fc027c450e9a91/users/9a3c32fc98604bbf81b026d0db004954/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:11.699427 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a66404-1012-4f8f-b0ba-ecedc2c324c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9980d1b3d24ee1b2fc027c450e9a91, user_id=9a3c32fc98604bbf81b026d0db004954, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:11.702501 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a66404-1012-4f8f-b0ba-ecedc2c324c8 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:11.716658 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1156/2306] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:11 2022] PUT /identity/v3/projects/7c9980d1b3d24ee1b2fc027c450e9a91/users/9a3c32fc98604bbf81b026d0db004954/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:11.719968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153a840-8e90-4b13-96e5-37b8dcbfaca5 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:11.730861 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153a840-8e90-4b13-96e5-37b8dcbfaca5 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:11.789539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa8c12-f341-42d8-b191-301aa36513b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:11.790458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa8c12-f341-42d8-b191-301aa36513b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:11.791348 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa8c12-f341-42d8-b191-301aa36513b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:11.791792 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa8c12-f341-42d8-b191-301aa36513b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:11.792516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa8c12-f341-42d8-b191-301aa36513b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:11.794181 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa8c12-f341-42d8-b191-301aa36513b5 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:11.807183 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1151/2307] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:55:11.812173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a66404-1012-4f8f-b0ba-ecedc2c324c8 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:11.823685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a66404-1012-4f8f-b0ba-ecedc2c324c8 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:11.830102 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025f55a-3804-4fae-a04d-3e254db9d180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:11.831212 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025f55a-3804-4fae-a04d-3e254db9d180 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:11.831566 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025f55a-3804-4fae-a04d-3e254db9d180 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:11.831839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025f55a-3804-4fae-a04d-3e254db9d180 admin admin] PATH_INFO: `/v3/projects/7c9980d1b3d24ee1b2fc027c450e9a91/users/9a3c32fc98604bbf81b026d0db004954/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:11.834672 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025f55a-3804-4fae-a04d-3e254db9d180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9980d1b3d24ee1b2fc027c450e9a91, user_id=9a3c32fc98604bbf81b026d0db004954, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:11.837505 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025f55a-3804-4fae-a04d-3e254db9d180 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:11.849226 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1157/2308] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:11 2022] PUT /identity/v3/projects/7c9980d1b3d24ee1b2fc027c450e9a91/users/9a3c32fc98604bbf81b026d0db004954/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:11.861782 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e1154-86e7-4432-9ffa-70c62e3d3cd0 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:11.862155 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e1154-86e7-4432-9ffa-70c62e3d3cd0 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:11.862531 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e1154-86e7-4432-9ffa-70c62e3d3cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:11.891594 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-a12e1154-86e7-4432-9ffa-70c62e3d3cd0 None None] MFA Rules not processed for user `9a3c32fc98604bbf81b026d0db004954`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:11.892853 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a12e1154-86e7-4432-9ffa-70c62e3d3cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:11.970219 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1152/2309] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:11.982003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025f55a-3804-4fae-a04d-3e254db9d180 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:11.983728 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4025f55a-3804-4fae-a04d-3e254db9d180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:12.048564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025f55a-3804-4fae-a04d-3e254db9d180 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:12.052594 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3a75d-31d7-4c11-a86f-60a6f0a90ecb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:12.053234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3a75d-31d7-4c11-a86f-60a6f0a90ecb service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:12.053504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3a75d-31d7-4c11-a86f-60a6f0a90ecb service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:12.053772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3a75d-31d7-4c11-a86f-60a6f0a90ecb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:12.067726 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3a75d-31d7-4c11-a86f-60a6f0a90ecb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:12.069566 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3a75d-31d7-4c11-a86f-60a6f0a90ecb service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:12.082185 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1158/2310] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:12.157389 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e1154-86e7-4432-9ffa-70c62e3d3cd0 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:12.227983 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e1154-86e7-4432-9ffa-70c62e3d3cd0 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:12.238572 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac241f-b62b-4750-935f-1731ff217d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:12.239466 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac241f-b62b-4750-935f-1731ff217d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:12.239747 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac241f-b62b-4750-935f-1731ff217d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:12.240011 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac241f-b62b-4750-935f-1731ff217d2b admin admin] PATH_INFO: `/v3/users/4ee793304b4340e487b89a044a8d768d` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:12.242229 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac241f-b62b-4750-935f-1731ff217d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee793304b4340e487b89a044a8d768d)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:12.244175 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac241f-b62b-4750-935f-1731ff217d2b admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:12.320552 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8eac241f-b62b-4750-935f-1731ff217d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee793304b4340e487b89a044a8d768d'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:12.321094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8eac241f-b62b-4750-935f-1731ff217d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee793304b4340e487b89a044a8d768d'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:12.335030 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8eac241f-b62b-4750-935f-1731ff217d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee793304b4340e487b89a044a8d768d'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:12.335767 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8eac241f-b62b-4750-935f-1731ff217d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee793304b4340e487b89a044a8d768d'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:12.344795 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8eac241f-b62b-4750-935f-1731ff217d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee793304b4340e487b89a044a8d768d'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:12.361668 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1153/2311] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:12 2022] DELETE /identity/v3/users/4ee793304b4340e487b89a044a8d768d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:12.370289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f093a-ad4a-4618-a942-72acf4049ddd None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:12.370802 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f093a-ad4a-4618-a942-72acf4049ddd None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:12.371057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f093a-ad4a-4618-a942-72acf4049ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:12.391461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-8e4f093a-ad4a-4618-a942-72acf4049ddd None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:12.392684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8e4f093a-ad4a-4618-a942-72acf4049ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:12.457498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1159/2312] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:12.468501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac241f-b62b-4750-935f-1731ff217d2b admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:12.469949 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-8eac241f-b62b-4750-935f-1731ff217d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:12.529656 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac241f-b62b-4750-935f-1731ff217d2b admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:12.535052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e26b12-6674-4a4f-a8f5-c160d4b87108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:12.535946 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e26b12-6674-4a4f-a8f5-c160d4b87108 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:12.536376 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e26b12-6674-4a4f-a8f5-c160d4b87108 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:12.536662 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e26b12-6674-4a4f-a8f5-c160d4b87108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:12.547627 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e26b12-6674-4a4f-a8f5-c160d4b87108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:12.549116 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e26b12-6674-4a4f-a8f5-c160d4b87108 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:12.559849 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1154/2313] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:12.841837 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f093a-ad4a-4618-a942-72acf4049ddd None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:12.843464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8e4f093a-ad4a-4618-a942-72acf4049ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:12.857980 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f093a-ad4a-4618-a942-72acf4049ddd None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:12.871143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:12.872048 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:12.872362 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:12.872622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095 admin admin] PATH_INFO: `/v3/projects/c74b4e29bba644fab9a14f541989255e` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:12.873923 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c74b4e29bba644fab9a14f541989255e)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:12.875837 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:12.923444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c74b4e29bba644fab9a14f541989255e', 'request_id': 'req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:12.931551 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c74b4e29bba644fab9a14f541989255e', 'request_id': 'req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:12.938355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c74b4e29bba644fab9a14f541989255e', 'request_id': 'req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:12.948651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095 admin admin] The token cache is being invalidate because project c74b4e29bba644fab9a14f541989255e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:12.948937 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:12.949574 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:12.951091 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1160/2314] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:12 2022] DELETE /identity/v3/projects/c74b4e29bba644fab9a14f541989255e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:12.955473 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e26b12-6674-4a4f-a8f5-c160d4b87108 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:12.965260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e26b12-6674-4a4f-a8f5-c160d4b87108 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:13.048634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430cee6-327c-44bc-ba18-f1773949d372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:13.049733 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430cee6-327c-44bc-ba18-f1773949d372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:13.050103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430cee6-327c-44bc-ba18-f1773949d372 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:13.050496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430cee6-327c-44bc-ba18-f1773949d372 admin admin] PATH_INFO: `/v3/users/9a3c32fc98604bbf81b026d0db004954` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:13.052191 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430cee6-327c-44bc-ba18-f1773949d372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3c32fc98604bbf81b026d0db004954)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:13.054654 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430cee6-327c-44bc-ba18-f1773949d372 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:13.116677 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0430cee6-327c-44bc-ba18-f1773949d372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3c32fc98604bbf81b026d0db004954'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:13.117465 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0430cee6-327c-44bc-ba18-f1773949d372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3c32fc98604bbf81b026d0db004954'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:13.130633 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0430cee6-327c-44bc-ba18-f1773949d372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3c32fc98604bbf81b026d0db004954'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:13.131373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0430cee6-327c-44bc-ba18-f1773949d372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3c32fc98604bbf81b026d0db004954'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:13.139915 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0430cee6-327c-44bc-ba18-f1773949d372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3c32fc98604bbf81b026d0db004954'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:13.152654 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1155/2315] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:12 2022] DELETE /identity/v3/users/9a3c32fc98604bbf81b026d0db004954 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:13.471843 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:13.475363 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:13.499929 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf8da9-e896-4b7c-9523-2bbf9f2e5095 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:13.587188 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92799a89-089e-418e-b1ea-047b410072ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:13.588241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92799a89-089e-418e-b1ea-047b410072ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:13.588551 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92799a89-089e-418e-b1ea-047b410072ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:13.588817 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92799a89-089e-418e-b1ea-047b410072ce admin admin] PATH_INFO: `/v3/projects/7c9980d1b3d24ee1b2fc027c450e9a91` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:13.590450 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92799a89-089e-418e-b1ea-047b410072ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9980d1b3d24ee1b2fc027c450e9a91)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:13.592405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92799a89-089e-418e-b1ea-047b410072ce admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:13.648753 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-92799a89-089e-418e-b1ea-047b410072ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9980d1b3d24ee1b2fc027c450e9a91', 'request_id': 'req-92799a89-089e-418e-b1ea-047b410072ce'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:13.657591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-92799a89-089e-418e-b1ea-047b410072ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9980d1b3d24ee1b2fc027c450e9a91', 'request_id': 'req-92799a89-089e-418e-b1ea-047b410072ce'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:13.664697 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-92799a89-089e-418e-b1ea-047b410072ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9980d1b3d24ee1b2fc027c450e9a91', 'request_id': 'req-92799a89-089e-418e-b1ea-047b410072ce'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:13.675482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-92799a89-089e-418e-b1ea-047b410072ce admin admin] The token cache is being invalidate because project 7c9980d1b3d24ee1b2fc027c450e9a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:13.675865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-92799a89-089e-418e-b1ea-047b410072ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:13.676666 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-92799a89-089e-418e-b1ea-047b410072ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:13.678437 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1161/2316] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:13 2022] DELETE /identity/v3/projects/7c9980d1b3d24ee1b2fc027c450e9a91 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:13.683262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd4fda-7808-4d75-b2b5-9fa8c9cc71c1 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:13.683657 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd4fda-7808-4d75-b2b5-9fa8c9cc71c1 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:13.683818 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd4fda-7808-4d75-b2b5-9fa8c9cc71c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:13.704178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-1dbd4fda-7808-4d75-b2b5-9fa8c9cc71c1 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:13.705455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1dbd4fda-7808-4d75-b2b5-9fa8c9cc71c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:13.768724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1156/2317] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:13.777145 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b8383-87a6-415e-a412-6519f860768d None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:13.777442 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b8383-87a6-415e-a412-6519f860768d None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:13.777704 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b8383-87a6-415e-a412-6519f860768d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:13.803226 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-2d2b8383-87a6-415e-a412-6519f860768d None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:13.804943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2d2b8383-87a6-415e-a412-6519f860768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:13.826876 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1162/2318] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:13.833772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd4fda-7808-4d75-b2b5-9fa8c9cc71c1 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:13.846059 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd4fda-7808-4d75-b2b5-9fa8c9cc71c1 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:13.852037 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c087a5-199c-4efb-898f-c99b71576953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:13.852726 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c087a5-199c-4efb-898f-c99b71576953 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:13.853005 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c087a5-199c-4efb-898f-c99b71576953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:13.853307 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c087a5-199c-4efb-898f-c99b71576953 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:13.854021 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c087a5-199c-4efb-898f-c99b71576953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:55:13.854338 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c087a5-199c-4efb-898f-c99b71576953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:13.855915 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c087a5-199c-4efb-898f-c99b71576953 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:13.867693 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1157/2319] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:55:13.872335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b8383-87a6-415e-a412-6519f860768d None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:13.881772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b8383-87a6-415e-a412-6519f860768d None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:13.887646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd292d-9f52-4152-a7b9-286e3ad48dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:13.888336 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd292d-9f52-4152-a7b9-286e3ad48dea admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:13.888614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd292d-9f52-4152-a7b9-286e3ad48dea admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:13.888882 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd292d-9f52-4152-a7b9-286e3ad48dea admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:13.889574 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd292d-9f52-4152-a7b9-286e3ad48dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:13.891483 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd292d-9f52-4152-a7b9-286e3ad48dea admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:13.919772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1163/2320] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:13 2022] POST /identity/v3/projects => generated 407 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:13.926124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c087a5-199c-4efb-898f-c99b71576953 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:13.941695 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c087a5-199c-4efb-898f-c99b71576953 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:14.014088 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e0a60-deb7-498c-8824-c35151338246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:14.014729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0a60-deb7-498c-8824-c35151338246 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:14.014963 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0a60-deb7-498c-8824-c35151338246 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:14.015231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0a60-deb7-498c-8824-c35151338246 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:14.015917 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e0a60-deb7-498c-8824-c35151338246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:14.017906 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e0a60-deb7-498c-8824-c35151338246 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:14.040362 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1158/2321] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:13 2022] POST /identity/v3/users => generated 304 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:14.045629 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd292d-9f52-4152-a7b9-286e3ad48dea admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:14.056278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd292d-9f52-4152-a7b9-286e3ad48dea admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:14.061173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b744c-d94e-4e21-a2e8-38492418622a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:14.061824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b744c-d94e-4e21-a2e8-38492418622a admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:14.062103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b744c-d94e-4e21-a2e8-38492418622a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:14.062372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b744c-d94e-4e21-a2e8-38492418622a admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:14.063081 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b744c-d94e-4e21-a2e8-38492418622a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:14.064730 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b744c-d94e-4e21-a2e8-38492418622a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:14.075624 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1164/2322] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:14.079617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e0a60-deb7-498c-8824-c35151338246 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:14.090096 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e0a60-deb7-498c-8824-c35151338246 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:14.096132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e98fd0-a07b-4b15-afb1-0afef6a3e2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:14.096846 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e98fd0-a07b-4b15-afb1-0afef6a3e2fb admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:14.097123 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e98fd0-a07b-4b15-afb1-0afef6a3e2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:14.097393 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e98fd0-a07b-4b15-afb1-0afef6a3e2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:14.098116 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e98fd0-a07b-4b15-afb1-0afef6a3e2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:14.099689 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e98fd0-a07b-4b15-afb1-0afef6a3e2fb admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:14.110296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1159/2323] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:14.114452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b744c-d94e-4e21-a2e8-38492418622a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:14.124966 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b744c-d94e-4e21-a2e8-38492418622a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:14.131187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccef7a7-b65c-4380-b841-c8303e83399f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:14.132066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccef7a7-b65c-4380-b841-c8303e83399f admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:14.132442 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccef7a7-b65c-4380-b841-c8303e83399f admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:14.132697 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccef7a7-b65c-4380-b841-c8303e83399f admin admin] PATH_INFO: `/v3/projects/93eec758ddbf476fa0a3e3a0640167dd/users/d2adcaf35c78494b98f893381dd4bae4/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:14.148812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccef7a7-b65c-4380-b841-c8303e83399f admin admin] RBAC: Authorizing `identity:create_grant(project_id=93eec758ddbf476fa0a3e3a0640167dd, user_id=d2adcaf35c78494b98f893381dd4bae4, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:14.151806 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccef7a7-b65c-4380-b841-c8303e83399f admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:14.167449 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1165/2324] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:14 2022] PUT /identity/v3/projects/93eec758ddbf476fa0a3e3a0640167dd/users/d2adcaf35c78494b98f893381dd4bae4/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:14.177928 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b4c2a-b6d2-4d1e-90a0-840163826185 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:14.178231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b4c2a-b6d2-4d1e-90a0-840163826185 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:14.178542 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b4c2a-b6d2-4d1e-90a0-840163826185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:14.204856 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-ce7b4c2a-b6d2-4d1e-90a0-840163826185 None None] MFA Rules not processed for user `d2adcaf35c78494b98f893381dd4bae4`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:14.206051 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ce7b4c2a-b6d2-4d1e-90a0-840163826185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:14.277881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1160/2325] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:14.282734 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccef7a7-b65c-4380-b841-c8303e83399f admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:14.346961 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccef7a7-b65c-4380-b841-c8303e83399f admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:14.352971 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a42328-ee6d-46f1-8222-139897847aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:14.353624 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a42328-ee6d-46f1-8222-139897847aba admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:14.353894 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a42328-ee6d-46f1-8222-139897847aba admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:14.354156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a42328-ee6d-46f1-8222-139897847aba admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:14.354835 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a42328-ee6d-46f1-8222-139897847aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:14.356751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a42328-ee6d-46f1-8222-139897847aba admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:14.386996 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1166/2326] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:14 2022] POST /identity/v3/projects => generated 409 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:14.391266 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b4c2a-b6d2-4d1e-90a0-840163826185 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:14.403218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b4c2a-b6d2-4d1e-90a0-840163826185 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:14.464393 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85002d5-df42-4615-8bb7-30add1fa0e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:14.465078 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85002d5-df42-4615-8bb7-30add1fa0e00 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:14.465356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85002d5-df42-4615-8bb7-30add1fa0e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:14.465790 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85002d5-df42-4615-8bb7-30add1fa0e00 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:14.466498 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85002d5-df42-4615-8bb7-30add1fa0e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:14.468424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85002d5-df42-4615-8bb7-30add1fa0e00 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:14.490717 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1161/2327] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:14 2022] POST /identity/v3/users => generated 311 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:14.494773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a42328-ee6d-46f1-8222-139897847aba admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:14.505453 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a42328-ee6d-46f1-8222-139897847aba admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:14.510529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb837f-951b-40c1-a2b7-40d8e0c9199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:14.511528 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb837f-951b-40c1-a2b7-40d8e0c9199b admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:14.511840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb837f-951b-40c1-a2b7-40d8e0c9199b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:14.512108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb837f-951b-40c1-a2b7-40d8e0c9199b admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:14.513168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb837f-951b-40c1-a2b7-40d8e0c9199b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:14.514767 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb837f-951b-40c1-a2b7-40d8e0c9199b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:14.526010 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1167/2328] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:14.530820 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85002d5-df42-4615-8bb7-30add1fa0e00 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:14.541737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85002d5-df42-4615-8bb7-30add1fa0e00 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:14.546386 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262d0d3-d94f-4174-a6a8-c4dc93f7a5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:14.547262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d0d3-d94f-4174-a6a8-c4dc93f7a5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:14.547538 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d0d3-d94f-4174-a6a8-c4dc93f7a5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:14.547807 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d0d3-d94f-4174-a6a8-c4dc93f7a5a3 admin admin] PATH_INFO: `/v3/projects/364b02e0429b446390474ba520adf493/users/fb679b6e590a402fa4dfd7053ba93cee/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:14.563529 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262d0d3-d94f-4174-a6a8-c4dc93f7a5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=364b02e0429b446390474ba520adf493, user_id=fb679b6e590a402fa4dfd7053ba93cee, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:14.566187 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262d0d3-d94f-4174-a6a8-c4dc93f7a5a3 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:14.580559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1162/2329] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:14 2022] PUT /identity/v3/projects/364b02e0429b446390474ba520adf493/users/fb679b6e590a402fa4dfd7053ba93cee/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:14.584773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb837f-951b-40c1-a2b7-40d8e0c9199b admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:14.594748 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb837f-951b-40c1-a2b7-40d8e0c9199b admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:14.652707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78fa44-c54d-4ba4-95ee-2e3f21c476af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:14.653366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78fa44-c54d-4ba4-95ee-2e3f21c476af admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:14.653640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78fa44-c54d-4ba4-95ee-2e3f21c476af admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:14.653950 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78fa44-c54d-4ba4-95ee-2e3f21c476af admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:14.654668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78fa44-c54d-4ba4-95ee-2e3f21c476af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:14.656299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78fa44-c54d-4ba4-95ee-2e3f21c476af admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:14.665756 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1168/2330] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:55:14.670207 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262d0d3-d94f-4174-a6a8-c4dc93f7a5a3 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:14.680542 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262d0d3-d94f-4174-a6a8-c4dc93f7a5a3 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:14.685322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d74a37-5607-4c73-9056-bc87b8081bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:14.686198 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d74a37-5607-4c73-9056-bc87b8081bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:14.686476 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d74a37-5607-4c73-9056-bc87b8081bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:14.686744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d74a37-5607-4c73-9056-bc87b8081bfa admin admin] PATH_INFO: `/v3/projects/364b02e0429b446390474ba520adf493/users/fb679b6e590a402fa4dfd7053ba93cee/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:14.688797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d74a37-5607-4c73-9056-bc87b8081bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=364b02e0429b446390474ba520adf493, user_id=fb679b6e590a402fa4dfd7053ba93cee, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:14.691433 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d74a37-5607-4c73-9056-bc87b8081bfa admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:14.702073 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1163/2331] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:14 2022] PUT /identity/v3/projects/364b02e0429b446390474ba520adf493/users/fb679b6e590a402fa4dfd7053ba93cee/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:14.713426 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3245-5aa4-4643-bb3a-c4612423bc15 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:14.713714 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3245-5aa4-4643-bb3a-c4612423bc15 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:14.713984 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3245-5aa4-4643-bb3a-c4612423bc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:14.742052 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-152a3245-5aa4-4643-bb3a-c4612423bc15 None None] MFA Rules not processed for user `fb679b6e590a402fa4dfd7053ba93cee`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:14.743313 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-152a3245-5aa4-4643-bb3a-c4612423bc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:14.812324 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1169/2332] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:14 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:14.823388 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d74a37-5607-4c73-9056-bc87b8081bfa admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:14.825302 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-b5d74a37-5607-4c73-9056-bc87b8081bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:14.882504 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d74a37-5607-4c73-9056-bc87b8081bfa admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:14.886239 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6d4ea-096e-4b41-ac54-518b53ca75b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:14.886851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d4ea-096e-4b41-ac54-518b53ca75b0 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:14.887124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d4ea-096e-4b41-ac54-518b53ca75b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:14.887389 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d4ea-096e-4b41-ac54-518b53ca75b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:14.896694 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6d4ea-096e-4b41-ac54-518b53ca75b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:14.898118 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6d4ea-096e-4b41-ac54-518b53ca75b0 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:14.907778 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1164/2333] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:15.068567 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a3245-5aa4-4643-bb3a-c4612423bc15 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:15.078365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a3245-5aa4-4643-bb3a-c4612423bc15 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:15.082730 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3371c-8aaf-47ae-8306-0957df550995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:15.083361 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3371c-8aaf-47ae-8306-0957df550995 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:15.083707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3371c-8aaf-47ae-8306-0957df550995 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:15.084001 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3371c-8aaf-47ae-8306-0957df550995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:15.141010 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3371c-8aaf-47ae-8306-0957df550995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:15.142806 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3371c-8aaf-47ae-8306-0957df550995 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:15.151944 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1170/2334] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:15 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:22.925918 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad902e0-f7bc-4f0f-a5a7-210ded9768cf None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:22.926503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad902e0-f7bc-4f0f-a5a7-210ded9768cf None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:22.926503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad902e0-f7bc-4f0f-a5a7-210ded9768cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:22.944343 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-dad902e0-f7bc-4f0f-a5a7-210ded9768cf None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:22.945590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-dad902e0-f7bc-4f0f-a5a7-210ded9768cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:23.006962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1165/2335] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Nov 2 12:55:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:23.052550 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3371c-8aaf-47ae-8306-0957df550995 service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:23.054051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4ea3371c-8aaf-47ae-8306-0957df550995 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:23.136472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3371c-8aaf-47ae-8306-0957df550995 service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:23.136472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480ecde-239e-44eb-9c09-6d4cd4566ba7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:23.136472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480ecde-239e-44eb-9c09-6d4cd4566ba7 service swift] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:23.136472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480ecde-239e-44eb-9c09-6d4cd4566ba7 service swift] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:23.136840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480ecde-239e-44eb-9c09-6d4cd4566ba7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:23.142219 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480ecde-239e-44eb-9c09-6d4cd4566ba7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:23.144168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480ecde-239e-44eb-9c09-6d4cd4566ba7 service swift] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:23.153250 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1171/2336] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 12:55:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:55:35.264906 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad902e0-f7bc-4f0f-a5a7-210ded9768cf None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:35.344621 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad902e0-f7bc-4f0f-a5a7-210ded9768cf None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:35.349630 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277183bf-d515-4b15-b87a-464723694013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:35.350609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277183bf-d515-4b15-b87a-464723694013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:35.350881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277183bf-d515-4b15-b87a-464723694013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:35.351153 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277183bf-d515-4b15-b87a-464723694013 admin admin] PATH_INFO: `/v3/users/d2adcaf35c78494b98f893381dd4bae4` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:35.352498 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277183bf-d515-4b15-b87a-464723694013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2adcaf35c78494b98f893381dd4bae4)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:35.354832 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277183bf-d515-4b15-b87a-464723694013 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:35.422623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-277183bf-d515-4b15-b87a-464723694013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2adcaf35c78494b98f893381dd4bae4'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:35.423431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-277183bf-d515-4b15-b87a-464723694013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2adcaf35c78494b98f893381dd4bae4'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:35.442284 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-277183bf-d515-4b15-b87a-464723694013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2adcaf35c78494b98f893381dd4bae4'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:35.443493 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-277183bf-d515-4b15-b87a-464723694013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2adcaf35c78494b98f893381dd4bae4'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:35.453975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-277183bf-d515-4b15-b87a-464723694013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2adcaf35c78494b98f893381dd4bae4'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:35.469810 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1166/2337] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:35 2022] DELETE /identity/v3/users/d2adcaf35c78494b98f893381dd4bae4 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:35.475539 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3bf8f-6ec5-4f8f-b970-58ad934fdaf2 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:35.476758 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3bf8f-6ec5-4f8f-b970-58ad934fdaf2 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:35.477222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3bf8f-6ec5-4f8f-b970-58ad934fdaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:35.500303 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-e8d3bf8f-6ec5-4f8f-b970-58ad934fdaf2 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:35.502231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e8d3bf8f-6ec5-4f8f-b970-58ad934fdaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:35.680860 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277183bf-d515-4b15-b87a-464723694013 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:35.682328 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-277183bf-d515-4b15-b87a-464723694013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:35.685704 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1172/2338] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:35.800316 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277183bf-d515-4b15-b87a-464723694013 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:35.804483 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bea35-8ebb-4982-ad3f-a427fb3b9845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:35.805224 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bea35-8ebb-4982-ad3f-a427fb3b9845 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:35.805582 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bea35-8ebb-4982-ad3f-a427fb3b9845 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:35.806373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bea35-8ebb-4982-ad3f-a427fb3b9845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:35.815934 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bea35-8ebb-4982-ad3f-a427fb3b9845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:35.817839 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bea35-8ebb-4982-ad3f-a427fb3b9845 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:35.829527 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1167/2339] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:55:36.139682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3bf8f-6ec5-4f8f-b970-58ad934fdaf2 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:36.141256 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e8d3bf8f-6ec5-4f8f-b970-58ad934fdaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:36.155352 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3bf8f-6ec5-4f8f-b970-58ad934fdaf2 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:36.161147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f72fe-3013-455c-9ae9-751d0304ff3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:36.162165 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f72fe-3013-455c-9ae9-751d0304ff3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:36.162777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f72fe-3013-455c-9ae9-751d0304ff3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:36.163039 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f72fe-3013-455c-9ae9-751d0304ff3b admin admin] PATH_INFO: `/v3/projects/93eec758ddbf476fa0a3e3a0640167dd` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:36.164520 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f72fe-3013-455c-9ae9-751d0304ff3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=93eec758ddbf476fa0a3e3a0640167dd)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:36.166446 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f72fe-3013-455c-9ae9-751d0304ff3b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:36.217829 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-388f72fe-3013-455c-9ae9-751d0304ff3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93eec758ddbf476fa0a3e3a0640167dd', 'request_id': 'req-388f72fe-3013-455c-9ae9-751d0304ff3b'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.226744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-388f72fe-3013-455c-9ae9-751d0304ff3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93eec758ddbf476fa0a3e3a0640167dd', 'request_id': 'req-388f72fe-3013-455c-9ae9-751d0304ff3b'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.234064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-388f72fe-3013-455c-9ae9-751d0304ff3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93eec758ddbf476fa0a3e3a0640167dd', 'request_id': 'req-388f72fe-3013-455c-9ae9-751d0304ff3b'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.245556 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-388f72fe-3013-455c-9ae9-751d0304ff3b admin admin] The token cache is being invalidate because project 93eec758ddbf476fa0a3e3a0640167dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:36.245844 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-388f72fe-3013-455c-9ae9-751d0304ff3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.246524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-388f72fe-3013-455c-9ae9-751d0304ff3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.248776 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1173/2340] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:36 2022] DELETE /identity/v3/projects/93eec758ddbf476fa0a3e3a0640167dd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:36.253106 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bea35-8ebb-4982-ad3f-a427fb3b9845 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:36.262980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bea35-8ebb-4982-ad3f-a427fb3b9845 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:36.322269 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e65f23-2a22-4e4a-aa53-2fc5f7129b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:36.324008 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e65f23-2a22-4e4a-aa53-2fc5f7129b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:36.324431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e65f23-2a22-4e4a-aa53-2fc5f7129b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:36.324712 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e65f23-2a22-4e4a-aa53-2fc5f7129b0d admin admin] PATH_INFO: `/v3/users/fb679b6e590a402fa4dfd7053ba93cee` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:36.325959 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e65f23-2a22-4e4a-aa53-2fc5f7129b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb679b6e590a402fa4dfd7053ba93cee)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:36.327886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e65f23-2a22-4e4a-aa53-2fc5f7129b0d admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:36.380672 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-27e65f23-2a22-4e4a-aa53-2fc5f7129b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb679b6e590a402fa4dfd7053ba93cee'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.381583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-27e65f23-2a22-4e4a-aa53-2fc5f7129b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb679b6e590a402fa4dfd7053ba93cee'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.394892 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-27e65f23-2a22-4e4a-aa53-2fc5f7129b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb679b6e590a402fa4dfd7053ba93cee'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.395523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-27e65f23-2a22-4e4a-aa53-2fc5f7129b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb679b6e590a402fa4dfd7053ba93cee'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.404392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-27e65f23-2a22-4e4a-aa53-2fc5f7129b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb679b6e590a402fa4dfd7053ba93cee'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.417024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1168/2341] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:36 2022] DELETE /identity/v3/users/fb679b6e590a402fa4dfd7053ba93cee => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:36.743298 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f72fe-3013-455c-9ae9-751d0304ff3b admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:36.745503 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-388f72fe-3013-455c-9ae9-751d0304ff3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:36.764869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f72fe-3013-455c-9ae9-751d0304ff3b admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:36.865810 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c408293-1884-4b4e-af6c-0a3b8fd6b0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:36.867011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c408293-1884-4b4e-af6c-0a3b8fd6b0a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:36.867443 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c408293-1884-4b4e-af6c-0a3b8fd6b0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:36.867720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c408293-1884-4b4e-af6c-0a3b8fd6b0a9 admin admin] PATH_INFO: `/v3/projects/364b02e0429b446390474ba520adf493` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:36.868994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c408293-1884-4b4e-af6c-0a3b8fd6b0a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=364b02e0429b446390474ba520adf493)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:36.871164 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c408293-1884-4b4e-af6c-0a3b8fd6b0a9 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:36.941562 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3c408293-1884-4b4e-af6c-0a3b8fd6b0a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364b02e0429b446390474ba520adf493', 'request_id': 'req-3c408293-1884-4b4e-af6c-0a3b8fd6b0a9'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.951633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3c408293-1884-4b4e-af6c-0a3b8fd6b0a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364b02e0429b446390474ba520adf493', 'request_id': 'req-3c408293-1884-4b4e-af6c-0a3b8fd6b0a9'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.959282 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3c408293-1884-4b4e-af6c-0a3b8fd6b0a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364b02e0429b446390474ba520adf493', 'request_id': 'req-3c408293-1884-4b4e-af6c-0a3b8fd6b0a9'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.971049 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3c408293-1884-4b4e-af6c-0a3b8fd6b0a9 admin admin] The token cache is being invalidate because project 364b02e0429b446390474ba520adf493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:36.971694 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3c408293-1884-4b4e-af6c-0a3b8fd6b0a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.972463 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3c408293-1884-4b4e-af6c-0a3b8fd6b0a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.974077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1174/2342] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:36 2022] DELETE /identity/v3/projects/364b02e0429b446390474ba520adf493 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:36.979192 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42b883-6f3e-4e59-887e-620b33da0749 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:36.979538 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42b883-6f3e-4e59-887e-620b33da0749 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:36.979899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42b883-6f3e-4e59-887e-620b33da0749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:37.002859 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-0e42b883-6f3e-4e59-887e-620b33da0749 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:37.004390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0e42b883-6f3e-4e59-887e-620b33da0749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:37.091124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1169/2343] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:37.099425 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b386f6-c264-425e-bd2b-e4baed8ad4fe None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:37.099715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b386f6-c264-425e-bd2b-e4baed8ad4fe None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:37.100023 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b386f6-c264-425e-bd2b-e4baed8ad4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:37.118947 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-e5b386f6-c264-425e-bd2b-e4baed8ad4fe None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:37.120225 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e5b386f6-c264-425e-bd2b-e4baed8ad4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:37.129108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1175/2344] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:37.133543 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42b883-6f3e-4e59-887e-620b33da0749 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:37.145443 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42b883-6f3e-4e59-887e-620b33da0749 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:37.151337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3738bff-a3c0-4d0e-aa95-0c2fa5538582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:37.152009 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3738bff-a3c0-4d0e-aa95-0c2fa5538582 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:37.152324 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3738bff-a3c0-4d0e-aa95-0c2fa5538582 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:37.152599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3738bff-a3c0-4d0e-aa95-0c2fa5538582 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:37.153321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3738bff-a3c0-4d0e-aa95-0c2fa5538582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:55:37.153623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3738bff-a3c0-4d0e-aa95-0c2fa5538582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:37.155250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3738bff-a3c0-4d0e-aa95-0c2fa5538582 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:37.170006 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1170/2345] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:55:37.176564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b386f6-c264-425e-bd2b-e4baed8ad4fe None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:37.186321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b386f6-c264-425e-bd2b-e4baed8ad4fe None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:37.193031 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86965a-ccc3-4cff-b1e8-e09d35bd0c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:37.193591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86965a-ccc3-4cff-b1e8-e09d35bd0c67 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:37.193861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86965a-ccc3-4cff-b1e8-e09d35bd0c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:37.194076 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86965a-ccc3-4cff-b1e8-e09d35bd0c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:37.194774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86965a-ccc3-4cff-b1e8-e09d35bd0c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:37.196741 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86965a-ccc3-4cff-b1e8-e09d35bd0c67 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:37.225774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1176/2346] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:37 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:37.234122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3738bff-a3c0-4d0e-aa95-0c2fa5538582 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:37.246562 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3738bff-a3c0-4d0e-aa95-0c2fa5538582 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:37.302644 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c52a6-f11d-49a2-9950-548c07c0c561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:37.303323 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c52a6-f11d-49a2-9950-548c07c0c561 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:37.303600 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c52a6-f11d-49a2-9950-548c07c0c561 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:37.303872 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c52a6-f11d-49a2-9950-548c07c0c561 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:37.304598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c52a6-f11d-49a2-9950-548c07c0c561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:37.306512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c52a6-f11d-49a2-9950-548c07c0c561 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:37.327520 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1171/2347] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:37 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:37.331903 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86965a-ccc3-4cff-b1e8-e09d35bd0c67 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:37.342671 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86965a-ccc3-4cff-b1e8-e09d35bd0c67 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:37.347612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6c1fd-345b-44dc-8bac-eba5b2c9f525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:37.348426 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6c1fd-345b-44dc-8bac-eba5b2c9f525 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:37.348779 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6c1fd-345b-44dc-8bac-eba5b2c9f525 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:37.349124 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6c1fd-345b-44dc-8bac-eba5b2c9f525 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:37.349861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6c1fd-345b-44dc-8bac-eba5b2c9f525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:37.351497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6c1fd-345b-44dc-8bac-eba5b2c9f525 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:37.362803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1177/2348] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:37.367015 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c52a6-f11d-49a2-9950-548c07c0c561 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:37.377099 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c52a6-f11d-49a2-9950-548c07c0c561 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:37.381979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9aa56c-b2fe-4738-b365-e5393780cdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:37.382645 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9aa56c-b2fe-4738-b365-e5393780cdec admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:37.382931 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9aa56c-b2fe-4738-b365-e5393780cdec admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:37.383212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9aa56c-b2fe-4738-b365-e5393780cdec admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:37.383938 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9aa56c-b2fe-4738-b365-e5393780cdec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:37.385598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9aa56c-b2fe-4738-b365-e5393780cdec admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:37.395884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1172/2349] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:37.400802 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6c1fd-345b-44dc-8bac-eba5b2c9f525 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:37.415007 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6c1fd-345b-44dc-8bac-eba5b2c9f525 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:37.420314 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7988da-071f-48b7-af52-6f913f3e4970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:37.421244 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7988da-071f-48b7-af52-6f913f3e4970 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:37.421514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7988da-071f-48b7-af52-6f913f3e4970 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:37.421777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7988da-071f-48b7-af52-6f913f3e4970 admin admin] PATH_INFO: `/v3/projects/0a07930c6ca94ccbb08fe32674126ec3/users/2128d122da9f4f26acb11509a62dd518/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:37.437236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7988da-071f-48b7-af52-6f913f3e4970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a07930c6ca94ccbb08fe32674126ec3, user_id=2128d122da9f4f26acb11509a62dd518, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:37.439914 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7988da-071f-48b7-af52-6f913f3e4970 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:37.459743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1178/2350] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:37 2022] PUT /identity/v3/projects/0a07930c6ca94ccbb08fe32674126ec3/users/2128d122da9f4f26acb11509a62dd518/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:37.472755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5bf1a-5962-4dc3-acc2-72cac4829c8c None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:37.473098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5bf1a-5962-4dc3-acc2-72cac4829c8c None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:37.473486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5bf1a-5962-4dc3-acc2-72cac4829c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:37.500988 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-2fd5bf1a-5962-4dc3-acc2-72cac4829c8c None None] MFA Rules not processed for user `2128d122da9f4f26acb11509a62dd518`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:37.502215 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-2fd5bf1a-5962-4dc3-acc2-72cac4829c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:37.573450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1173/2351] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:55:37.587647 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7988da-071f-48b7-af52-6f913f3e4970 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:37.590658 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0c7988da-071f-48b7-af52-6f913f3e4970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:37.655258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7988da-071f-48b7-af52-6f913f3e4970 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:37.659744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56224357-a186-4d22-ab8a-d2a5263e338a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:37.660441 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56224357-a186-4d22-ab8a-d2a5263e338a service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:37.660728 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56224357-a186-4d22-ab8a-d2a5263e338a service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:37.661022 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56224357-a186-4d22-ab8a-d2a5263e338a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:37.670325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56224357-a186-4d22-ab8a-d2a5263e338a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:37.671780 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56224357-a186-4d22-ab8a-d2a5263e338a service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:37.681058 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1179/2352] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:37.701159 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5bf1a-5962-4dc3-acc2-72cac4829c8c None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:37.775012 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5bf1a-5962-4dc3-acc2-72cac4829c8c None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:37.780004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc67c5-1943-48a2-9629-18298ae284dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:37.781007 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc67c5-1943-48a2-9629-18298ae284dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:37.781281 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc67c5-1943-48a2-9629-18298ae284dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:37.781562 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc67c5-1943-48a2-9629-18298ae284dc admin admin] PATH_INFO: `/v3/users/2128d122da9f4f26acb11509a62dd518` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:37.782833 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc67c5-1943-48a2-9629-18298ae284dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2128d122da9f4f26acb11509a62dd518)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:37.785195 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc67c5-1943-48a2-9629-18298ae284dc admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:37.841523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a8dc67c5-1943-48a2-9629-18298ae284dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2128d122da9f4f26acb11509a62dd518'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:37.842187 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a8dc67c5-1943-48a2-9629-18298ae284dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2128d122da9f4f26acb11509a62dd518'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:37.854481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a8dc67c5-1943-48a2-9629-18298ae284dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2128d122da9f4f26acb11509a62dd518'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:37.855338 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a8dc67c5-1943-48a2-9629-18298ae284dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2128d122da9f4f26acb11509a62dd518'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:37.863447 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a8dc67c5-1943-48a2-9629-18298ae284dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2128d122da9f4f26acb11509a62dd518'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:37.876757 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1174/2353] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:37 2022] DELETE /identity/v3/users/2128d122da9f4f26acb11509a62dd518 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:37.881247 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bb29c-3e4e-411e-b81f-f32208c59be3 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:37.881759 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bb29c-3e4e-411e-b81f-f32208c59be3 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:37.881884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bb29c-3e4e-411e-b81f-f32208c59be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:37.899923 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-8a7bb29c-3e4e-411e-b81f-f32208c59be3 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:37.901153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8a7bb29c-3e4e-411e-b81f-f32208c59be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:37.966783 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1180/2354] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:55:37.982317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc67c5-1943-48a2-9629-18298ae284dc admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:37.984738 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a8dc67c5-1943-48a2-9629-18298ae284dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:38.054648 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc67c5-1943-48a2-9629-18298ae284dc admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:38.058840 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed01911-8ff3-4741-8092-120fe1f0d18b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:38.059533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed01911-8ff3-4741-8092-120fe1f0d18b service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:38.059791 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed01911-8ff3-4741-8092-120fe1f0d18b service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:38.060059 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed01911-8ff3-4741-8092-120fe1f0d18b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:38.070101 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed01911-8ff3-4741-8092-120fe1f0d18b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:38.071576 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed01911-8ff3-4741-8092-120fe1f0d18b service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:38.081251 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1175/2355] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:38.432822 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bb29c-3e4e-411e-b81f-f32208c59be3 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:38.434340 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8a7bb29c-3e4e-411e-b81f-f32208c59be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:38.446407 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bb29c-3e4e-411e-b81f-f32208c59be3 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:38.451052 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efacc7-5899-4698-84a3-39ef8caa951b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:38.451908 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efacc7-5899-4698-84a3-39ef8caa951b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:38.452184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efacc7-5899-4698-84a3-39ef8caa951b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:38.452476 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efacc7-5899-4698-84a3-39ef8caa951b admin admin] PATH_INFO: `/v3/projects/0a07930c6ca94ccbb08fe32674126ec3` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:38.453665 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efacc7-5899-4698-84a3-39ef8caa951b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a07930c6ca94ccbb08fe32674126ec3)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:38.455577 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efacc7-5899-4698-84a3-39ef8caa951b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:38.508866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-64efacc7-5899-4698-84a3-39ef8caa951b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a07930c6ca94ccbb08fe32674126ec3', 'request_id': 'req-64efacc7-5899-4698-84a3-39ef8caa951b'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:38.518196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-64efacc7-5899-4698-84a3-39ef8caa951b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a07930c6ca94ccbb08fe32674126ec3', 'request_id': 'req-64efacc7-5899-4698-84a3-39ef8caa951b'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:38.525403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-64efacc7-5899-4698-84a3-39ef8caa951b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a07930c6ca94ccbb08fe32674126ec3', 'request_id': 'req-64efacc7-5899-4698-84a3-39ef8caa951b'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:38.537038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-64efacc7-5899-4698-84a3-39ef8caa951b admin admin] The token cache is being invalidate because project 0a07930c6ca94ccbb08fe32674126ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:38.537318 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-64efacc7-5899-4698-84a3-39ef8caa951b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:38.537994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-64efacc7-5899-4698-84a3-39ef8caa951b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:38.539544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1181/2356] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:38 2022] DELETE /identity/v3/projects/0a07930c6ca94ccbb08fe32674126ec3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:38.544926 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741a3bb-307b-40ea-8ab1-4fb3447b7786 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:38.545447 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741a3bb-307b-40ea-8ab1-4fb3447b7786 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:38.545447 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741a3bb-307b-40ea-8ab1-4fb3447b7786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:38.563921 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-f741a3bb-307b-40ea-8ab1-4fb3447b7786 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:38.565170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f741a3bb-307b-40ea-8ab1-4fb3447b7786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:38.627656 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1176/2357] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:38.640299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918ecc0-8c64-4d39-bbe6-e2c7e76e79f0 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:38.640656 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918ecc0-8c64-4d39-bbe6-e2c7e76e79f0 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:38.641138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918ecc0-8c64-4d39-bbe6-e2c7e76e79f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:38.663586 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-6918ecc0-8c64-4d39-bbe6-e2c7e76e79f0 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:38.664903 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6918ecc0-8c64-4d39-bbe6-e2c7e76e79f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:38.674351 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1182/2358] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:38.679628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741a3bb-307b-40ea-8ab1-4fb3447b7786 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:38.694948 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741a3bb-307b-40ea-8ab1-4fb3447b7786 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:38.702555 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54c11e-302c-454b-88ac-6007aa0d593d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:38.703202 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54c11e-302c-454b-88ac-6007aa0d593d admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:38.703504 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54c11e-302c-454b-88ac-6007aa0d593d admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:38.703767 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54c11e-302c-454b-88ac-6007aa0d593d admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:38.704513 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54c11e-302c-454b-88ac-6007aa0d593d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:55:38.704810 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54c11e-302c-454b-88ac-6007aa0d593d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:38.706419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54c11e-302c-454b-88ac-6007aa0d593d admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:38.719968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1177/2359] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:55:38.726644 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918ecc0-8c64-4d39-bbe6-e2c7e76e79f0 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:38.740946 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918ecc0-8c64-4d39-bbe6-e2c7e76e79f0 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:38.746981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac179aed-1696-49ef-926c-e035fb819797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:38.747649 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac179aed-1696-49ef-926c-e035fb819797 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:38.747924 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac179aed-1696-49ef-926c-e035fb819797 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:38.748186 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac179aed-1696-49ef-926c-e035fb819797 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:38.748905 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac179aed-1696-49ef-926c-e035fb819797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:38.750828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac179aed-1696-49ef-926c-e035fb819797 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:38.782398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1183/2360] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:38 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:38.786545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54c11e-302c-454b-88ac-6007aa0d593d admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:38.796886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54c11e-302c-454b-88ac-6007aa0d593d admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:38.855585 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f14ee-8e2d-4423-8377-aa95e8f455fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:38.856331 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f14ee-8e2d-4423-8377-aa95e8f455fe admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:38.856611 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f14ee-8e2d-4423-8377-aa95e8f455fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:38.856882 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f14ee-8e2d-4423-8377-aa95e8f455fe admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:38.857597 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f14ee-8e2d-4423-8377-aa95e8f455fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:38.859533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f14ee-8e2d-4423-8377-aa95e8f455fe admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:38.884255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1178/2361] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:38 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:38.887499 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac179aed-1696-49ef-926c-e035fb819797 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:38.900323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac179aed-1696-49ef-926c-e035fb819797 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:38.905373 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ec26f-b12f-4b3d-87bc-06944f0c413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:38.906054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ec26f-b12f-4b3d-87bc-06944f0c413a admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:38.906361 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ec26f-b12f-4b3d-87bc-06944f0c413a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:38.906626 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ec26f-b12f-4b3d-87bc-06944f0c413a admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:38.907366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ec26f-b12f-4b3d-87bc-06944f0c413a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:38.909018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ec26f-b12f-4b3d-87bc-06944f0c413a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:38.920297 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1184/2362] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:38.924598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f14ee-8e2d-4423-8377-aa95e8f455fe admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:38.939974 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f14ee-8e2d-4423-8377-aa95e8f455fe admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:38.944957 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07062e1-06b5-484b-bcd8-9c3ef83410c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:38.945692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07062e1-06b5-484b-bcd8-9c3ef83410c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:38.946038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07062e1-06b5-484b-bcd8-9c3ef83410c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:38.946322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07062e1-06b5-484b-bcd8-9c3ef83410c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:38.947066 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07062e1-06b5-484b-bcd8-9c3ef83410c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:38.948726 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07062e1-06b5-484b-bcd8-9c3ef83410c8 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:38.959139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1179/2363] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:38.963473 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ec26f-b12f-4b3d-87bc-06944f0c413a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:38.974910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ec26f-b12f-4b3d-87bc-06944f0c413a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:38.980275 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed090bc1-c495-4b28-9eab-d5579bff6726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:38.981156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed090bc1-c495-4b28-9eab-d5579bff6726 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:38.981428 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed090bc1-c495-4b28-9eab-d5579bff6726 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:38.981694 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed090bc1-c495-4b28-9eab-d5579bff6726 admin admin] PATH_INFO: `/v3/projects/2d4d58229f2e40fa99be53b8c6b47f35/users/c575dbe9324f457bbcdc5e6dc117ace0/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:38.996036 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed090bc1-c495-4b28-9eab-d5579bff6726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d4d58229f2e40fa99be53b8c6b47f35, user_id=c575dbe9324f457bbcdc5e6dc117ace0, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:38.998897 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed090bc1-c495-4b28-9eab-d5579bff6726 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:39.017403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1185/2364] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:38 2022] PUT /identity/v3/projects/2d4d58229f2e40fa99be53b8c6b47f35/users/c575dbe9324f457bbcdc5e6dc117ace0/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:39.029134 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c65f1c-d370-46ac-81fa-1862c0dff4a7 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:39.029485 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c65f1c-d370-46ac-81fa-1862c0dff4a7 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:39.029901 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c65f1c-d370-46ac-81fa-1862c0dff4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:39.057420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-94c65f1c-d370-46ac-81fa-1862c0dff4a7 None None] MFA Rules not processed for user `c575dbe9324f457bbcdc5e6dc117ace0`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:39.058588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-94c65f1c-d370-46ac-81fa-1862c0dff4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:39.136595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1180/2365] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:39.149186 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed090bc1-c495-4b28-9eab-d5579bff6726 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:39.151041 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ed090bc1-c495-4b28-9eab-d5579bff6726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:39.233086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed090bc1-c495-4b28-9eab-d5579bff6726 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:39.237373 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110f31e-b554-4ff7-b2bd-3b6d386fc3a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0303312c6cec4067a4a92d38edb59086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:39.238020 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110f31e-b554-4ff7-b2bd-3b6d386fc3a8 service glance] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:39.238292 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110f31e-b554-4ff7-b2bd-3b6d386fc3a8 service glance] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:39.238561 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110f31e-b554-4ff7-b2bd-3b6d386fc3a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:39.249806 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110f31e-b554-4ff7-b2bd-3b6d386fc3a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:39.251278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110f31e-b554-4ff7-b2bd-3b6d386fc3a8 service glance] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:39.260274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1186/2366] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:49.769930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795af400-194a-4d4f-bee1-a7a4460095a4 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:49.770540 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795af400-194a-4d4f-bee1-a7a4460095a4 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:49.770864 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795af400-194a-4d4f-bee1-a7a4460095a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:49.794167 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-795af400-194a-4d4f-bee1-a7a4460095a4 None None] MFA Rules not processed for user `12d35ac129c24e118df9ebee0c8c9f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:49.795466 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-795af400-194a-4d4f-bee1-a7a4460095a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:49.866950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1181/2367] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:55.964376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d211e-8dbd-48a5-a59a-3122664583e9 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:55.965341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d211e-8dbd-48a5-a59a-3122664583e9 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:55.965341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d211e-8dbd-48a5-a59a-3122664583e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:55.984713 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-e95d211e-8dbd-48a5-a59a-3122664583e9 None None] MFA Rules not processed for user `8c01ed6e76ef4ee4ba5356c526e113e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:55.986263 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e95d211e-8dbd-48a5-a59a-3122664583e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:56.061382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1187/2368] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:55:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:59.072719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795af400-194a-4d4f-bee1-a7a4460095a4 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:59.074185 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-795af400-194a-4d4f-bee1-a7a4460095a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:59.151644 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795af400-194a-4d4f-bee1-a7a4460095a4 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:59.157093 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f26c4f-eb27-4225-ac20-6f068af78178 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:59.158274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f26c4f-eb27-4225-ac20-6f068af78178 service placement] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:59.158274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f26c4f-eb27-4225-ac20-6f068af78178 service placement] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:59.158498 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f26c4f-eb27-4225-ac20-6f068af78178 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:59.160394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-91f26c4f-eb27-4225-ac20-6f068af78178 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:59.175596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f26c4f-eb27-4225-ac20-6f068af78178 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:59.177310 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f26c4f-eb27-4225-ac20-6f068af78178 service placement] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:59.189896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1182/2369] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:05.888235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dce1a4-e0ff-4811-bc68-b9cfe03bbb5e None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:05.888235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dce1a4-e0ff-4811-bc68-b9cfe03bbb5e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:05.888875 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dce1a4-e0ff-4811-bc68-b9cfe03bbb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:05.943313 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-10dce1a4-e0ff-4811-bc68-b9cfe03bbb5e None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:05.944645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-10dce1a4-e0ff-4811-bc68-b9cfe03bbb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:06.014032 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1188/2370] 10.222.0.90 () {58 vars in 967 bytes} [Wed Nov 2 12:56:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:06.030398 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f26c4f-eb27-4225-ac20-6f068af78178 service placement] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:06.031873 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-91f26c4f-eb27-4225-ac20-6f068af78178 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:06.126405 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f26c4f-eb27-4225-ac20-6f068af78178 service placement] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:06.132087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e490bd-94de-403c-b3c6-81e49d671852 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:06.132881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e490bd-94de-403c-b3c6-81e49d671852 service swift] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:06.133167 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e490bd-94de-403c-b3c6-81e49d671852 service swift] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:06.133443 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e490bd-94de-403c-b3c6-81e49d671852 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:06.142831 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e490bd-94de-403c-b3c6-81e49d671852 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:06.144855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e490bd-94de-403c-b3c6-81e49d671852 service swift] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:06.154679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1183/2371] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 12:56:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:56:16.697708 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dce1a4-e0ff-4811-bc68-b9cfe03bbb5e None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:16.699324 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-10dce1a4-e0ff-4811-bc68-b9cfe03bbb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:16.770015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dce1a4-e0ff-4811-bc68-b9cfe03bbb5e None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:16.775138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c469079-ad1d-4847-a6fa-dcc746244448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:16.776120 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c469079-ad1d-4847-a6fa-dcc746244448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:16.776632 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c469079-ad1d-4847-a6fa-dcc746244448 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:16.776844 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c469079-ad1d-4847-a6fa-dcc746244448 admin admin] PATH_INFO: `/v3/users/f77ffa9a7dd44cf9b00c53d1356e0567` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:16.778166 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c469079-ad1d-4847-a6fa-dcc746244448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f77ffa9a7dd44cf9b00c53d1356e0567)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:16.780108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c469079-ad1d-4847-a6fa-dcc746244448 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:16.831330 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8c469079-ad1d-4847-a6fa-dcc746244448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f77ffa9a7dd44cf9b00c53d1356e0567'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:16.831998 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8c469079-ad1d-4847-a6fa-dcc746244448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f77ffa9a7dd44cf9b00c53d1356e0567'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:16.843815 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8c469079-ad1d-4847-a6fa-dcc746244448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f77ffa9a7dd44cf9b00c53d1356e0567'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:16.844480 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8c469079-ad1d-4847-a6fa-dcc746244448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f77ffa9a7dd44cf9b00c53d1356e0567'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:16.854926 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8c469079-ad1d-4847-a6fa-dcc746244448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f77ffa9a7dd44cf9b00c53d1356e0567'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:16.867167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1189/2372] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:16 2022] DELETE /identity/v3/users/f77ffa9a7dd44cf9b00c53d1356e0567 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:17.057643 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e490bd-94de-403c-b3c6-81e49d671852 service swift] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:17.070494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e490bd-94de-403c-b3c6-81e49d671852 service swift] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:17.129449 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f02b8f-b889-4b4d-8c62-31dd17951318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:17.130142 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f02b8f-b889-4b4d-8c62-31dd17951318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:17.130420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f02b8f-b889-4b4d-8c62-31dd17951318 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:17.130688 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f02b8f-b889-4b4d-8c62-31dd17951318 admin admin] PATH_INFO: `/v3/projects/2c22011cb72447d49eaf0e623c2d423c` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:17.132103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f02b8f-b889-4b4d-8c62-31dd17951318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c22011cb72447d49eaf0e623c2d423c)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:17.134053 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f02b8f-b889-4b4d-8c62-31dd17951318 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:17.187474 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e0f02b8f-b889-4b4d-8c62-31dd17951318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c22011cb72447d49eaf0e623c2d423c', 'request_id': 'req-e0f02b8f-b889-4b4d-8c62-31dd17951318'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.196260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e0f02b8f-b889-4b4d-8c62-31dd17951318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c22011cb72447d49eaf0e623c2d423c', 'request_id': 'req-e0f02b8f-b889-4b4d-8c62-31dd17951318'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.201847 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e0f02b8f-b889-4b4d-8c62-31dd17951318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c22011cb72447d49eaf0e623c2d423c', 'request_id': 'req-e0f02b8f-b889-4b4d-8c62-31dd17951318'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.213149 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e0f02b8f-b889-4b4d-8c62-31dd17951318 admin admin] The token cache is being invalidate because project 2c22011cb72447d49eaf0e623c2d423c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:17.213435 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e0f02b8f-b889-4b4d-8c62-31dd17951318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.214123 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e0f02b8f-b889-4b4d-8c62-31dd17951318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.215675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1184/2373] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:17 2022] DELETE /identity/v3/projects/2c22011cb72447d49eaf0e623c2d423c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:17.221716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dba21e-bbbc-4c80-a5d3-39fe9f902387 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:17.221998 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dba21e-bbbc-4c80-a5d3-39fe9f902387 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:17.222268 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dba21e-bbbc-4c80-a5d3-39fe9f902387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:17.243990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-88dba21e-bbbc-4c80-a5d3-39fe9f902387 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:17.246142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-88dba21e-bbbc-4c80-a5d3-39fe9f902387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:17.320455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1190/2374] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:17.329207 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff0374-1836-4b6e-88db-8fddf2b778f0 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:17.329491 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff0374-1836-4b6e-88db-8fddf2b778f0 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:17.329830 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff0374-1836-4b6e-88db-8fddf2b778f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:17.351971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-7bff0374-1836-4b6e-88db-8fddf2b778f0 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:17.353243 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7bff0374-1836-4b6e-88db-8fddf2b778f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:17.361807 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1185/2375] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:17.366385 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dba21e-bbbc-4c80-a5d3-39fe9f902387 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:17.381173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dba21e-bbbc-4c80-a5d3-39fe9f902387 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:17.386764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b5d14-b648-4299-92e5-270733e131f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:17.387398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b5d14-b648-4299-92e5-270733e131f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:17.387681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b5d14-b648-4299-92e5-270733e131f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:17.387958 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b5d14-b648-4299-92e5-270733e131f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:17.388726 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b5d14-b648-4299-92e5-270733e131f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:56:17.389025 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b5d14-b648-4299-92e5-270733e131f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:17.390622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b5d14-b648-4299-92e5-270733e131f1 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:17.403814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1191/2376] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:56:17.410126 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff0374-1836-4b6e-88db-8fddf2b778f0 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:17.420154 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff0374-1836-4b6e-88db-8fddf2b778f0 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:17.425580 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506aa95-5147-446f-8f6f-dc4cad5cfce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:17.426263 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506aa95-5147-446f-8f6f-dc4cad5cfce9 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:17.426631 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506aa95-5147-446f-8f6f-dc4cad5cfce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:17.426744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506aa95-5147-446f-8f6f-dc4cad5cfce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:17.427453 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506aa95-5147-446f-8f6f-dc4cad5cfce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:17.429487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506aa95-5147-446f-8f6f-dc4cad5cfce9 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:17.460357 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1186/2377] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:17 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:17.464717 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b5d14-b648-4299-92e5-270733e131f1 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:17.478242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b5d14-b648-4299-92e5-270733e131f1 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:17.535602 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c27416-6b44-4a49-b13b-3d3cd7049004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:17.536299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c27416-6b44-4a49-b13b-3d3cd7049004 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:17.536605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c27416-6b44-4a49-b13b-3d3cd7049004 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:17.536875 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c27416-6b44-4a49-b13b-3d3cd7049004 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:17.537751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c27416-6b44-4a49-b13b-3d3cd7049004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:17.539673 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c27416-6b44-4a49-b13b-3d3cd7049004 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:17.564610 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1192/2378] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:17 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:17.569150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506aa95-5147-446f-8f6f-dc4cad5cfce9 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:17.579368 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506aa95-5147-446f-8f6f-dc4cad5cfce9 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:17.583814 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b34e6-2129-4afa-a168-5247a7a3f242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:17.586259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b34e6-2129-4afa-a168-5247a7a3f242 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:17.586547 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b34e6-2129-4afa-a168-5247a7a3f242 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:17.586822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b34e6-2129-4afa-a168-5247a7a3f242 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:17.587980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b34e6-2129-4afa-a168-5247a7a3f242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:17.591088 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b34e6-2129-4afa-a168-5247a7a3f242 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:17.602079 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1187/2379] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:17.606414 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c27416-6b44-4a49-b13b-3d3cd7049004 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:17.617337 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c27416-6b44-4a49-b13b-3d3cd7049004 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:17.622757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17b441-343e-496b-bec8-bca62835adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:17.623432 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17b441-343e-496b-bec8-bca62835adab admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:17.623724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17b441-343e-496b-bec8-bca62835adab admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:17.624002 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17b441-343e-496b-bec8-bca62835adab admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:17.624773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17b441-343e-496b-bec8-bca62835adab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:17.626398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17b441-343e-496b-bec8-bca62835adab admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:17.637315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1193/2380] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:17.641651 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b34e6-2129-4afa-a168-5247a7a3f242 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:17.652262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b34e6-2129-4afa-a168-5247a7a3f242 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:17.657151 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cad19-ab6a-47b5-b6d8-e56aacbb43ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:17.658015 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cad19-ab6a-47b5-b6d8-e56aacbb43ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:17.658780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cad19-ab6a-47b5-b6d8-e56aacbb43ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:17.658780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cad19-ab6a-47b5-b6d8-e56aacbb43ed admin admin] PATH_INFO: `/v3/projects/dfcc0d46f03c4673b32caedfcf1fdc3d/users/9aed045fb48c4b589f675daa0eb59154/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:17.673527 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cad19-ab6a-47b5-b6d8-e56aacbb43ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfcc0d46f03c4673b32caedfcf1fdc3d, user_id=9aed045fb48c4b589f675daa0eb59154, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:17.676245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cad19-ab6a-47b5-b6d8-e56aacbb43ed admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:17.691232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1188/2381] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:17 2022] PUT /identity/v3/projects/dfcc0d46f03c4673b32caedfcf1fdc3d/users/9aed045fb48c4b589f675daa0eb59154/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:17.701920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447a8db-ce9f-4733-8155-8aacabcb7dfc None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:17.702700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447a8db-ce9f-4733-8155-8aacabcb7dfc None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:17.703030 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447a8db-ce9f-4733-8155-8aacabcb7dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:17.732265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-1447a8db-ce9f-4733-8155-8aacabcb7dfc None None] MFA Rules not processed for user `9aed045fb48c4b589f675daa0eb59154`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:17.733520 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1447a8db-ce9f-4733-8155-8aacabcb7dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:17.804127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1194/2382] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:56:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:17.815992 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cad19-ab6a-47b5-b6d8-e56aacbb43ed admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:17.818369 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-782cad19-ab6a-47b5-b6d8-e56aacbb43ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:17.877836 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cad19-ab6a-47b5-b6d8-e56aacbb43ed admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:17.882478 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a595d60-932a-4431-add1-2f97f0dad502 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:17.883138 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595d60-932a-4431-add1-2f97f0dad502 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:17.883411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595d60-932a-4431-add1-2f97f0dad502 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:17.883681 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595d60-932a-4431-add1-2f97f0dad502 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:17.894289 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a595d60-932a-4431-add1-2f97f0dad502 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:17.895663 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a595d60-932a-4431-add1-2f97f0dad502 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:17.905482 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1189/2383] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:32.131944 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447a8db-ce9f-4733-8155-8aacabcb7dfc None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:32.197089 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447a8db-ce9f-4733-8155-8aacabcb7dfc None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:32.201954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf01347-7cef-472d-a7cc-75ea74590af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:32.202878 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf01347-7cef-472d-a7cc-75ea74590af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:32.203148 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf01347-7cef-472d-a7cc-75ea74590af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:32.203405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf01347-7cef-472d-a7cc-75ea74590af8 admin admin] PATH_INFO: `/v3/users/9aed045fb48c4b589f675daa0eb59154` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:32.204611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf01347-7cef-472d-a7cc-75ea74590af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aed045fb48c4b589f675daa0eb59154)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:32.206548 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf01347-7cef-472d-a7cc-75ea74590af8 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:32.259418 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ccf01347-7cef-472d-a7cc-75ea74590af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aed045fb48c4b589f675daa0eb59154'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:32.260178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ccf01347-7cef-472d-a7cc-75ea74590af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aed045fb48c4b589f675daa0eb59154'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:32.273970 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ccf01347-7cef-472d-a7cc-75ea74590af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aed045fb48c4b589f675daa0eb59154'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:32.274887 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ccf01347-7cef-472d-a7cc-75ea74590af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aed045fb48c4b589f675daa0eb59154'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:32.283281 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ccf01347-7cef-472d-a7cc-75ea74590af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aed045fb48c4b589f675daa0eb59154'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:32.297380 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1195/2384] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:32 2022] DELETE /identity/v3/users/9aed045fb48c4b589f675daa0eb59154 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:32.301961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf31692-dceb-490e-b399-585c57037c0e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:32.302493 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf31692-dceb-490e-b399-585c57037c0e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:32.303090 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf31692-dceb-490e-b399-585c57037c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:32.325128 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-2cf31692-dceb-490e-b399-585c57037c0e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:32.326723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-2cf31692-dceb-490e-b399-585c57037c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:32.389658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1190/2385] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:56:32.400192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf01347-7cef-472d-a7cc-75ea74590af8 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:32.401622 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ccf01347-7cef-472d-a7cc-75ea74590af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:32.457749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf01347-7cef-472d-a7cc-75ea74590af8 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:32.461742 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015186c1-16bb-448c-a341-67ba14bd1954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:32.462457 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015186c1-16bb-448c-a341-67ba14bd1954 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:32.462838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015186c1-16bb-448c-a341-67ba14bd1954 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:32.463109 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015186c1-16bb-448c-a341-67ba14bd1954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:32.473584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015186c1-16bb-448c-a341-67ba14bd1954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:32.475053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015186c1-16bb-448c-a341-67ba14bd1954 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:32.485315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1196/2386] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:32.779455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf31692-dceb-490e-b399-585c57037c0e None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:32.780894 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-2cf31692-dceb-490e-b399-585c57037c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:32.798503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf31692-dceb-490e-b399-585c57037c0e None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:32.803560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d932d-f0f1-4ad5-bbae-9f8f94836211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:32.804514 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d932d-f0f1-4ad5-bbae-9f8f94836211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:32.804788 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d932d-f0f1-4ad5-bbae-9f8f94836211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:32.805076 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d932d-f0f1-4ad5-bbae-9f8f94836211 admin admin] PATH_INFO: `/v3/projects/dfcc0d46f03c4673b32caedfcf1fdc3d` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:32.806445 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d932d-f0f1-4ad5-bbae-9f8f94836211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfcc0d46f03c4673b32caedfcf1fdc3d)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:32.808424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d932d-f0f1-4ad5-bbae-9f8f94836211 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:32.864139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a22d932d-f0f1-4ad5-bbae-9f8f94836211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfcc0d46f03c4673b32caedfcf1fdc3d', 'request_id': 'req-a22d932d-f0f1-4ad5-bbae-9f8f94836211'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:32.872956 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a22d932d-f0f1-4ad5-bbae-9f8f94836211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfcc0d46f03c4673b32caedfcf1fdc3d', 'request_id': 'req-a22d932d-f0f1-4ad5-bbae-9f8f94836211'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:32.878196 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a22d932d-f0f1-4ad5-bbae-9f8f94836211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfcc0d46f03c4673b32caedfcf1fdc3d', 'request_id': 'req-a22d932d-f0f1-4ad5-bbae-9f8f94836211'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:32.888988 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a22d932d-f0f1-4ad5-bbae-9f8f94836211 admin admin] The token cache is being invalidate because project dfcc0d46f03c4673b32caedfcf1fdc3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:32.889276 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a22d932d-f0f1-4ad5-bbae-9f8f94836211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:32.889873 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a22d932d-f0f1-4ad5-bbae-9f8f94836211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:32.891394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1191/2387] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:32 2022] DELETE /identity/v3/projects/dfcc0d46f03c4673b32caedfcf1fdc3d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:32.896935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635db3c-b75a-489a-abb7-1c841d79ef19 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:32.897244 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635db3c-b75a-489a-abb7-1c841d79ef19 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:32.897514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635db3c-b75a-489a-abb7-1c841d79ef19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:32.916958 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-9635db3c-b75a-489a-abb7-1c841d79ef19 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:32.918234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-9635db3c-b75a-489a-abb7-1c841d79ef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:32.982896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1197/2388] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:32.992112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976a482-ada0-4d71-9e09-58870da4ac29 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:32.992447 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976a482-ada0-4d71-9e09-58870da4ac29 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:32.992726 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976a482-ada0-4d71-9e09-58870da4ac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:33.013411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-7976a482-ada0-4d71-9e09-58870da4ac29 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:33.014851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7976a482-ada0-4d71-9e09-58870da4ac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:33.026348 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1192/2389] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:33.030793 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635db3c-b75a-489a-abb7-1c841d79ef19 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:33.041644 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635db3c-b75a-489a-abb7-1c841d79ef19 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:33.046950 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7e532-45f3-4473-a7ed-adc2db26e17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:33.047781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7e532-45f3-4473-a7ed-adc2db26e17f admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:33.048057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7e532-45f3-4473-a7ed-adc2db26e17f admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:33.048422 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7e532-45f3-4473-a7ed-adc2db26e17f admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:33.049200 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7e532-45f3-4473-a7ed-adc2db26e17f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:56:33.049504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7e532-45f3-4473-a7ed-adc2db26e17f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:33.051293 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7e532-45f3-4473-a7ed-adc2db26e17f admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:33.066180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1198/2390] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:56:33.070736 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976a482-ada0-4d71-9e09-58870da4ac29 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:33.080921 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976a482-ada0-4d71-9e09-58870da4ac29 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:33.085797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e01d89-54b5-439f-9e5d-d7957ee79b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:33.086475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e01d89-54b5-439f-9e5d-d7957ee79b41 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:33.086754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e01d89-54b5-439f-9e5d-d7957ee79b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:33.087028 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e01d89-54b5-439f-9e5d-d7957ee79b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:33.087771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e01d89-54b5-439f-9e5d-d7957ee79b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:33.089741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e01d89-54b5-439f-9e5d-d7957ee79b41 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:33.123130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1193/2391] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:33 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:56:33.128708 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7e532-45f3-4473-a7ed-adc2db26e17f admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:33.139687 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7e532-45f3-4473-a7ed-adc2db26e17f admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:33.217964 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b148d4-a5f2-4ca8-9665-26ab1e2bc677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:33.219040 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b148d4-a5f2-4ca8-9665-26ab1e2bc677 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:33.219666 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b148d4-a5f2-4ca8-9665-26ab1e2bc677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:33.220267 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b148d4-a5f2-4ca8-9665-26ab1e2bc677 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:33.221216 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b148d4-a5f2-4ca8-9665-26ab1e2bc677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:33.223910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b148d4-a5f2-4ca8-9665-26ab1e2bc677 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:33.247588 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1199/2392] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:33 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:56:33.252295 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e01d89-54b5-439f-9e5d-d7957ee79b41 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:33.269756 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e01d89-54b5-439f-9e5d-d7957ee79b41 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:33.273351 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67562378-f158-4378-9d5f-1c1bb24035a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:33.274186 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67562378-f158-4378-9d5f-1c1bb24035a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:33.274558 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67562378-f158-4378-9d5f-1c1bb24035a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:33.274934 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67562378-f158-4378-9d5f-1c1bb24035a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:33.275819 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67562378-f158-4378-9d5f-1c1bb24035a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:33.277678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67562378-f158-4378-9d5f-1c1bb24035a8 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:33.292256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1194/2393] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:33.294280 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b148d4-a5f2-4ca8-9665-26ab1e2bc677 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:33.304163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b148d4-a5f2-4ca8-9665-26ab1e2bc677 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:33.308846 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22ebee-a971-46da-ba6a-eb85d4e80c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:33.309541 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22ebee-a971-46da-ba6a-eb85d4e80c59 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:33.309821 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22ebee-a971-46da-ba6a-eb85d4e80c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:33.310095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22ebee-a971-46da-ba6a-eb85d4e80c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:33.310825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22ebee-a971-46da-ba6a-eb85d4e80c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:33.312485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22ebee-a971-46da-ba6a-eb85d4e80c59 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:33.324890 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1200/2394] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:33.329280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67562378-f158-4378-9d5f-1c1bb24035a8 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:33.341912 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67562378-f158-4378-9d5f-1c1bb24035a8 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:33.346682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983ed8e-16cb-4dcd-8995-62cdfab982e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:33.347593 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983ed8e-16cb-4dcd-8995-62cdfab982e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:33.347873 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983ed8e-16cb-4dcd-8995-62cdfab982e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:33.348145 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983ed8e-16cb-4dcd-8995-62cdfab982e9 admin admin] PATH_INFO: `/v3/projects/2761deba8c294fb189aced5e7cb5357a/users/b50b18ca68e5453780af8fa5e4030492/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:33.363598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983ed8e-16cb-4dcd-8995-62cdfab982e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2761deba8c294fb189aced5e7cb5357a, user_id=b50b18ca68e5453780af8fa5e4030492, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:33.366306 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983ed8e-16cb-4dcd-8995-62cdfab982e9 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:33.382046 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1195/2395] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:33 2022] PUT /identity/v3/projects/2761deba8c294fb189aced5e7cb5357a/users/b50b18ca68e5453780af8fa5e4030492/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:33.393321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7003a-2cae-45f5-99ca-a83bcfd4092b None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:33.393619 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7003a-2cae-45f5-99ca-a83bcfd4092b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:33.393896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7003a-2cae-45f5-99ca-a83bcfd4092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:33.420812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-16f7003a-2cae-45f5-99ca-a83bcfd4092b None None] MFA Rules not processed for user `b50b18ca68e5453780af8fa5e4030492`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:33.422083 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-16f7003a-2cae-45f5-99ca-a83bcfd4092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:33.490393 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1201/2396] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:56:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:33.502249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983ed8e-16cb-4dcd-8995-62cdfab982e9 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:33.507232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5983ed8e-16cb-4dcd-8995-62cdfab982e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:33.571219 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983ed8e-16cb-4dcd-8995-62cdfab982e9 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:33.575533 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247d870-a73e-4b40-8d8c-e295b6a9e352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:33.576161 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247d870-a73e-4b40-8d8c-e295b6a9e352 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:33.576453 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247d870-a73e-4b40-8d8c-e295b6a9e352 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:33.576746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247d870-a73e-4b40-8d8c-e295b6a9e352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:33.586168 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247d870-a73e-4b40-8d8c-e295b6a9e352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:33.587841 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247d870-a73e-4b40-8d8c-e295b6a9e352 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:33.597193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1196/2397] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:50.564808 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7003a-2cae-45f5-99ca-a83bcfd4092b None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:50.566443 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-16f7003a-2cae-45f5-99ca-a83bcfd4092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:50.624061 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7003a-2cae-45f5-99ca-a83bcfd4092b None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:50.628132 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd0075-a22c-4292-b813-208cd9b020d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:50.629032 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd0075-a22c-4292-b813-208cd9b020d2 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:50.629306 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd0075-a22c-4292-b813-208cd9b020d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:50.629570 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd0075-a22c-4292-b813-208cd9b020d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:50.631606 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-75fd0075-a22c-4292-b813-208cd9b020d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:50.694744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd0075-a22c-4292-b813-208cd9b020d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:50.696269 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd0075-a22c-4292-b813-208cd9b020d2 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:50.706172 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1202/2398] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:53.636552 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247d870-a73e-4b40-8d8c-e295b6a9e352 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:53.723108 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247d870-a73e-4b40-8d8c-e295b6a9e352 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:53.727719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ce39b-741a-4cf2-8a59-a35f33460465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:53.728716 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ce39b-741a-4cf2-8a59-a35f33460465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:53.729088 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ce39b-741a-4cf2-8a59-a35f33460465 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:53.729416 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ce39b-741a-4cf2-8a59-a35f33460465 admin admin] PATH_INFO: `/v3/users/b50b18ca68e5453780af8fa5e4030492` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:53.730777 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ce39b-741a-4cf2-8a59-a35f33460465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b50b18ca68e5453780af8fa5e4030492)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:53.732823 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ce39b-741a-4cf2-8a59-a35f33460465 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:53.786653 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-423ce39b-741a-4cf2-8a59-a35f33460465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b50b18ca68e5453780af8fa5e4030492'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:53.787209 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-423ce39b-741a-4cf2-8a59-a35f33460465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b50b18ca68e5453780af8fa5e4030492'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:53.799960 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-423ce39b-741a-4cf2-8a59-a35f33460465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b50b18ca68e5453780af8fa5e4030492'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:53.800888 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-423ce39b-741a-4cf2-8a59-a35f33460465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b50b18ca68e5453780af8fa5e4030492'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:53.809410 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-423ce39b-741a-4cf2-8a59-a35f33460465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b50b18ca68e5453780af8fa5e4030492'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:53.822655 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1197/2399] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:53 2022] DELETE /identity/v3/users/b50b18ca68e5453780af8fa5e4030492 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:53.827019 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa31c61-ca16-41fe-8178-9e95101eda78 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:53.827518 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa31c61-ca16-41fe-8178-9e95101eda78 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:53.827598 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa31c61-ca16-41fe-8178-9e95101eda78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:53.845196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-1aa31c61-ca16-41fe-8178-9e95101eda78 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:53.846396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1aa31c61-ca16-41fe-8178-9e95101eda78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:53.908891 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1203/2400] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:53.919301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ce39b-741a-4cf2-8a59-a35f33460465 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:53.921015 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-423ce39b-741a-4cf2-8a59-a35f33460465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:53.979598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ce39b-741a-4cf2-8a59-a35f33460465 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:53.983984 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65212a-7a44-415c-82aa-11dc5c13da26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:53.984666 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65212a-7a44-415c-82aa-11dc5c13da26 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:53.984941 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65212a-7a44-415c-82aa-11dc5c13da26 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:53.985216 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65212a-7a44-415c-82aa-11dc5c13da26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:53.994535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65212a-7a44-415c-82aa-11dc5c13da26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:53.995972 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65212a-7a44-415c-82aa-11dc5c13da26 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:54.005563 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1198/2401] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:54.270304 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa31c61-ca16-41fe-8178-9e95101eda78 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:54.271755 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1aa31c61-ca16-41fe-8178-9e95101eda78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:54.286510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa31c61-ca16-41fe-8178-9e95101eda78 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:54.291741 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70982f-a9a0-4c20-bd36-5c0917359eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:54.292673 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70982f-a9a0-4c20-bd36-5c0917359eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:54.292934 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70982f-a9a0-4c20-bd36-5c0917359eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:54.293198 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70982f-a9a0-4c20-bd36-5c0917359eb8 admin admin] PATH_INFO: `/v3/projects/2761deba8c294fb189aced5e7cb5357a` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:54.294422 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70982f-a9a0-4c20-bd36-5c0917359eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2761deba8c294fb189aced5e7cb5357a)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:54.296390 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70982f-a9a0-4c20-bd36-5c0917359eb8 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:54.346973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ad70982f-a9a0-4c20-bd36-5c0917359eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2761deba8c294fb189aced5e7cb5357a', 'request_id': 'req-ad70982f-a9a0-4c20-bd36-5c0917359eb8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:54.356189 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ad70982f-a9a0-4c20-bd36-5c0917359eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2761deba8c294fb189aced5e7cb5357a', 'request_id': 'req-ad70982f-a9a0-4c20-bd36-5c0917359eb8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:54.363372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ad70982f-a9a0-4c20-bd36-5c0917359eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2761deba8c294fb189aced5e7cb5357a', 'request_id': 'req-ad70982f-a9a0-4c20-bd36-5c0917359eb8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:54.374082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ad70982f-a9a0-4c20-bd36-5c0917359eb8 admin admin] The token cache is being invalidate because project 2761deba8c294fb189aced5e7cb5357a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:54.374374 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ad70982f-a9a0-4c20-bd36-5c0917359eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:54.375150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ad70982f-a9a0-4c20-bd36-5c0917359eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:54.376866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1204/2402] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:54 2022] DELETE /identity/v3/projects/2761deba8c294fb189aced5e7cb5357a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:11.925322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd6f86-a049-4249-9527-305fc36a6134 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:11.926160 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd6f86-a049-4249-9527-305fc36a6134 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:11.926160 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd6f86-a049-4249-9527-305fc36a6134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:11.944003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-57fd6f86-a049-4249-9527-305fc36a6134 None None] MFA Rules not processed for user `a05c9a5fa170471aa8d73e243ffc30b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:11.945245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-57fd6f86-a049-4249-9527-305fc36a6134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:12.000968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1199/2403] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:57:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:25.078503 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70982f-a9a0-4c20-bd36-5c0917359eb8 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:25.080117 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ad70982f-a9a0-4c20-bd36-5c0917359eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:25.114518 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd6f86-a049-4249-9527-305fc36a6134 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:25.116130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-57fd6f86-a049-4249-9527-305fc36a6134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:25.148633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70982f-a9a0-4c20-bd36-5c0917359eb8 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:25.153712 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dbf98-44a5-4345-baa8-a6c698a13f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:25.154703 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dbf98-44a5-4345-baa8-a6c698a13f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:25.155078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dbf98-44a5-4345-baa8-a6c698a13f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:25.155447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dbf98-44a5-4345-baa8-a6c698a13f47 admin admin] PATH_INFO: `/v3/users/a7251524be714e9fa4757bd2cf05bc8c` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:25.156777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dbf98-44a5-4345-baa8-a6c698a13f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7251524be714e9fa4757bd2cf05bc8c)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:25.158935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dbf98-44a5-4345-baa8-a6c698a13f47 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:25.181001 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd6f86-a049-4249-9527-305fc36a6134 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:25.186296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd30cf-1f2a-48c1-96e6-3f184750d88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:25.187254 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd30cf-1f2a-48c1-96e6-3f184750d88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:25.187530 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd30cf-1f2a-48c1-96e6-3f184750d88e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:25.187843 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd30cf-1f2a-48c1-96e6-3f184750d88e admin admin] PATH_INFO: `/v3/users/c575dbe9324f457bbcdc5e6dc117ace0` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:25.189155 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd30cf-1f2a-48c1-96e6-3f184750d88e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c575dbe9324f457bbcdc5e6dc117ace0)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:25.191202 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd30cf-1f2a-48c1-96e6-3f184750d88e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:25.207752 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ff0dbf98-44a5-4345-baa8-a6c698a13f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7251524be714e9fa4757bd2cf05bc8c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:25.208435 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ff0dbf98-44a5-4345-baa8-a6c698a13f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7251524be714e9fa4757bd2cf05bc8c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:25.220406 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ff0dbf98-44a5-4345-baa8-a6c698a13f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7251524be714e9fa4757bd2cf05bc8c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:25.221511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ff0dbf98-44a5-4345-baa8-a6c698a13f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7251524be714e9fa4757bd2cf05bc8c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:25.228659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-ff0dbf98-44a5-4345-baa8-a6c698a13f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7251524be714e9fa4757bd2cf05bc8c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:25.238286 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6fbd30cf-1f2a-48c1-96e6-3f184750d88e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c575dbe9324f457bbcdc5e6dc117ace0'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:25.239095 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6fbd30cf-1f2a-48c1-96e6-3f184750d88e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c575dbe9324f457bbcdc5e6dc117ace0'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:25.240785 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1205/2404] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:57:25 2022] DELETE /identity/v3/users/a7251524be714e9fa4757bd2cf05bc8c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:25.245382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4532d-11e4-4c56-8cc2-4452dfb0615a None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:25.245664 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4532d-11e4-4c56-8cc2-4452dfb0615a None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:25.245935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4532d-11e4-4c56-8cc2-4452dfb0615a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:25.252184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6fbd30cf-1f2a-48c1-96e6-3f184750d88e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c575dbe9324f457bbcdc5e6dc117ace0'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:25.253576 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6fbd30cf-1f2a-48c1-96e6-3f184750d88e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c575dbe9324f457bbcdc5e6dc117ace0'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:25.263652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-6fbd30cf-1f2a-48c1-96e6-3f184750d88e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c575dbe9324f457bbcdc5e6dc117ace0'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:25.264188 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-b7b4532d-11e4-4c56-8cc2-4452dfb0615a None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:25.265471 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b7b4532d-11e4-4c56-8cc2-4452dfb0615a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:25.278523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1200/2405] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:57:25 2022] DELETE /identity/v3/users/c575dbe9324f457bbcdc5e6dc117ace0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:57:25.283908 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82da25-546b-445f-9965-52719f59f2cf None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:25.284550 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82da25-546b-445f-9965-52719f59f2cf None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:25.285029 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82da25-546b-445f-9965-52719f59f2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:25.304153 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-5b82da25-546b-445f-9965-52719f59f2cf None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:25.305695 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5b82da25-546b-445f-9965-52719f59f2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:25.327068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1206/2406] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:57:25.337181 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4532d-11e4-4c56-8cc2-4452dfb0615a None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:25.338619 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b7b4532d-11e4-4c56-8cc2-4452dfb0615a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:25.370801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1201/2407] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:25.383671 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82da25-546b-445f-9965-52719f59f2cf None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:25.385161 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5b82da25-546b-445f-9965-52719f59f2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:25.399390 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4532d-11e4-4c56-8cc2-4452dfb0615a None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:25.444138 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82da25-546b-445f-9965-52719f59f2cf None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:25.448083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b1872-1ca1-47e7-9ecf-8b86c6d0eb12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:25.448851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b1872-1ca1-47e7-9ecf-8b86c6d0eb12 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:25.449166 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b461e8-d849-4c61-84bd-20f7a62362db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:25.449282 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b1872-1ca1-47e7-9ecf-8b86c6d0eb12 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:25.449591 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b1872-1ca1-47e7-9ecf-8b86c6d0eb12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:25.449813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b461e8-d849-4c61-84bd-20f7a62362db service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:25.450084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b461e8-d849-4c61-84bd-20f7a62362db service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:25.450371 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b461e8-d849-4c61-84bd-20f7a62362db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:25.459196 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b1872-1ca1-47e7-9ecf-8b86c6d0eb12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:25.459542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b461e8-d849-4c61-84bd-20f7a62362db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:25.461041 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b461e8-d849-4c61-84bd-20f7a62362db service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:25.461374 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b1872-1ca1-47e7-9ecf-8b86c6d0eb12 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:25.471845 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1207/2408] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:57:25.473933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1202/2409] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:25.909747 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b461e8-d849-4c61-84bd-20f7a62362db service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:25.911702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-45b461e8-d849-4c61-84bd-20f7a62362db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:25.916464 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b1872-1ca1-47e7-9ecf-8b86c6d0eb12 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:25.918456 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0b5b1872-1ca1-47e7-9ecf-8b86c6d0eb12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:25.926473 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b461e8-d849-4c61-84bd-20f7a62362db service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:25.939734 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69debc4-60fa-44ad-a087-b6184d7e6e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:25.939962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b1872-1ca1-47e7-9ecf-8b86c6d0eb12 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:25.940793 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69debc4-60fa-44ad-a087-b6184d7e6e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:25.941163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69debc4-60fa-44ad-a087-b6184d7e6e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:25.941505 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69debc4-60fa-44ad-a087-b6184d7e6e58 admin admin] PATH_INFO: `/v3/projects/dd991a5e73f8448ebeed792cac973318` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:25.942828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69debc4-60fa-44ad-a087-b6184d7e6e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd991a5e73f8448ebeed792cac973318)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:25.945173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69debc4-60fa-44ad-a087-b6184d7e6e58 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:25.951144 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24d7c5-d64a-48d8-8e75-6ecfbfb3cafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:25.952474 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24d7c5-d64a-48d8-8e75-6ecfbfb3cafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:25.952789 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24d7c5-d64a-48d8-8e75-6ecfbfb3cafd admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:25.953145 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24d7c5-d64a-48d8-8e75-6ecfbfb3cafd admin admin] PATH_INFO: `/v3/projects/2d4d58229f2e40fa99be53b8c6b47f35` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:25.954749 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24d7c5-d64a-48d8-8e75-6ecfbfb3cafd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d4d58229f2e40fa99be53b8c6b47f35)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:25.956701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24d7c5-d64a-48d8-8e75-6ecfbfb3cafd admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:26.001932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-d69debc4-60fa-44ad-a087-b6184d7e6e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd991a5e73f8448ebeed792cac973318', 'request_id': 'req-d69debc4-60fa-44ad-a087-b6184d7e6e58'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:26.011544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-d69debc4-60fa-44ad-a087-b6184d7e6e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd991a5e73f8448ebeed792cac973318', 'request_id': 'req-d69debc4-60fa-44ad-a087-b6184d7e6e58'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:26.020837 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-d69debc4-60fa-44ad-a087-b6184d7e6e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd991a5e73f8448ebeed792cac973318', 'request_id': 'req-d69debc4-60fa-44ad-a087-b6184d7e6e58'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:26.024042 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8c24d7c5-d64a-48d8-8e75-6ecfbfb3cafd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d4d58229f2e40fa99be53b8c6b47f35', 'request_id': 'req-8c24d7c5-d64a-48d8-8e75-6ecfbfb3cafd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:26.035712 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8c24d7c5-d64a-48d8-8e75-6ecfbfb3cafd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d4d58229f2e40fa99be53b8c6b47f35', 'request_id': 'req-8c24d7c5-d64a-48d8-8e75-6ecfbfb3cafd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:26.036564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-d69debc4-60fa-44ad-a087-b6184d7e6e58 admin admin] The token cache is being invalidate because project dd991a5e73f8448ebeed792cac973318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:57:26.036914 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-d69debc4-60fa-44ad-a087-b6184d7e6e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:26.037754 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-d69debc4-60fa-44ad-a087-b6184d7e6e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:26.039585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1208/2410] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:57:25 2022] DELETE /identity/v3/projects/dd991a5e73f8448ebeed792cac973318 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:26.042711 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8c24d7c5-d64a-48d8-8e75-6ecfbfb3cafd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d4d58229f2e40fa99be53b8c6b47f35', 'request_id': 'req-8c24d7c5-d64a-48d8-8e75-6ecfbfb3cafd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:26.044576 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73864a6e-d0a0-4345-be55-3b9956654dee None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:26.044865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73864a6e-d0a0-4345-be55-3b9956654dee None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:26.045142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73864a6e-d0a0-4345-be55-3b9956654dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:26.056718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8c24d7c5-d64a-48d8-8e75-6ecfbfb3cafd admin admin] The token cache is being invalidate because project 2d4d58229f2e40fa99be53b8c6b47f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:57:26.057204 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8c24d7c5-d64a-48d8-8e75-6ecfbfb3cafd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:26.057851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8c24d7c5-d64a-48d8-8e75-6ecfbfb3cafd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:26.080255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1203/2411] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:57:25 2022] DELETE /identity/v3/projects/2d4d58229f2e40fa99be53b8c6b47f35 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:26.080640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-73864a6e-d0a0-4345-be55-3b9956654dee None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:26.080640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-73864a6e-d0a0-4345-be55-3b9956654dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:26.143478 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1209/2412] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:57:26.151749 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ae357-080f-4986-890e-467c1325e450 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:26.153005 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ae357-080f-4986-890e-467c1325e450 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:26.153439 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ae357-080f-4986-890e-467c1325e450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:26.183249 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-6d3ae357-080f-4986-890e-467c1325e450 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:26.184581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-6d3ae357-080f-4986-890e-467c1325e450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:26.193184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1204/2413] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:26.197680 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73864a6e-d0a0-4345-be55-3b9956654dee None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:26.211149 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73864a6e-d0a0-4345-be55-3b9956654dee None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:26.216744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9c477-63dd-47cf-913e-78006bfbbcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:26.217586 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9c477-63dd-47cf-913e-78006bfbbcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:26.217866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9c477-63dd-47cf-913e-78006bfbbcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:26.218133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9c477-63dd-47cf-913e-78006bfbbcf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:26.219381 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9c477-63dd-47cf-913e-78006bfbbcf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:57:26.219381 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9c477-63dd-47cf-913e-78006bfbbcf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:26.220919 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9c477-63dd-47cf-913e-78006bfbbcf4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:26.233673 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1210/2414] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:57:26.238397 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ae357-080f-4986-890e-467c1325e450 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:26.247899 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ae357-080f-4986-890e-467c1325e450 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:26.253801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c2f97-71e4-42f3-9561-f6ee66e882cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:26.254526 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c2f97-71e4-42f3-9561-f6ee66e882cc admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:26.254807 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c2f97-71e4-42f3-9561-f6ee66e882cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:26.255102 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c2f97-71e4-42f3-9561-f6ee66e882cc admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:26.255834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c2f97-71e4-42f3-9561-f6ee66e882cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:26.257863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c2f97-71e4-42f3-9561-f6ee66e882cc admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:26.287738 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1205/2415] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:57:26 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:26.292040 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9c477-63dd-47cf-913e-78006bfbbcf4 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:26.303817 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9c477-63dd-47cf-913e-78006bfbbcf4 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:26.358890 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad3c27-b2d5-445e-b206-e26d35f6bb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:26.359620 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad3c27-b2d5-445e-b206-e26d35f6bb51 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:26.359868 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad3c27-b2d5-445e-b206-e26d35f6bb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:26.360135 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad3c27-b2d5-445e-b206-e26d35f6bb51 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:26.361396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad3c27-b2d5-445e-b206-e26d35f6bb51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:26.362775 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad3c27-b2d5-445e-b206-e26d35f6bb51 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:26.384137 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1211/2416] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:57:26 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:57:26.388016 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c2f97-71e4-42f3-9561-f6ee66e882cc admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:26.399818 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c2f97-71e4-42f3-9561-f6ee66e882cc admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:26.405085 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450327d-188a-4805-aeb5-76b6df0bb4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:26.405994 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450327d-188a-4805-aeb5-76b6df0bb4ee admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:26.406287 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450327d-188a-4805-aeb5-76b6df0bb4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:26.406561 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450327d-188a-4805-aeb5-76b6df0bb4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:26.407328 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450327d-188a-4805-aeb5-76b6df0bb4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:26.409034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450327d-188a-4805-aeb5-76b6df0bb4ee admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:26.420149 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1206/2417] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:26.424869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad3c27-b2d5-445e-b206-e26d35f6bb51 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:26.438023 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad3c27-b2d5-445e-b206-e26d35f6bb51 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:26.443132 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac2ba3-c976-4f3d-a21e-e7fda23cd557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:26.443826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac2ba3-c976-4f3d-a21e-e7fda23cd557 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:26.444095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac2ba3-c976-4f3d-a21e-e7fda23cd557 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:26.444393 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac2ba3-c976-4f3d-a21e-e7fda23cd557 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:26.445116 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac2ba3-c976-4f3d-a21e-e7fda23cd557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:26.446704 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac2ba3-c976-4f3d-a21e-e7fda23cd557 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:26.463284 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1212/2418] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:26.467825 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450327d-188a-4805-aeb5-76b6df0bb4ee admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:26.479066 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450327d-188a-4805-aeb5-76b6df0bb4ee admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:26.485704 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b66a3-010d-4bd4-9c4c-4a320eead9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:26.487303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b66a3-010d-4bd4-9c4c-4a320eead9aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:26.487598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b66a3-010d-4bd4-9c4c-4a320eead9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:26.488158 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b66a3-010d-4bd4-9c4c-4a320eead9aa admin admin] PATH_INFO: `/v3/projects/a146c5f2babf4df88b2c99728301bc32/users/646c39dd5c4e41a887c458c91814320a/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:26.520940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b66a3-010d-4bd4-9c4c-4a320eead9aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a146c5f2babf4df88b2c99728301bc32, user_id=646c39dd5c4e41a887c458c91814320a, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:26.523705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b66a3-010d-4bd4-9c4c-4a320eead9aa admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:26.542169 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1207/2419] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:57:26 2022] PUT /identity/v3/projects/a146c5f2babf4df88b2c99728301bc32/users/646c39dd5c4e41a887c458c91814320a/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:26.554029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1798e-761c-4c74-badc-3cdcadb37652 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:26.554374 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1798e-761c-4c74-badc-3cdcadb37652 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:26.554611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1798e-761c-4c74-badc-3cdcadb37652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:26.568745 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b66a3-010d-4bd4-9c4c-4a320eead9aa admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:26.570603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-156b66a3-010d-4bd4-9c4c-4a320eead9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:26.595610 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-1cf1798e-761c-4c74-badc-3cdcadb37652 None None] MFA Rules not processed for user `646c39dd5c4e41a887c458c91814320a`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:26.598431 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1cf1798e-761c-4c74-badc-3cdcadb37652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:26.630605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b66a3-010d-4bd4-9c4c-4a320eead9aa admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:26.634448 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4eb3-2b8b-4b1d-ad02-494206eda35a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:26.635134 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4eb3-2b8b-4b1d-ad02-494206eda35a service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:26.635412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4eb3-2b8b-4b1d-ad02-494206eda35a service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:26.635687 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4eb3-2b8b-4b1d-ad02-494206eda35a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:26.637511 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-212d4eb3-2b8b-4b1d-ad02-494206eda35a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:26.661156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1213/2420] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:57:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:26.672626 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1798e-761c-4c74-badc-3cdcadb37652 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:26.674094 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1cf1798e-761c-4c74-badc-3cdcadb37652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:26.720823 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d4eb3-2b8b-4b1d-ad02-494206eda35a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:26.722273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d4eb3-2b8b-4b1d-ad02-494206eda35a service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:26.731619 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1798e-761c-4c74-badc-3cdcadb37652 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:26.735370 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757c5da-3334-474b-8141-0024cbd3e2ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:26.736018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757c5da-3334-474b-8141-0024cbd3e2ea service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:26.736327 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757c5da-3334-474b-8141-0024cbd3e2ea service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:26.736593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757c5da-3334-474b-8141-0024cbd3e2ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:26.742522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1208/2421] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:26.747095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757c5da-3334-474b-8141-0024cbd3e2ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:26.748558 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757c5da-3334-474b-8141-0024cbd3e2ea service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:26.758104 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1214/2422] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:57:26.785761 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4eb3-2b8b-4b1d-ad02-494206eda35a service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:26.858242 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4eb3-2b8b-4b1d-ad02-494206eda35a service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:26.863187 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dc93e-f39c-4dc8-8902-039b294b9dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:26.864122 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dc93e-f39c-4dc8-8902-039b294b9dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:26.864402 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dc93e-f39c-4dc8-8902-039b294b9dec admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:26.864677 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dc93e-f39c-4dc8-8902-039b294b9dec admin admin] PATH_INFO: `/v3/users/646c39dd5c4e41a887c458c91814320a` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:26.865896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1dc93e-f39c-4dc8-8902-039b294b9dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=646c39dd5c4e41a887c458c91814320a)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:26.867875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1dc93e-f39c-4dc8-8902-039b294b9dec admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:26.915471 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-9d1dc93e-f39c-4dc8-8902-039b294b9dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '646c39dd5c4e41a887c458c91814320a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:26.916079 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-9d1dc93e-f39c-4dc8-8902-039b294b9dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '646c39dd5c4e41a887c458c91814320a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:26.927869 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-9d1dc93e-f39c-4dc8-8902-039b294b9dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '646c39dd5c4e41a887c458c91814320a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:26.928547 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-9d1dc93e-f39c-4dc8-8902-039b294b9dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '646c39dd5c4e41a887c458c91814320a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:26.936803 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-9d1dc93e-f39c-4dc8-8902-039b294b9dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '646c39dd5c4e41a887c458c91814320a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:26.949167 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1209/2423] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:57:26 2022] DELETE /identity/v3/users/646c39dd5c4e41a887c458c91814320a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:26.955786 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8acb56-eb61-42f4-9ec6-36302d8ece8b None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:26.956052 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8acb56-eb61-42f4-9ec6-36302d8ece8b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:26.956513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8acb56-eb61-42f4-9ec6-36302d8ece8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:26.978077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-de8acb56-eb61-42f4-9ec6-36302d8ece8b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:26.979259 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-de8acb56-eb61-42f4-9ec6-36302d8ece8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:27.049459 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1215/2424] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:27.059841 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dc93e-f39c-4dc8-8902-039b294b9dec admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:27.061756 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-9d1dc93e-f39c-4dc8-8902-039b294b9dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:27.123448 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dc93e-f39c-4dc8-8902-039b294b9dec admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:27.128064 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b647a-6ff3-4b72-8323-e89c469d9758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:27.128774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b647a-6ff3-4b72-8323-e89c469d9758 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:27.129060 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b647a-6ff3-4b72-8323-e89c469d9758 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:27.129337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b647a-6ff3-4b72-8323-e89c469d9758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:27.138721 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b647a-6ff3-4b72-8323-e89c469d9758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:27.140166 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b647a-6ff3-4b72-8323-e89c469d9758 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:27.149905 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1210/2425] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:27.438351 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8acb56-eb61-42f4-9ec6-36302d8ece8b None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:27.439886 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-de8acb56-eb61-42f4-9ec6-36302d8ece8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:27.452281 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8acb56-eb61-42f4-9ec6-36302d8ece8b None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:27.458975 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cef99a-7e1d-4b4a-ba5c-683ce80d42da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:27.460222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cef99a-7e1d-4b4a-ba5c-683ce80d42da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:27.460513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cef99a-7e1d-4b4a-ba5c-683ce80d42da admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:27.461293 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cef99a-7e1d-4b4a-ba5c-683ce80d42da admin admin] PATH_INFO: `/v3/projects/a146c5f2babf4df88b2c99728301bc32` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:27.462285 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cef99a-7e1d-4b4a-ba5c-683ce80d42da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a146c5f2babf4df88b2c99728301bc32)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:27.464306 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cef99a-7e1d-4b4a-ba5c-683ce80d42da admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:27.513393 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-52cef99a-7e1d-4b4a-ba5c-683ce80d42da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a146c5f2babf4df88b2c99728301bc32', 'request_id': 'req-52cef99a-7e1d-4b4a-ba5c-683ce80d42da'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:27.522295 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-52cef99a-7e1d-4b4a-ba5c-683ce80d42da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a146c5f2babf4df88b2c99728301bc32', 'request_id': 'req-52cef99a-7e1d-4b4a-ba5c-683ce80d42da'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:27.529318 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-52cef99a-7e1d-4b4a-ba5c-683ce80d42da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a146c5f2babf4df88b2c99728301bc32', 'request_id': 'req-52cef99a-7e1d-4b4a-ba5c-683ce80d42da'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:27.540402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-52cef99a-7e1d-4b4a-ba5c-683ce80d42da admin admin] The token cache is being invalidate because project a146c5f2babf4df88b2c99728301bc32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:57:27.540702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-52cef99a-7e1d-4b4a-ba5c-683ce80d42da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:27.541491 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-52cef99a-7e1d-4b4a-ba5c-683ce80d42da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:27.543097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1216/2426] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:57:27 2022] DELETE /identity/v3/projects/a146c5f2babf4df88b2c99728301bc32 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:27.548419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eeb92-ffcc-45fd-962d-c194a87a617d None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:27.548951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eeb92-ffcc-45fd-962d-c194a87a617d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:27.548951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eeb92-ffcc-45fd-962d-c194a87a617d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:27.569292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-924eeb92-ffcc-45fd-962d-c194a87a617d None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:27.570486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-924eeb92-ffcc-45fd-962d-c194a87a617d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:27.636841 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1211/2427] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:27.709725 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35028d-9b55-4e0b-b9c3-5b74da503cfc None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:27.710037 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35028d-9b55-4e0b-b9c3-5b74da503cfc None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:27.710274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35028d-9b55-4e0b-b9c3-5b74da503cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:27.732274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-da35028d-9b55-4e0b-b9c3-5b74da503cfc None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:27.733524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-da35028d-9b55-4e0b-b9c3-5b74da503cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:27.742950 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1217/2428] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:27.747797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924eeb92-ffcc-45fd-962d-c194a87a617d None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:27.758221 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924eeb92-ffcc-45fd-962d-c194a87a617d None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:27.764475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a066b4-27e0-43fe-b6b1-e84bb5bc022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:27.765127 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a066b4-27e0-43fe-b6b1-e84bb5bc022d admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:27.765435 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a066b4-27e0-43fe-b6b1-e84bb5bc022d admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:27.765703 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a066b4-27e0-43fe-b6b1-e84bb5bc022d admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:27.766744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a066b4-27e0-43fe-b6b1-e84bb5bc022d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:57:27.767044 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a066b4-27e0-43fe-b6b1-e84bb5bc022d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:27.768678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a066b4-27e0-43fe-b6b1-e84bb5bc022d admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:27.780757 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1212/2429] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 12:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:57:27.785308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35028d-9b55-4e0b-b9c3-5b74da503cfc None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:27.796657 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35028d-9b55-4e0b-b9c3-5b74da503cfc None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:27.805195 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5845bf-3a7d-4035-ae02-bc78e3c22ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:27.806150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5845bf-3a7d-4035-ae02-bc78e3c22ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:27.806433 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5845bf-3a7d-4035-ae02-bc78e3c22ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:27.806724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5845bf-3a7d-4035-ae02-bc78e3c22ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:27.807736 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5845bf-3a7d-4035-ae02-bc78e3c22ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:27.810652 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5845bf-3a7d-4035-ae02-bc78e3c22ee8 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:27.839670 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1218/2430] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 12:57:27 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:27.844232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a066b4-27e0-43fe-b6b1-e84bb5bc022d admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:27.854837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a066b4-27e0-43fe-b6b1-e84bb5bc022d admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:27.872748 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5845bf-3a7d-4035-ae02-bc78e3c22ee8 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:27.874891 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ea5845bf-3a7d-4035-ae02-bc78e3c22ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:27.914335 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de104fe6-1065-4721-8d85-f8c9f327be8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:27.915017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de104fe6-1065-4721-8d85-f8c9f327be8c admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:27.915356 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de104fe6-1065-4721-8d85-f8c9f327be8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:27.915630 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de104fe6-1065-4721-8d85-f8c9f327be8c admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:27.916358 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de104fe6-1065-4721-8d85-f8c9f327be8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:27.918302 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de104fe6-1065-4721-8d85-f8c9f327be8c admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:27.929902 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5845bf-3a7d-4035-ae02-bc78e3c22ee8 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:27.934023 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1e2c2-5767-44ec-8682-5cc99f1c3f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:27.934673 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1e2c2-5767-44ec-8682-5cc99f1c3f3a service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:27.934948 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1e2c2-5767-44ec-8682-5cc99f1c3f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:27.935219 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1e2c2-5767-44ec-8682-5cc99f1c3f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:27.937059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1bd1e2c2-5767-44ec-8682-5cc99f1c3f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:27.943186 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1213/2431] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 12:57:27 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:27.944284 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de104fe6-1065-4721-8d85-f8c9f327be8c admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:27.953597 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de104fe6-1065-4721-8d85-f8c9f327be8c admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:27.958688 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c97ae6-d91f-4b61-835f-7fc7bed6ad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:27.959340 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c97ae6-d91f-4b61-835f-7fc7bed6ad1b admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:27.959616 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c97ae6-d91f-4b61-835f-7fc7bed6ad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:27.959935 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c97ae6-d91f-4b61-835f-7fc7bed6ad1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:27.960657 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c97ae6-d91f-4b61-835f-7fc7bed6ad1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:27.962243 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c97ae6-d91f-4b61-835f-7fc7bed6ad1b admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:27.972441 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1214/2432] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:27.976606 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c97ae6-d91f-4b61-835f-7fc7bed6ad1b admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:27.985932 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c97ae6-d91f-4b61-835f-7fc7bed6ad1b admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:27.990626 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f24b6a-efe6-4d5c-bfbe-693f35ef6d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:27.991275 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f24b6a-efe6-4d5c-bfbe-693f35ef6d82 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:27.991546 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f24b6a-efe6-4d5c-bfbe-693f35ef6d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:27.991818 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f24b6a-efe6-4d5c-bfbe-693f35ef6d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:27.992626 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f24b6a-efe6-4d5c-bfbe-693f35ef6d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:27.994224 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f24b6a-efe6-4d5c-bfbe-693f35ef6d82 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:28.004936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1215/2433] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:57:28.007978 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1e2c2-5767-44ec-8682-5cc99f1c3f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:28.009054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f24b6a-efe6-4d5c-bfbe-693f35ef6d82 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:28.009475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1e2c2-5767-44ec-8682-5cc99f1c3f3a service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:28.019280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f24b6a-efe6-4d5c-bfbe-693f35ef6d82 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:28.020944 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1219/2434] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:28.024255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858ed67-52b6-435a-8eda-b6fb6a1f8d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:28.025164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858ed67-52b6-435a-8eda-b6fb6a1f8d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:28.025443 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858ed67-52b6-435a-8eda-b6fb6a1f8d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:28.025717 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858ed67-52b6-435a-8eda-b6fb6a1f8d12 admin admin] PATH_INFO: `/v3/projects/7920f325351344b884730c7b1d1b669f/users/389e226eede44d619873653bb139d05e/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:28.040854 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858ed67-52b6-435a-8eda-b6fb6a1f8d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7920f325351344b884730c7b1d1b669f, user_id=389e226eede44d619873653bb139d05e, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:28.043507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858ed67-52b6-435a-8eda-b6fb6a1f8d12 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:28.058040 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1216/2435] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 12:57:28 2022] PUT /identity/v3/projects/7920f325351344b884730c7b1d1b669f/users/389e226eede44d619873653bb139d05e/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:28.069222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67d0a3-3a92-4a01-a7a6-bf72dc67fdf3 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:28.069516 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67d0a3-3a92-4a01-a7a6-bf72dc67fdf3 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:28.069796 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67d0a3-3a92-4a01-a7a6-bf72dc67fdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:28.097206 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-bb67d0a3-3a92-4a01-a7a6-bf72dc67fdf3 None None] MFA Rules not processed for user `389e226eede44d619873653bb139d05e`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:28.098473 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-bb67d0a3-3a92-4a01-a7a6-bf72dc67fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:28.163781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1220/2436] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:57:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:28.175405 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858ed67-52b6-435a-8eda-b6fb6a1f8d12 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:28.177256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f858ed67-52b6-435a-8eda-b6fb6a1f8d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:28.241494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858ed67-52b6-435a-8eda-b6fb6a1f8d12 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:28.245710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe95369-32e0-4eae-b656-759b43e77fe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:28.246362 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe95369-32e0-4eae-b656-759b43e77fe7 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:28.246621 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe95369-32e0-4eae-b656-759b43e77fe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:28.246886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe95369-32e0-4eae-b656-759b43e77fe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:28.256625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe95369-32e0-4eae-b656-759b43e77fe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:28.258086 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe95369-32e0-4eae-b656-759b43e77fe7 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:28.267837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1217/2437] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:59.527774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67d0a3-3a92-4a01-a7a6-bf72dc67fdf3 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:59.529411 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-bb67d0a3-3a92-4a01-a7a6-bf72dc67fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:59.609974 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67d0a3-3a92-4a01-a7a6-bf72dc67fdf3 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:59.620860 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95726f4a-7c92-405e-9d80-6433b3d6d86f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:59.621904 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95726f4a-7c92-405e-9d80-6433b3d6d86f service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:59.622300 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95726f4a-7c92-405e-9d80-6433b3d6d86f service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:59.622667 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95726f4a-7c92-405e-9d80-6433b3d6d86f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:59.625790 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-95726f4a-7c92-405e-9d80-6433b3d6d86f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:59.689188 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95726f4a-7c92-405e-9d80-6433b3d6d86f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:59.690912 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95726f4a-7c92-405e-9d80-6433b3d6d86f service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:59.700071 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1221/2438] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:06.469553 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe95369-32e0-4eae-b656-759b43e77fe7 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:06.539921 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe95369-32e0-4eae-b656-759b43e77fe7 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:06.545103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7965181-1e13-41db-8c88-b96fb7fa3a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:06.545978 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7965181-1e13-41db-8c88-b96fb7fa3a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:06.546252 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7965181-1e13-41db-8c88-b96fb7fa3a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:06.546526 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7965181-1e13-41db-8c88-b96fb7fa3a7a admin admin] PATH_INFO: `/v3/users/389e226eede44d619873653bb139d05e` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:06.547841 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7965181-1e13-41db-8c88-b96fb7fa3a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=389e226eede44d619873653bb139d05e)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:06.549886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7965181-1e13-41db-8c88-b96fb7fa3a7a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:06.603615 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-b7965181-1e13-41db-8c88-b96fb7fa3a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389e226eede44d619873653bb139d05e'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:06.604282 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-b7965181-1e13-41db-8c88-b96fb7fa3a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389e226eede44d619873653bb139d05e'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:06.615954 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-b7965181-1e13-41db-8c88-b96fb7fa3a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389e226eede44d619873653bb139d05e'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:06.616705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-b7965181-1e13-41db-8c88-b96fb7fa3a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389e226eede44d619873653bb139d05e'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:06.625255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-b7965181-1e13-41db-8c88-b96fb7fa3a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389e226eede44d619873653bb139d05e'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:06.637243 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1218/2439] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:58:06 2022] DELETE /identity/v3/users/389e226eede44d619873653bb139d05e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:06.645809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda61734-20d3-403f-962d-281b064857ac None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:06.646429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda61734-20d3-403f-962d-281b064857ac None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:06.646429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda61734-20d3-403f-962d-281b064857ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:06.666433 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-bda61734-20d3-403f-962d-281b064857ac None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:06.667572 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-bda61734-20d3-403f-962d-281b064857ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:06.729180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1222/2440] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:06.740293 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7965181-1e13-41db-8c88-b96fb7fa3a7a admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:06.741685 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-b7965181-1e13-41db-8c88-b96fb7fa3a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:06.802387 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7965181-1e13-41db-8c88-b96fb7fa3a7a admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:06.806258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9c462-1dce-47fd-9aba-3dcb198676d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:06.806909 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9c462-1dce-47fd-9aba-3dcb198676d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:06.807184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9c462-1dce-47fd-9aba-3dcb198676d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:06.807454 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9c462-1dce-47fd-9aba-3dcb198676d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:06.817400 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9c462-1dce-47fd-9aba-3dcb198676d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:06.818844 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9c462-1dce-47fd-9aba-3dcb198676d0 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:06.828502 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1219/2441] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:07.361599 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda61734-20d3-403f-962d-281b064857ac None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:07.363660 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-bda61734-20d3-403f-962d-281b064857ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:07.380997 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda61734-20d3-403f-962d-281b064857ac None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:07.386520 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd56406-26d0-4f66-b020-bed592478659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:07.388254 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd56406-26d0-4f66-b020-bed592478659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:07.388503 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd56406-26d0-4f66-b020-bed592478659 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:07.388846 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd56406-26d0-4f66-b020-bed592478659 admin admin] PATH_INFO: `/v3/projects/7920f325351344b884730c7b1d1b669f` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:07.390207 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd56406-26d0-4f66-b020-bed592478659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7920f325351344b884730c7b1d1b669f)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:07.392851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd56406-26d0-4f66-b020-bed592478659 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:07.444484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5cd56406-26d0-4f66-b020-bed592478659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7920f325351344b884730c7b1d1b669f', 'request_id': 'req-5cd56406-26d0-4f66-b020-bed592478659'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:07.453049 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5cd56406-26d0-4f66-b020-bed592478659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7920f325351344b884730c7b1d1b669f', 'request_id': 'req-5cd56406-26d0-4f66-b020-bed592478659'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:07.459658 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5cd56406-26d0-4f66-b020-bed592478659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7920f325351344b884730c7b1d1b669f', 'request_id': 'req-5cd56406-26d0-4f66-b020-bed592478659'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:07.470644 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5cd56406-26d0-4f66-b020-bed592478659 admin admin] The token cache is being invalidate because project 7920f325351344b884730c7b1d1b669f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:58:07.471114 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5cd56406-26d0-4f66-b020-bed592478659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:07.471823 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5cd56406-26d0-4f66-b020-bed592478659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:07.473414 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1223/2442] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:58:07 2022] DELETE /identity/v3/projects/7920f325351344b884730c7b1d1b669f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:09.704918 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9c462-1dce-47fd-9aba-3dcb198676d0 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:09.706753 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a8f9c462-1dce-47fd-9aba-3dcb198676d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:09.785200 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9c462-1dce-47fd-9aba-3dcb198676d0 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:09.851755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3ed61-02e1-4bd3-877d-f50df4112c64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:09.852478 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3ed61-02e1-4bd3-877d-f50df4112c64 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:09.852753 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3ed61-02e1-4bd3-877d-f50df4112c64 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:09.853024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3ed61-02e1-4bd3-877d-f50df4112c64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:09.854917 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f5c3ed61-02e1-4bd3-877d-f50df4112c64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:09.913616 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3ed61-02e1-4bd3-877d-f50df4112c64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:09.915245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3ed61-02e1-4bd3-877d-f50df4112c64 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:09.929856 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1220/2443] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:14.667408 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd56406-26d0-4f66-b020-bed592478659 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:14.668986 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5cd56406-26d0-4f66-b020-bed592478659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:14.686227 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd56406-26d0-4f66-b020-bed592478659 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:14.691894 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae6bf4-2015-4e53-b5f9-504e681bee0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:14.692906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae6bf4-2015-4e53-b5f9-504e681bee0f service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:14.693715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae6bf4-2015-4e53-b5f9-504e681bee0f service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:14.693715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae6bf4-2015-4e53-b5f9-504e681bee0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:14.695385 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-36ae6bf4-2015-4e53-b5f9-504e681bee0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:14.712194 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae6bf4-2015-4e53-b5f9-504e681bee0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:14.714004 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae6bf4-2015-4e53-b5f9-504e681bee0f service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:14.726172 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1224/2444] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:33.777725 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3ed61-02e1-4bd3-877d-f50df4112c64 service nova] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:33.791486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3ed61-02e1-4bd3-877d-f50df4112c64 service nova] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:33.797344 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44023f2-6653-48cb-b908-b41fb41ec416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:33.798028 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44023f2-6653-48cb-b908-b41fb41ec416 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:33.798688 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44023f2-6653-48cb-b908-b41fb41ec416 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:33.798688 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44023f2-6653-48cb-b908-b41fb41ec416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:33.800398 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-b44023f2-6653-48cb-b908-b41fb41ec416 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:33.814012 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44023f2-6653-48cb-b908-b41fb41ec416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:33.815829 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44023f2-6653-48cb-b908-b41fb41ec416 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:33.827360 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1221/2445] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:40.305448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6ad7e-e029-4a95-98e7-c1242378b1c9 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:40.306193 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6ad7e-e029-4a95-98e7-c1242378b1c9 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:40.306193 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6ad7e-e029-4a95-98e7-c1242378b1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:40.325203 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-5ea6ad7e-e029-4a95-98e7-c1242378b1c9 None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:40.326458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5ea6ad7e-e029-4a95-98e7-c1242378b1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:40.384445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1225/2446] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Nov 2 12:58:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:40.435637 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44023f2-6653-48cb-b908-b41fb41ec416 service nova] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:40.437119 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-b44023f2-6653-48cb-b908-b41fb41ec416 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:40.510479 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44023f2-6653-48cb-b908-b41fb41ec416 service nova] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:40.515841 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583b26f-b56a-4876-a25c-c664f2d60116 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:40.516563 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583b26f-b56a-4876-a25c-c664f2d60116 service swift] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:40.516812 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583b26f-b56a-4876-a25c-c664f2d60116 service swift] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:40.517081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583b26f-b56a-4876-a25c-c664f2d60116 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:40.526960 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583b26f-b56a-4876-a25c-c664f2d60116 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:40.528820 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583b26f-b56a-4876-a25c-c664f2d60116 service swift] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:40.538914 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1222/2447] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 12:58:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:58:48.303118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6ad7e-e029-4a95-98e7-c1242378b1c9 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:48.306605 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5ea6ad7e-e029-4a95-98e7-c1242378b1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:48.435854 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6ad7e-e029-4a95-98e7-c1242378b1c9 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:48.440818 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714ebc9-f25b-4cd7-9b17-b073d5d5f377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:48.441721 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714ebc9-f25b-4cd7-9b17-b073d5d5f377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:48.441991 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714ebc9-f25b-4cd7-9b17-b073d5d5f377 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:48.442256 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714ebc9-f25b-4cd7-9b17-b073d5d5f377 admin admin] PATH_INFO: `/v3/users/a05c9a5fa170471aa8d73e243ffc30b8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:48.443525 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714ebc9-f25b-4cd7-9b17-b073d5d5f377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05c9a5fa170471aa8d73e243ffc30b8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:48.445777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714ebc9-f25b-4cd7-9b17-b073d5d5f377 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:48.514178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0714ebc9-f25b-4cd7-9b17-b073d5d5f377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05c9a5fa170471aa8d73e243ffc30b8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:48.515276 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0714ebc9-f25b-4cd7-9b17-b073d5d5f377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05c9a5fa170471aa8d73e243ffc30b8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:48.534821 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0714ebc9-f25b-4cd7-9b17-b073d5d5f377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05c9a5fa170471aa8d73e243ffc30b8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:48.538574 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0714ebc9-f25b-4cd7-9b17-b073d5d5f377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05c9a5fa170471aa8d73e243ffc30b8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:48.548895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-0714ebc9-f25b-4cd7-9b17-b073d5d5f377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05c9a5fa170471aa8d73e243ffc30b8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:48.566337 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1226/2448] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 12:58:48 2022] DELETE /identity/v3/users/a05c9a5fa170471aa8d73e243ffc30b8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:58:48.922421 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583b26f-b56a-4876-a25c-c664f2d60116 service swift] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:48.955612 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583b26f-b56a-4876-a25c-c664f2d60116 service swift] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:48.984089 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714ebc9-f25b-4cd7-9b17-b073d5d5f377 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:48.985938 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0714ebc9-f25b-4cd7-9b17-b073d5d5f377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:49.065226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51684860-72f6-423a-9c03-5a1ac602fce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:49.066734 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51684860-72f6-423a-9c03-5a1ac602fce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:49.067193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51684860-72f6-423a-9c03-5a1ac602fce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:49.067621 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51684860-72f6-423a-9c03-5a1ac602fce2 admin admin] PATH_INFO: `/v3/projects/90b42fe203384f8c852afe1c917d4f40` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:49.069623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51684860-72f6-423a-9c03-5a1ac602fce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b42fe203384f8c852afe1c917d4f40)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:49.072262 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51684860-72f6-423a-9c03-5a1ac602fce2 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:49.082791 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714ebc9-f25b-4cd7-9b17-b073d5d5f377 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:49.086636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9ff18-52da-49c4-9fbe-ac892a22ffad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:49.087560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9ff18-52da-49c4-9fbe-ac892a22ffad service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:49.087560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9ff18-52da-49c4-9fbe-ac892a22ffad service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:49.087936 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9ff18-52da-49c4-9fbe-ac892a22ffad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:49.090049 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-15e9ff18-52da-49c4-9fbe-ac892a22ffad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:49.102237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9ff18-52da-49c4-9fbe-ac892a22ffad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:49.103744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9ff18-52da-49c4-9fbe-ac892a22ffad service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:49.114620 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1227/2449] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:58:49.170916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-51684860-72f6-423a-9c03-5a1ac602fce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b42fe203384f8c852afe1c917d4f40', 'request_id': 'req-51684860-72f6-423a-9c03-5a1ac602fce2'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:49.185763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-51684860-72f6-423a-9c03-5a1ac602fce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b42fe203384f8c852afe1c917d4f40', 'request_id': 'req-51684860-72f6-423a-9c03-5a1ac602fce2'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:49.197590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-51684860-72f6-423a-9c03-5a1ac602fce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b42fe203384f8c852afe1c917d4f40', 'request_id': 'req-51684860-72f6-423a-9c03-5a1ac602fce2'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:49.225875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-51684860-72f6-423a-9c03-5a1ac602fce2 admin admin] The token cache is being invalidate because project 90b42fe203384f8c852afe1c917d4f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:58:49.228187 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-51684860-72f6-423a-9c03-5a1ac602fce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:49.230014 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-51684860-72f6-423a-9c03-5a1ac602fce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:49.244233 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1223/2450] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 12:58:48 2022] DELETE /identity/v3/projects/90b42fe203384f8c852afe1c917d4f40 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:55.810262 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9ff18-52da-49c4-9fbe-ac892a22ffad service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:55.811918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-15e9ff18-52da-49c4-9fbe-ac892a22ffad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:55.822888 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9ff18-52da-49c4-9fbe-ac892a22ffad service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:55.877798 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551bfc8-eb9f-4423-b472-829daa8cb00e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:55.878386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551bfc8-eb9f-4423-b472-829daa8cb00e service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:55.878661 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551bfc8-eb9f-4423-b472-829daa8cb00e service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:55.878929 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551bfc8-eb9f-4423-b472-829daa8cb00e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:55.881309 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-9551bfc8-eb9f-4423-b472-829daa8cb00e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:55.892936 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551bfc8-eb9f-4423-b472-829daa8cb00e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:55.894400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551bfc8-eb9f-4423-b472-829daa8cb00e service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:55.903810 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1228/2451] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:56.022888 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9d1f0-c6d3-43d4-ba7a-c38892daecb9 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:56.023466 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9d1f0-c6d3-43d4-ba7a-c38892daecb9 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:56.023466 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9d1f0-c6d3-43d4-ba7a-c38892daecb9 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:56.025426 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1224/2452] 10.222.0.90 () {54 vars in 921 bytes} [Wed Nov 2 12:58:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:58:56.031653 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82dde4-186c-47df-9e1a-2fadf3c9721e None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:56.031974 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82dde4-186c-47df-9e1a-2fadf3c9721e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:56.032313 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82dde4-186c-47df-9e1a-2fadf3c9721e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:56.074003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-6d82dde4-186c-47df-9e1a-2fadf3c9721e None None] MFA Rules not processed for user `fbcda58f298444eebf4f08ce01deffc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:56.075243 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6d82dde4-186c-47df-9e1a-2fadf3c9721e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:56.155365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1229/2453] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Nov 2 12:58:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:56.167870 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9d1f0-c6d3-43d4-ba7a-c38892daecb9 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:56.169617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-2ef9d1f0-c6d3-43d4-ba7a-c38892daecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:56.231150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9d1f0-c6d3-43d4-ba7a-c38892daecb9 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:56.235654 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef687a29-645f-4572-836c-87aec05e8dfd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0303312c6cec4067a4a92d38edb59086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:56.236348 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef687a29-645f-4572-836c-87aec05e8dfd service glance] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:56.236629 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef687a29-645f-4572-836c-87aec05e8dfd service glance] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:56.236898 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef687a29-645f-4572-836c-87aec05e8dfd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:56.249024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef687a29-645f-4572-836c-87aec05e8dfd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:56.250483 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef687a29-645f-4572-836c-87aec05e8dfd service glance] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:56.262431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1225/2454] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:56.336235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5f4a9-559e-41cc-838b-1b7109a9041e None None] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:56.336492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5f4a9-559e-41cc-838b-1b7109a9041e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:56.336790 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5f4a9-559e-41cc-838b-1b7109a9041e None None] PATH_INFO: `/` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:56.338604 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1230/2455] 10.222.0.90 () {54 vars in 921 bytes} [Wed Nov 2 12:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:58:56.344653 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52025a-a9cc-4d7d-b783-edea77dba82d None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:56.345017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52025a-a9cc-4d7d-b783-edea77dba82d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:56.345296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52025a-a9cc-4d7d-b783-edea77dba82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:56.364111 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-fb52025a-a9cc-4d7d-b783-edea77dba82d None None] MFA Rules not processed for user `89a11da83d84467ca9ae04b9693beede`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:56.365346 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-fb52025a-a9cc-4d7d-b783-edea77dba82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:56.373240 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1226/2456] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Nov 2 12:58:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:56.386191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5f4a9-559e-41cc-838b-1b7109a9041e None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:56.387875 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2bf5f4a9-559e-41cc-838b-1b7109a9041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:56.404195 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5f4a9-559e-41cc-838b-1b7109a9041e None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:56.408720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3c72f-9bd9-4870-8443-5ab347c272d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:56.409372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3c72f-9bd9-4870-8443-5ab347c272d2 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:56.409649 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3c72f-9bd9-4870-8443-5ab347c272d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:56.409920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3c72f-9bd9-4870-8443-5ab347c272d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:56.417838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3c72f-9bd9-4870-8443-5ab347c272d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:56.419278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3c72f-9bd9-4870-8443-5ab347c272d2 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:56.427498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1231/2457] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:56.525038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7a0e0-00ec-44e7-802a-7268c1160e83 None None] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:56.525322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7a0e0-00ec-44e7-802a-7268c1160e83 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:56.525595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7a0e0-00ec-44e7-802a-7268c1160e83 None None] PATH_INFO: `/` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:56.527422 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1227/2458] 10.222.0.90 () {54 vars in 921 bytes} [Wed Nov 2 12:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:58:56.533886 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f9f63-7fde-4b45-ac66-cc8b98e3939c None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:56.534173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f9f63-7fde-4b45-ac66-cc8b98e3939c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:56.534506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f9f63-7fde-4b45-ac66-cc8b98e3939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:56.557210 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-0c3f9f63-7fde-4b45-ac66-cc8b98e3939c None None] MFA Rules not processed for user `fbcda58f298444eebf4f08ce01deffc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:56.558329 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0c3f9f63-7fde-4b45-ac66-cc8b98e3939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:56.574224 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1232/2459] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Nov 2 12:58:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:56.586173 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7a0e0-00ec-44e7-802a-7268c1160e83 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:56.587894 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-dbb7a0e0-00ec-44e7-802a-7268c1160e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:56.602326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7a0e0-00ec-44e7-802a-7268c1160e83 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:56.605847 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40a4e1-c624-4c91-a154-12ca28f015aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:56.606483 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40a4e1-c624-4c91-a154-12ca28f015aa service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:56.606759 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40a4e1-c624-4c91-a154-12ca28f015aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:56.607029 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40a4e1-c624-4c91-a154-12ca28f015aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:56.617797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40a4e1-c624-4c91-a154-12ca28f015aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:56.619243 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40a4e1-c624-4c91-a154-12ca28f015aa service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:56.631397 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1228/2460] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:56.697645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f9f63-7fde-4b45-ac66-cc8b98e3939c None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:56.700025 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0c3f9f63-7fde-4b45-ac66-cc8b98e3939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:56.777899 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f9f63-7fde-4b45-ac66-cc8b98e3939c None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:56.783626 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759e24b-cb7d-4ced-9c5d-8ff028da1013 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:56.784316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759e24b-cb7d-4ced-9c5d-8ff028da1013 service placement] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:56.784592 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759e24b-cb7d-4ced-9c5d-8ff028da1013 service placement] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:56.784855 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759e24b-cb7d-4ced-9c5d-8ff028da1013 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:56.786839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6759e24b-cb7d-4ced-9c5d-8ff028da1013 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:56.799369 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759e24b-cb7d-4ced-9c5d-8ff028da1013 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:56.801011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759e24b-cb7d-4ced-9c5d-8ff028da1013 service placement] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:56.811457 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1233/2461] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:59.692664 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ab01c-b1d2-4fb6-89fb-d4b4b6199cf4 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:59.693251 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ab01c-b1d2-4fb6-89fb-d4b4b6199cf4 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:59.693396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ab01c-b1d2-4fb6-89fb-d4b4b6199cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:59.712868 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e67ab01c-b1d2-4fb6-89fb-d4b4b6199cf4 None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:59.714154 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e67ab01c-b1d2-4fb6-89fb-d4b4b6199cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:59.780053 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1229/2462] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Nov 2 12:58:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:59.792881 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759e24b-cb7d-4ced-9c5d-8ff028da1013 service placement] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:59.794583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6759e24b-cb7d-4ced-9c5d-8ff028da1013 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:59.867858 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759e24b-cb7d-4ced-9c5d-8ff028da1013 service placement] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:59.873404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766c9d3-1e54-461d-ade1-30025b547eaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:59.874070 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766c9d3-1e54-461d-ade1-30025b547eaa service swift] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:59.874352 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766c9d3-1e54-461d-ade1-30025b547eaa service swift] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:59.874607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766c9d3-1e54-461d-ade1-30025b547eaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:59.883687 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766c9d3-1e54-461d-ade1-30025b547eaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:59.885359 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766c9d3-1e54-461d-ade1-30025b547eaa service swift] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:59.894465 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1234/2463] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 12:58:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:59:31.356242 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71518e9-135d-4da6-bc44-c381a2e10696 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:31.356817 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71518e9-135d-4da6-bc44-c381a2e10696 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:31.356918 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71518e9-135d-4da6-bc44-c381a2e10696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:31.375931 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-c71518e9-135d-4da6-bc44-c381a2e10696 None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:59:31.377160 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c71518e9-135d-4da6-bc44-c381a2e10696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:31.385282 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1230/2464] 10.222.0.90 () {58 vars in 967 bytes} [Wed Nov 2 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:59:31.405906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766c9d3-1e54-461d-ade1-30025b547eaa service swift] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:31.420606 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766c9d3-1e54-461d-ade1-30025b547eaa service swift] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:31.425644 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bfb05-f80a-4581-ba0f-e31e1b7c1455 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:31.426348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bfb05-f80a-4581-ba0f-e31e1b7c1455 service swift] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:31.426646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bfb05-f80a-4581-ba0f-e31e1b7c1455 service swift] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:31.426924 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bfb05-f80a-4581-ba0f-e31e1b7c1455 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:31.435353 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3bfb05-f80a-4581-ba0f-e31e1b7c1455 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:31.436976 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3bfb05-f80a-4581-ba0f-e31e1b7c1455 service swift] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:31.445448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1235/2465] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 12:59:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:59:33.878592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71518e9-135d-4da6-bc44-c381a2e10696 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:33.880074 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c71518e9-135d-4da6-bc44-c381a2e10696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:33.898418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71518e9-135d-4da6-bc44-c381a2e10696 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:33.904072 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e54e6-3e6c-43b3-83f9-a1c6fed4ca42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:33.904754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e54e6-3e6c-43b3-83f9-a1c6fed4ca42 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:33.905049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e54e6-3e6c-43b3-83f9-a1c6fed4ca42 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:33.905326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e54e6-3e6c-43b3-83f9-a1c6fed4ca42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:33.907144 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-cc1e54e6-3e6c-43b3-83f9-a1c6fed4ca42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:33.978440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e54e6-3e6c-43b3-83f9-a1c6fed4ca42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:33.980052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e54e6-3e6c-43b3-83f9-a1c6fed4ca42 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:33.989890 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1231/2466] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 12:59:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:59:57.937631 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05072fa-229a-4b18-ad53-1f60a79cbe0e None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:57.938174 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05072fa-229a-4b18-ad53-1f60a79cbe0e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:57.938300 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05072fa-229a-4b18-ad53-1f60a79cbe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:57.960670 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-a05072fa-229a-4b18-ad53-1f60a79cbe0e None None] MFA Rules not processed for user `12d35ac129c24e118df9ebee0c8c9f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:59:57.961852 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-a05072fa-229a-4b18-ad53-1f60a79cbe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:57.969134 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1236/2467] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 12:59:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:04.293306 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e54e6-3e6c-43b3-83f9-a1c6fed4ca42 service nova] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:04.305865 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e54e6-3e6c-43b3-83f9-a1c6fed4ca42 service nova] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:04.311503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4839f0-be41-4311-8f34-3ef676877e7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:04.312177 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4839f0-be41-4311-8f34-3ef676877e7d service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:04.312568 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4839f0-be41-4311-8f34-3ef676877e7d service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:04.312831 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4839f0-be41-4311-8f34-3ef676877e7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:04.315415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-9b4839f0-be41-4311-8f34-3ef676877e7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:04.328355 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4839f0-be41-4311-8f34-3ef676877e7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:04.330993 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4839f0-be41-4311-8f34-3ef676877e7d service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:04.342658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1232/2468] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:35.528607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05072fa-229a-4b18-ad53-1f60a79cbe0e None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:35.547907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05072fa-229a-4b18-ad53-1f60a79cbe0e None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:35.554541 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a082b0a-01cf-401c-85c3-9c41e7aab7bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:35.555198 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a082b0a-01cf-401c-85c3-9c41e7aab7bc service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:35.555478 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a082b0a-01cf-401c-85c3-9c41e7aab7bc service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:35.555777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a082b0a-01cf-401c-85c3-9c41e7aab7bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:35.557688 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4a082b0a-01cf-401c-85c3-9c41e7aab7bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:35.631684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a082b0a-01cf-401c-85c3-9c41e7aab7bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:35.633335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a082b0a-01cf-401c-85c3-9c41e7aab7bc service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:35.643357 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1237/2469] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:41.867769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc2506-1872-4797-8b1e-bfc23546a00a None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:41.868377 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc2506-1872-4797-8b1e-bfc23546a00a None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:41.868377 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc2506-1872-4797-8b1e-bfc23546a00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:41.887139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-bcdc2506-1872-4797-8b1e-bfc23546a00a None None] MFA Rules not processed for user `8c01ed6e76ef4ee4ba5356c526e113e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:41.888906 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-bcdc2506-1872-4797-8b1e-bfc23546a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:41.898083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1233/2470] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:42.227064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a082b0a-01cf-401c-85c3-9c41e7aab7bc service nova] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:42.238178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a082b0a-01cf-401c-85c3-9c41e7aab7bc service nova] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:42.243021 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a7ea5-60d6-4f04-8e1b-15d5793d457f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:42.243736 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a7ea5-60d6-4f04-8e1b-15d5793d457f service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:42.244160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a7ea5-60d6-4f04-8e1b-15d5793d457f service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:42.244468 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a7ea5-60d6-4f04-8e1b-15d5793d457f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:42.246600 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-194a7ea5-60d6-4f04-8e1b-15d5793d457f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:42.257528 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a7ea5-60d6-4f04-8e1b-15d5793d457f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:42.259004 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a7ea5-60d6-4f04-8e1b-15d5793d457f service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:42.268945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1238/2471] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:59.083953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34cfc1-6a6c-493d-b6c5-ff193a6846fb None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:59.084536 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34cfc1-6a6c-493d-b6c5-ff193a6846fb None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:59.084665 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34cfc1-6a6c-493d-b6c5-ff193a6846fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:59.103481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-9d34cfc1-6a6c-493d-b6c5-ff193a6846fb None None] MFA Rules not processed for user `a2c786462bac45848eeff3a966e71149`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:59.104822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-9d34cfc1-6a6c-493d-b6c5-ff193a6846fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:59.162767 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1234/2472] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:00:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:00.319002 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a7ea5-60d6-4f04-8e1b-15d5793d457f service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:00.320693 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-194a7ea5-60d6-4f04-8e1b-15d5793d457f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:00.340807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a7ea5-60d6-4f04-8e1b-15d5793d457f service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:00.348267 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa41ff1-9286-47ee-a236-576fca2095dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:00.350493 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa41ff1-9286-47ee-a236-576fca2095dd service placement] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:00.350493 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa41ff1-9286-47ee-a236-576fca2095dd service placement] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:00.350493 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa41ff1-9286-47ee-a236-576fca2095dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:00.352466 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-aaa41ff1-9286-47ee-a236-576fca2095dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:00.364620 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa41ff1-9286-47ee-a236-576fca2095dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:00.366236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa41ff1-9286-47ee-a236-576fca2095dd service placement] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:00.376712 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1239/2473] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:37.729105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34cfc1-6a6c-493d-b6c5-ff193a6846fb None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:37.740059 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34cfc1-6a6c-493d-b6c5-ff193a6846fb None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:37.745614 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7d700-201e-42da-a3a5-30b50130dd6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:37.746260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7d700-201e-42da-a3a5-30b50130dd6e service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:37.746537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7d700-201e-42da-a3a5-30b50130dd6e service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:37.746834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7d700-201e-42da-a3a5-30b50130dd6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:37.748893 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7eb7d700-201e-42da-a3a5-30b50130dd6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:37.813115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7d700-201e-42da-a3a5-30b50130dd6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:37.814568 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7d700-201e-42da-a3a5-30b50130dd6e service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:37.824183 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1235/2474] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:41.079655 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa41ff1-9286-47ee-a236-576fca2095dd service placement] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:41.099349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa41ff1-9286-47ee-a236-576fca2095dd service placement] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:41.105227 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ffdf7-452f-479f-af0b-9cad254c5d24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:41.105884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ffdf7-452f-479f-af0b-9cad254c5d24 service placement] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:41.106156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ffdf7-452f-479f-af0b-9cad254c5d24 service placement] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:41.106426 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ffdf7-452f-479f-af0b-9cad254c5d24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:41.108515 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-998ffdf7-452f-479f-af0b-9cad254c5d24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:41.120240 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ffdf7-452f-479f-af0b-9cad254c5d24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:41.121825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ffdf7-452f-479f-af0b-9cad254c5d24 service placement] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:41.132994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1240/2475] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:41.149590 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7d700-201e-42da-a3a5-30b50130dd6e service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:41.151120 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7eb7d700-201e-42da-a3a5-30b50130dd6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:41.164823 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7d700-201e-42da-a3a5-30b50130dd6e service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:41.170091 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17fa0e-f419-44ac-b04b-b9ead51144da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:41.171083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17fa0e-f419-44ac-b04b-b9ead51144da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:41.171471 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17fa0e-f419-44ac-b04b-b9ead51144da admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:41.171743 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17fa0e-f419-44ac-b04b-b9ead51144da admin admin] PATH_INFO: `/v3/users/12d35ac129c24e118df9ebee0c8c9f6f` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:41.172989 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17fa0e-f419-44ac-b04b-b9ead51144da admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d35ac129c24e118df9ebee0c8c9f6f)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:41.174931 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17fa0e-f419-44ac-b04b-b9ead51144da admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:41.233319 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ca17fa0e-f419-44ac-b04b-b9ead51144da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d35ac129c24e118df9ebee0c8c9f6f'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:41.233985 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ca17fa0e-f419-44ac-b04b-b9ead51144da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d35ac129c24e118df9ebee0c8c9f6f'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:41.250578 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ca17fa0e-f419-44ac-b04b-b9ead51144da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d35ac129c24e118df9ebee0c8c9f6f'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:41.251327 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ca17fa0e-f419-44ac-b04b-b9ead51144da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d35ac129c24e118df9ebee0c8c9f6f'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:41.261258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-ca17fa0e-f419-44ac-b04b-b9ead51144da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d35ac129c24e118df9ebee0c8c9f6f'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:41.274994 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1236/2476] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:41 2022] DELETE /identity/v3/users/12d35ac129c24e118df9ebee0c8c9f6f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:41.466569 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ffdf7-452f-479f-af0b-9cad254c5d24 service placement] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:41.480265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ffdf7-452f-479f-af0b-9cad254c5d24 service placement] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:41.553621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53cde9-8164-498b-b304-cfd7fb1579d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:41.554491 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53cde9-8164-498b-b304-cfd7fb1579d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:41.554778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53cde9-8164-498b-b304-cfd7fb1579d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:41.555053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53cde9-8164-498b-b304-cfd7fb1579d2 admin admin] PATH_INFO: `/v3/projects/9d086a8e68a94153b5d2a15d6d54fc63` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:41.556368 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53cde9-8164-498b-b304-cfd7fb1579d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d086a8e68a94153b5d2a15d6d54fc63)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:41.558543 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53cde9-8164-498b-b304-cfd7fb1579d2 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:41.616716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6f53cde9-8164-498b-b304-cfd7fb1579d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d086a8e68a94153b5d2a15d6d54fc63', 'request_id': 'req-6f53cde9-8164-498b-b304-cfd7fb1579d2'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:41.633027 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6f53cde9-8164-498b-b304-cfd7fb1579d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d086a8e68a94153b5d2a15d6d54fc63', 'request_id': 'req-6f53cde9-8164-498b-b304-cfd7fb1579d2'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:41.641131 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6f53cde9-8164-498b-b304-cfd7fb1579d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d086a8e68a94153b5d2a15d6d54fc63', 'request_id': 'req-6f53cde9-8164-498b-b304-cfd7fb1579d2'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:41.651953 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6f53cde9-8164-498b-b304-cfd7fb1579d2 admin admin] The token cache is being invalidate because project 9d086a8e68a94153b5d2a15d6d54fc63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:41.652290 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6f53cde9-8164-498b-b304-cfd7fb1579d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:41.652940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6f53cde9-8164-498b-b304-cfd7fb1579d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:41.654497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1241/2477] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:41 2022] DELETE /identity/v3/projects/9d086a8e68a94153b5d2a15d6d54fc63 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:41.659699 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5e1a8-0d1c-434a-8b61-b664be119f88 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:41.660149 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5e1a8-0d1c-434a-8b61-b664be119f88 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:41.660467 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5e1a8-0d1c-434a-8b61-b664be119f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:41.678170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e6d5e1a8-0d1c-434a-8b61-b664be119f88 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:41.679781 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e6d5e1a8-0d1c-434a-8b61-b664be119f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:41.746216 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1237/2478] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:41.754971 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cec2dd-f555-4e9a-ad0e-8bde7cfdc04c None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:41.755162 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cec2dd-f555-4e9a-ad0e-8bde7cfdc04c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:41.755445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cec2dd-f555-4e9a-ad0e-8bde7cfdc04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:41.776408 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-59cec2dd-f555-4e9a-ad0e-8bde7cfdc04c None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:41.777733 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-59cec2dd-f555-4e9a-ad0e-8bde7cfdc04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:41.786088 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1242/2479] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:41.790843 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5e1a8-0d1c-434a-8b61-b664be119f88 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:41.801945 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5e1a8-0d1c-434a-8b61-b664be119f88 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:41.807650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46f7d1-c0ef-45b4-a4b1-dd7a9cf3b149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:41.808291 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46f7d1-c0ef-45b4-a4b1-dd7a9cf3b149 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:41.808576 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46f7d1-c0ef-45b4-a4b1-dd7a9cf3b149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:41.808852 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46f7d1-c0ef-45b4-a4b1-dd7a9cf3b149 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:41.809589 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46f7d1-c0ef-45b4-a4b1-dd7a9cf3b149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:01:41.809895 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46f7d1-c0ef-45b4-a4b1-dd7a9cf3b149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:41.811579 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46f7d1-c0ef-45b4-a4b1-dd7a9cf3b149 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:41.824261 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1238/2480] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:01:41.830772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cec2dd-f555-4e9a-ad0e-8bde7cfdc04c None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:41.840707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cec2dd-f555-4e9a-ad0e-8bde7cfdc04c None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:41.846322 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc98c81-2dcb-4ec9-959f-dcd571ea521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:41.847013 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc98c81-2dcb-4ec9-959f-dcd571ea521c admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:41.847292 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc98c81-2dcb-4ec9-959f-dcd571ea521c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:41.847562 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc98c81-2dcb-4ec9-959f-dcd571ea521c admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:41.848306 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc98c81-2dcb-4ec9-959f-dcd571ea521c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:41.850242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc98c81-2dcb-4ec9-959f-dcd571ea521c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:41.890621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1243/2481] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:41 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:41.895296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46f7d1-c0ef-45b4-a4b1-dd7a9cf3b149 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:41.906648 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46f7d1-c0ef-45b4-a4b1-dd7a9cf3b149 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:41.966877 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715b690-f671-4e72-ac0d-cbef2cfe3e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:41.967543 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b690-f671-4e72-ac0d-cbef2cfe3e4a admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:41.967810 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b690-f671-4e72-ac0d-cbef2cfe3e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:41.968103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b690-f671-4e72-ac0d-cbef2cfe3e4a admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:41.968926 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715b690-f671-4e72-ac0d-cbef2cfe3e4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:41.970856 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715b690-f671-4e72-ac0d-cbef2cfe3e4a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:41.993255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1239/2482] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:41 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:41.998097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc98c81-2dcb-4ec9-959f-dcd571ea521c admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:42.009552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc98c81-2dcb-4ec9-959f-dcd571ea521c admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:42.015677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065aa163-ad80-4612-be8b-2fbf6c343877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:42.016378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065aa163-ad80-4612-be8b-2fbf6c343877 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:42.016705 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065aa163-ad80-4612-be8b-2fbf6c343877 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:42.016990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065aa163-ad80-4612-be8b-2fbf6c343877 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:42.017736 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065aa163-ad80-4612-be8b-2fbf6c343877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:42.019349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065aa163-ad80-4612-be8b-2fbf6c343877 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:42.029412 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1244/2483] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:42.033708 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715b690-f671-4e72-ac0d-cbef2cfe3e4a admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:42.043855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715b690-f671-4e72-ac0d-cbef2cfe3e4a admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:42.049145 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ae9d4-7a8c-4619-a741-4d27af12479c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:42.049860 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ae9d4-7a8c-4619-a741-4d27af12479c admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:42.050136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ae9d4-7a8c-4619-a741-4d27af12479c admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:42.050408 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ae9d4-7a8c-4619-a741-4d27af12479c admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:42.051136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ae9d4-7a8c-4619-a741-4d27af12479c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:42.052787 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ae9d4-7a8c-4619-a741-4d27af12479c admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:42.065584 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1240/2484] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:42.070003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065aa163-ad80-4612-be8b-2fbf6c343877 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:42.080719 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065aa163-ad80-4612-be8b-2fbf6c343877 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:42.086384 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482ed47-ae20-4c7b-a0ca-274e257dd807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:42.087304 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482ed47-ae20-4c7b-a0ca-274e257dd807 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:42.087581 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482ed47-ae20-4c7b-a0ca-274e257dd807 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:42.087885 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482ed47-ae20-4c7b-a0ca-274e257dd807 admin admin] PATH_INFO: `/v3/projects/0967610683674744af59943f119e411e/users/52ddaf3bd1994993a06cec3c0550d3aa/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:42.104719 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482ed47-ae20-4c7b-a0ca-274e257dd807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0967610683674744af59943f119e411e, user_id=52ddaf3bd1994993a06cec3c0550d3aa, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:42.107421 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482ed47-ae20-4c7b-a0ca-274e257dd807 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:42.124401 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1245/2485] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:42 2022] PUT /identity/v3/projects/0967610683674744af59943f119e411e/users/52ddaf3bd1994993a06cec3c0550d3aa/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:42.136788 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9ab9-f138-4fe3-b219-6c3a53c0835d None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:42.137097 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9ab9-f138-4fe3-b219-6c3a53c0835d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:42.137369 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9ab9-f138-4fe3-b219-6c3a53c0835d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:42.168605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-636f9ab9-f138-4fe3-b219-6c3a53c0835d None None] MFA Rules not processed for user `52ddaf3bd1994993a06cec3c0550d3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:42.170508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-636f9ab9-f138-4fe3-b219-6c3a53c0835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:42.248874 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1241/2486] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:01:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:42.254334 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482ed47-ae20-4c7b-a0ca-274e257dd807 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:42.331702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482ed47-ae20-4c7b-a0ca-274e257dd807 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:42.337216 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949bfea-6226-4dcc-96cb-c6881c332d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:42.337894 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949bfea-6226-4dcc-96cb-c6881c332d1d admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:42.338175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949bfea-6226-4dcc-96cb-c6881c332d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:42.338445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949bfea-6226-4dcc-96cb-c6881c332d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:42.339252 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949bfea-6226-4dcc-96cb-c6881c332d1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:42.341350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949bfea-6226-4dcc-96cb-c6881c332d1d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:42.371476 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1246/2487] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:42 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:42.375701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f9ab9-f138-4fe3-b219-6c3a53c0835d None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:42.388409 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f9ab9-f138-4fe3-b219-6c3a53c0835d None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:42.449715 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca429e33-7a63-4238-b8cc-cf87614c316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:42.450440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca429e33-7a63-4238-b8cc-cf87614c316f admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:42.450717 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca429e33-7a63-4238-b8cc-cf87614c316f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:42.451004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca429e33-7a63-4238-b8cc-cf87614c316f admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:42.451702 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca429e33-7a63-4238-b8cc-cf87614c316f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:42.454485 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca429e33-7a63-4238-b8cc-cf87614c316f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:42.477229 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1242/2488] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:42 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:42.481339 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949bfea-6226-4dcc-96cb-c6881c332d1d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:42.492195 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949bfea-6226-4dcc-96cb-c6881c332d1d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:42.498018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8ea14-ab10-48e2-aea4-ccd8b43b1303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:42.498708 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8ea14-ab10-48e2-aea4-ccd8b43b1303 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:42.499592 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8ea14-ab10-48e2-aea4-ccd8b43b1303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:42.499592 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8ea14-ab10-48e2-aea4-ccd8b43b1303 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:42.500281 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8ea14-ab10-48e2-aea4-ccd8b43b1303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:42.502019 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8ea14-ab10-48e2-aea4-ccd8b43b1303 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:42.514348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1247/2489] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:42.519413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca429e33-7a63-4238-b8cc-cf87614c316f admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:42.529653 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca429e33-7a63-4238-b8cc-cf87614c316f admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:42.534696 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa091b-5cb2-4463-bc58-61c2f31b3323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:42.535591 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa091b-5cb2-4463-bc58-61c2f31b3323 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:42.535867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa091b-5cb2-4463-bc58-61c2f31b3323 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:42.536136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa091b-5cb2-4463-bc58-61c2f31b3323 admin admin] PATH_INFO: `/v3/projects/fbd87d5a8a61464582299c14f0648708/users/008336b688e94ddf8c70629bdcf4778d/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:42.552332 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa091b-5cb2-4463-bc58-61c2f31b3323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd87d5a8a61464582299c14f0648708, user_id=008336b688e94ddf8c70629bdcf4778d, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:42.555033 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa091b-5cb2-4463-bc58-61c2f31b3323 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:42.570953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1243/2490] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:42 2022] PUT /identity/v3/projects/fbd87d5a8a61464582299c14f0648708/users/008336b688e94ddf8c70629bdcf4778d/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:42.576640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8ea14-ab10-48e2-aea4-ccd8b43b1303 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:42.587406 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8ea14-ab10-48e2-aea4-ccd8b43b1303 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:42.653040 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1be62-c5fe-48cb-abd0-1d2836c437aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:42.653696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1be62-c5fe-48cb-abd0-1d2836c437aa admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:42.654015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1be62-c5fe-48cb-abd0-1d2836c437aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:42.654285 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1be62-c5fe-48cb-abd0-1d2836c437aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:42.655009 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1be62-c5fe-48cb-abd0-1d2836c437aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:42.656783 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1be62-c5fe-48cb-abd0-1d2836c437aa admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:42.667340 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1248/2491] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:42.672257 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa091b-5cb2-4463-bc58-61c2f31b3323 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:42.687378 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa091b-5cb2-4463-bc58-61c2f31b3323 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:42.695855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46ac06-6b25-4b6e-9904-6d6fd342f6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:42.697247 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46ac06-6b25-4b6e-9904-6d6fd342f6ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:42.697580 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46ac06-6b25-4b6e-9904-6d6fd342f6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:42.697931 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46ac06-6b25-4b6e-9904-6d6fd342f6ef admin admin] PATH_INFO: `/v3/projects/fbd87d5a8a61464582299c14f0648708/users/008336b688e94ddf8c70629bdcf4778d/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:42.700924 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46ac06-6b25-4b6e-9904-6d6fd342f6ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd87d5a8a61464582299c14f0648708, user_id=008336b688e94ddf8c70629bdcf4778d, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:42.705407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46ac06-6b25-4b6e-9904-6d6fd342f6ef admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:42.717764 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1244/2492] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:42 2022] PUT /identity/v3/projects/fbd87d5a8a61464582299c14f0648708/users/008336b688e94ddf8c70629bdcf4778d/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:42.728837 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6085e75-398f-4497-a0ac-0aef6a60b56b None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:42.729149 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6085e75-398f-4497-a0ac-0aef6a60b56b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:42.729371 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6085e75-398f-4497-a0ac-0aef6a60b56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:42.766014 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-f6085e75-398f-4497-a0ac-0aef6a60b56b None None] MFA Rules not processed for user `008336b688e94ddf8c70629bdcf4778d`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:42.767263 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f6085e75-398f-4497-a0ac-0aef6a60b56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:42.842316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1249/2493] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:01:42 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:42.856762 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46ac06-6b25-4b6e-9904-6d6fd342f6ef admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:42.858653 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-6c46ac06-6b25-4b6e-9904-6d6fd342f6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:42.924933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46ac06-6b25-4b6e-9904-6d6fd342f6ef admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:42.931586 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24397d-69bf-4214-865f-1adfdb529e57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:42.932665 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24397d-69bf-4214-865f-1adfdb529e57 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:42.933131 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24397d-69bf-4214-865f-1adfdb529e57 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:42.933406 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24397d-69bf-4214-865f-1adfdb529e57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:42.943746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24397d-69bf-4214-865f-1adfdb529e57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:42.945232 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24397d-69bf-4214-865f-1adfdb529e57 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:42.957875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1245/2494] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:42 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:43.007366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6085e75-398f-4497-a0ac-0aef6a60b56b None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:43.009133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f6085e75-398f-4497-a0ac-0aef6a60b56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:43.023857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6085e75-398f-4497-a0ac-0aef6a60b56b None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:43.032724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac281642-2c3c-4cbc-abf3-78fc32d648dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:43.034123 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac281642-2c3c-4cbc-abf3-78fc32d648dd service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:43.034403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac281642-2c3c-4cbc-abf3-78fc32d648dd service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:43.034671 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac281642-2c3c-4cbc-abf3-78fc32d648dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:43.095756 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac281642-2c3c-4cbc-abf3-78fc32d648dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:43.097193 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac281642-2c3c-4cbc-abf3-78fc32d648dd service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:43.109447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1250/2495] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:46.524645 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24397d-69bf-4214-865f-1adfdb529e57 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:46.591627 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24397d-69bf-4214-865f-1adfdb529e57 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:46.598500 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bd692-f5dc-4896-ab2c-6c9619229de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:46.599396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bd692-f5dc-4896-ab2c-6c9619229de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:46.599667 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bd692-f5dc-4896-ab2c-6c9619229de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:46.600057 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bd692-f5dc-4896-ab2c-6c9619229de1 admin admin] PATH_INFO: `/v3/users/52ddaf3bd1994993a06cec3c0550d3aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:46.601294 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bd692-f5dc-4896-ab2c-6c9619229de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ddaf3bd1994993a06cec3c0550d3aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:46.603242 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bd692-f5dc-4896-ab2c-6c9619229de1 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:46.660893 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-721bd692-f5dc-4896-ab2c-6c9619229de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ddaf3bd1994993a06cec3c0550d3aa'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:46.661663 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-721bd692-f5dc-4896-ab2c-6c9619229de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ddaf3bd1994993a06cec3c0550d3aa'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:46.675331 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-721bd692-f5dc-4896-ab2c-6c9619229de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ddaf3bd1994993a06cec3c0550d3aa'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:46.675969 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-721bd692-f5dc-4896-ab2c-6c9619229de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ddaf3bd1994993a06cec3c0550d3aa'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:46.685891 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-721bd692-f5dc-4896-ab2c-6c9619229de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ddaf3bd1994993a06cec3c0550d3aa'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:46.699290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1246/2496] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:46 2022] DELETE /identity/v3/users/52ddaf3bd1994993a06cec3c0550d3aa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:46.704150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe84b53-f3a2-4e69-8738-47b593ab59c6 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:46.704678 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe84b53-f3a2-4e69-8738-47b593ab59c6 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:46.704789 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe84b53-f3a2-4e69-8738-47b593ab59c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:46.723569 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-1fe84b53-f3a2-4e69-8738-47b593ab59c6 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:46.724797 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1fe84b53-f3a2-4e69-8738-47b593ab59c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:46.789212 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1251/2497] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:01:46.803668 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bd692-f5dc-4896-ab2c-6c9619229de1 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:46.805313 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-721bd692-f5dc-4896-ab2c-6c9619229de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:46.869543 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bd692-f5dc-4896-ab2c-6c9619229de1 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:46.873321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394f118-8bf4-4fef-9657-222280820472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:46.874015 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394f118-8bf4-4fef-9657-222280820472 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:46.874292 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394f118-8bf4-4fef-9657-222280820472 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:46.874567 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394f118-8bf4-4fef-9657-222280820472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:46.884024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394f118-8bf4-4fef-9657-222280820472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:46.885498 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394f118-8bf4-4fef-9657-222280820472 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:46.896949 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1247/2498] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:01:47.195391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe84b53-f3a2-4e69-8738-47b593ab59c6 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:47.196926 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1fe84b53-f3a2-4e69-8738-47b593ab59c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:47.210372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe84b53-f3a2-4e69-8738-47b593ab59c6 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:47.216749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:47.218068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:47.218348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:47.218651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9 admin admin] PATH_INFO: `/v3/projects/0967610683674744af59943f119e411e` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:47.220052 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0967610683674744af59943f119e411e)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:47.222923 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:47.271857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0967610683674744af59943f119e411e', 'request_id': 'req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:47.281310 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0967610683674744af59943f119e411e', 'request_id': 'req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:47.288530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0967610683674744af59943f119e411e', 'request_id': 'req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:47.302280 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9 admin admin] The token cache is being invalidate because project 0967610683674744af59943f119e411e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:47.302574 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:47.303484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:47.305118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1252/2499] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:47 2022] DELETE /identity/v3/projects/0967610683674744af59943f119e411e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:47.309755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394f118-8bf4-4fef-9657-222280820472 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:47.319434 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394f118-8bf4-4fef-9657-222280820472 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:47.376991 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259e836-6838-4191-9431-4fba06eee486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:47.377872 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259e836-6838-4191-9431-4fba06eee486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:47.378148 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259e836-6838-4191-9431-4fba06eee486 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:47.378421 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259e836-6838-4191-9431-4fba06eee486 admin admin] PATH_INFO: `/v3/users/008336b688e94ddf8c70629bdcf4778d` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:47.379610 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259e836-6838-4191-9431-4fba06eee486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=008336b688e94ddf8c70629bdcf4778d)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:47.381576 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259e836-6838-4191-9431-4fba06eee486 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:47.430298 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-2259e836-6838-4191-9431-4fba06eee486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008336b688e94ddf8c70629bdcf4778d'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:47.430962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-2259e836-6838-4191-9431-4fba06eee486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008336b688e94ddf8c70629bdcf4778d'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:47.443647 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-2259e836-6838-4191-9431-4fba06eee486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008336b688e94ddf8c70629bdcf4778d'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:47.444447 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-2259e836-6838-4191-9431-4fba06eee486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008336b688e94ddf8c70629bdcf4778d'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:47.452721 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-2259e836-6838-4191-9431-4fba06eee486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008336b688e94ddf8c70629bdcf4778d'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:47.465502 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1248/2500] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:47 2022] DELETE /identity/v3/users/008336b688e94ddf8c70629bdcf4778d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:47.745220 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:47.746875 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:47.760380 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0b355-2ea5-4cda-a14e-7627fbf2b2b9 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:47.819548 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5cdb8-cd2c-4004-bbef-f8693b9d650c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:47.820387 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5cdb8-cd2c-4004-bbef-f8693b9d650c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:47.820658 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5cdb8-cd2c-4004-bbef-f8693b9d650c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:47.820922 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5cdb8-cd2c-4004-bbef-f8693b9d650c admin admin] PATH_INFO: `/v3/projects/fbd87d5a8a61464582299c14f0648708` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:47.822157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5cdb8-cd2c-4004-bbef-f8693b9d650c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd87d5a8a61464582299c14f0648708)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:47.824086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5cdb8-cd2c-4004-bbef-f8693b9d650c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:47.871289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6ec5cdb8-cd2c-4004-bbef-f8693b9d650c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd87d5a8a61464582299c14f0648708', 'request_id': 'req-6ec5cdb8-cd2c-4004-bbef-f8693b9d650c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:47.879598 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6ec5cdb8-cd2c-4004-bbef-f8693b9d650c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd87d5a8a61464582299c14f0648708', 'request_id': 'req-6ec5cdb8-cd2c-4004-bbef-f8693b9d650c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:47.886023 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6ec5cdb8-cd2c-4004-bbef-f8693b9d650c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd87d5a8a61464582299c14f0648708', 'request_id': 'req-6ec5cdb8-cd2c-4004-bbef-f8693b9d650c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:47.897234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6ec5cdb8-cd2c-4004-bbef-f8693b9d650c admin admin] The token cache is being invalidate because project fbd87d5a8a61464582299c14f0648708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:47.897514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6ec5cdb8-cd2c-4004-bbef-f8693b9d650c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:47.898176 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6ec5cdb8-cd2c-4004-bbef-f8693b9d650c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:47.899747 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1253/2501] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:47 2022] DELETE /identity/v3/projects/fbd87d5a8a61464582299c14f0648708 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:47.905369 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc2da6-8998-484d-a384-313ce6f668bc None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:47.905965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc2da6-8998-484d-a384-313ce6f668bc None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:47.905965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc2da6-8998-484d-a384-313ce6f668bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:47.926239 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-50fc2da6-8998-484d-a384-313ce6f668bc None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:47.927462 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-50fc2da6-8998-484d-a384-313ce6f668bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:47.990469 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1249/2502] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:48.003857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db23282-f1c0-4fb0-863c-1bfe5f9aa93d None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.004228 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db23282-f1c0-4fb0-863c-1bfe5f9aa93d None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.004556 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db23282-f1c0-4fb0-863c-1bfe5f9aa93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.031934 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-8db23282-f1c0-4fb0-863c-1bfe5f9aa93d None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:48.033215 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8db23282-f1c0-4fb0-863c-1bfe5f9aa93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:48.042573 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1254/2503] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:48.047440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc2da6-8998-484d-a384-313ce6f668bc None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:48.057922 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc2da6-8998-484d-a384-313ce6f668bc None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:48.063933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e89241-c8bc-4a4a-99dc-239266b60699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:48.064642 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e89241-c8bc-4a4a-99dc-239266b60699 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.064920 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e89241-c8bc-4a4a-99dc-239266b60699 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.065183 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e89241-c8bc-4a4a-99dc-239266b60699 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.065936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e89241-c8bc-4a4a-99dc-239266b60699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:01:48.066237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e89241-c8bc-4a4a-99dc-239266b60699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:48.067875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e89241-c8bc-4a4a-99dc-239266b60699 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:48.082184 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1250/2504] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:01:48.086918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db23282-f1c0-4fb0-863c-1bfe5f9aa93d None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:48.096695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db23282-f1c0-4fb0-863c-1bfe5f9aa93d None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:48.102090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b254a-cf8b-4d68-8a22-5170e56fcb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:48.102733 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b254a-cf8b-4d68-8a22-5170e56fcb39 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.103013 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b254a-cf8b-4d68-8a22-5170e56fcb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.103276 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b254a-cf8b-4d68-8a22-5170e56fcb39 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.103968 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b254a-cf8b-4d68-8a22-5170e56fcb39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:48.106020 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b254a-cf8b-4d68-8a22-5170e56fcb39 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:48.133990 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1255/2505] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:48 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:48.138960 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e89241-c8bc-4a4a-99dc-239266b60699 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:48.149811 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e89241-c8bc-4a4a-99dc-239266b60699 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:48.216754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ffdca-5253-43e5-90c5-35c899fc7d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:48.217468 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ffdca-5253-43e5-90c5-35c899fc7d92 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.217760 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ffdca-5253-43e5-90c5-35c899fc7d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.217977 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ffdca-5253-43e5-90c5-35c899fc7d92 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.218691 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ffdca-5253-43e5-90c5-35c899fc7d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:48.221261 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ffdca-5253-43e5-90c5-35c899fc7d92 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:48.243323 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1251/2506] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:48 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:48.247563 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b254a-cf8b-4d68-8a22-5170e56fcb39 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:48.259104 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b254a-cf8b-4d68-8a22-5170e56fcb39 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:48.264820 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3613c-def3-43a8-adbe-6996c955d74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:48.265541 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3613c-def3-43a8-adbe-6996c955d74b admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.265830 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3613c-def3-43a8-adbe-6996c955d74b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.266238 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3613c-def3-43a8-adbe-6996c955d74b admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.266936 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3613c-def3-43a8-adbe-6996c955d74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:48.268751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3613c-def3-43a8-adbe-6996c955d74b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:48.280629 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1256/2507] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:01:48.285146 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ffdca-5253-43e5-90c5-35c899fc7d92 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:48.295436 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ffdca-5253-43e5-90c5-35c899fc7d92 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:48.300773 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd33af-dce2-463e-8a20-8ac89caba663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:48.301448 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd33af-dce2-463e-8a20-8ac89caba663 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.301722 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd33af-dce2-463e-8a20-8ac89caba663 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.302458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd33af-dce2-463e-8a20-8ac89caba663 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.302710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd33af-dce2-463e-8a20-8ac89caba663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:48.305158 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd33af-dce2-463e-8a20-8ac89caba663 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:48.317100 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1252/2508] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:48.321630 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3613c-def3-43a8-adbe-6996c955d74b admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:48.337532 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3613c-def3-43a8-adbe-6996c955d74b admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:48.343995 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa722f-11c2-4e9b-b78f-591f140209c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:48.344945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa722f-11c2-4e9b-b78f-591f140209c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.345232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa722f-11c2-4e9b-b78f-591f140209c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.345511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa722f-11c2-4e9b-b78f-591f140209c1 admin admin] PATH_INFO: `/v3/projects/d60cd24c096b4b25982787fd2542a2ed/users/71a52258fe8c4db5812fdc749a144425/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.362405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa722f-11c2-4e9b-b78f-591f140209c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60cd24c096b4b25982787fd2542a2ed, user_id=71a52258fe8c4db5812fdc749a144425, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:48.365110 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa722f-11c2-4e9b-b78f-591f140209c1 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:48.379521 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1257/2509] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:48 2022] PUT /identity/v3/projects/d60cd24c096b4b25982787fd2542a2ed/users/71a52258fe8c4db5812fdc749a144425/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:48.390961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e398220-79eb-4f79-bf9b-dbde03c9a75c None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.391247 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e398220-79eb-4f79-bf9b-dbde03c9a75c None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.391529 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e398220-79eb-4f79-bf9b-dbde03c9a75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.419624 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-6e398220-79eb-4f79-bf9b-dbde03c9a75c None None] MFA Rules not processed for user `71a52258fe8c4db5812fdc749a144425`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:48.420890 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-6e398220-79eb-4f79-bf9b-dbde03c9a75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:48.486285 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1253/2510] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:01:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:48.493724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa722f-11c2-4e9b-b78f-591f140209c1 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:48.558734 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa722f-11c2-4e9b-b78f-591f140209c1 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:48.563864 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133385d-e5f9-43ba-9c53-c8d4dfedd9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:48.564560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133385d-e5f9-43ba-9c53-c8d4dfedd9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.564837 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133385d-e5f9-43ba-9c53-c8d4dfedd9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.565103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133385d-e5f9-43ba-9c53-c8d4dfedd9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.565908 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133385d-e5f9-43ba-9c53-c8d4dfedd9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:48.567842 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133385d-e5f9-43ba-9c53-c8d4dfedd9b6 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:48.595681 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1258/2511] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:48 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:48.600742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e398220-79eb-4f79-bf9b-dbde03c9a75c None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:48.613218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e398220-79eb-4f79-bf9b-dbde03c9a75c None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:48.675674 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da9d36-8665-4a32-8265-9e3f41be88cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:48.676434 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da9d36-8665-4a32-8265-9e3f41be88cc admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.676707 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da9d36-8665-4a32-8265-9e3f41be88cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.676963 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da9d36-8665-4a32-8265-9e3f41be88cc admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.677701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da9d36-8665-4a32-8265-9e3f41be88cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:48.679802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da9d36-8665-4a32-8265-9e3f41be88cc admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:48.705948 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1254/2512] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:48 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:48.707210 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133385d-e5f9-43ba-9c53-c8d4dfedd9b6 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:48.718510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133385d-e5f9-43ba-9c53-c8d4dfedd9b6 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:48.723691 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c0e21-e403-425b-8b82-30e80c5573d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:48.724430 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c0e21-e403-425b-8b82-30e80c5573d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.724712 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c0e21-e403-425b-8b82-30e80c5573d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.724987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c0e21-e403-425b-8b82-30e80c5573d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.725951 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c0e21-e403-425b-8b82-30e80c5573d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:48.727617 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c0e21-e403-425b-8b82-30e80c5573d3 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:48.740091 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1259/2513] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:48.745031 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da9d36-8665-4a32-8265-9e3f41be88cc admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:48.756425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da9d36-8665-4a32-8265-9e3f41be88cc admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:48.761447 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952a1c7-26ce-4962-9372-b26ee9278518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:48.762235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952a1c7-26ce-4962-9372-b26ee9278518 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.762816 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952a1c7-26ce-4962-9372-b26ee9278518 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.763098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952a1c7-26ce-4962-9372-b26ee9278518 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.763845 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952a1c7-26ce-4962-9372-b26ee9278518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:48.765475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952a1c7-26ce-4962-9372-b26ee9278518 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:48.780545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1255/2514] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:48.781807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c0e21-e403-425b-8b82-30e80c5573d3 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:48.793158 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c0e21-e403-425b-8b82-30e80c5573d3 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:48.799538 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01760093-15f8-43f2-a025-ea97ef14b91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:48.800685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01760093-15f8-43f2-a025-ea97ef14b91f admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.801050 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01760093-15f8-43f2-a025-ea97ef14b91f admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.801315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01760093-15f8-43f2-a025-ea97ef14b91f admin admin] PATH_INFO: `/v3/projects/6fe71093489e47b295c71bd37ca7bc3b/users/19213273da2a496bad003ff738893c2a/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.818828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01760093-15f8-43f2-a025-ea97ef14b91f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe71093489e47b295c71bd37ca7bc3b, user_id=19213273da2a496bad003ff738893c2a, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:48.821702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01760093-15f8-43f2-a025-ea97ef14b91f admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:48.838111 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1260/2515] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:48 2022] PUT /identity/v3/projects/6fe71093489e47b295c71bd37ca7bc3b/users/19213273da2a496bad003ff738893c2a/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:48.849413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5b63c-7bfb-47c5-8870-ca978bc4fc4b None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.849618 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5b63c-7bfb-47c5-8870-ca978bc4fc4b None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.849876 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5b63c-7bfb-47c5-8870-ca978bc4fc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.878505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-95a5b63c-7bfb-47c5-8870-ca978bc4fc4b None None] MFA Rules not processed for user `19213273da2a496bad003ff738893c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:48.879769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-95a5b63c-7bfb-47c5-8870-ca978bc4fc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:48.952880 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1256/2516] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:01:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:01:48.957325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01760093-15f8-43f2-a025-ea97ef14b91f admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:49.022955 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01760093-15f8-43f2-a025-ea97ef14b91f admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:49.027781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7d35a-5a2e-407d-8ba6-5ccc33dac222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:49.028493 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7d35a-5a2e-407d-8ba6-5ccc33dac222 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:49.028774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7d35a-5a2e-407d-8ba6-5ccc33dac222 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:49.029040 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7d35a-5a2e-407d-8ba6-5ccc33dac222 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:49.029784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7d35a-5a2e-407d-8ba6-5ccc33dac222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:49.031773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7d35a-5a2e-407d-8ba6-5ccc33dac222 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:49.058744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1261/2517] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:48 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:01:49.063366 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5b63c-7bfb-47c5-8870-ca978bc4fc4b None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:49.074836 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5b63c-7bfb-47c5-8870-ca978bc4fc4b None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:49.143523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5862ab-895f-48df-af77-4c213ee6c6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:49.144706 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5862ab-895f-48df-af77-4c213ee6c6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:49.145203 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5862ab-895f-48df-af77-4c213ee6c6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:49.145705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5862ab-895f-48df-af77-4c213ee6c6b9 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:49.146965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5862ab-895f-48df-af77-4c213ee6c6b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:49.150665 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5862ab-895f-48df-af77-4c213ee6c6b9 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:49.182980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1257/2518] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:49 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:49.187580 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7d35a-5a2e-407d-8ba6-5ccc33dac222 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:49.207971 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7d35a-5a2e-407d-8ba6-5ccc33dac222 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:49.213003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0f428-ecf1-4bbd-95d8-365ba011053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:49.213865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0f428-ecf1-4bbd-95d8-365ba011053a admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:49.214261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0f428-ecf1-4bbd-95d8-365ba011053a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:49.215368 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0f428-ecf1-4bbd-95d8-365ba011053a admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:49.216138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0f428-ecf1-4bbd-95d8-365ba011053a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:49.217981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0f428-ecf1-4bbd-95d8-365ba011053a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:49.230385 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1262/2519] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:49.234954 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5862ab-895f-48df-af77-4c213ee6c6b9 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:49.245584 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5862ab-895f-48df-af77-4c213ee6c6b9 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:49.250774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523db250-1786-4091-8eda-5824a151b7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:49.251697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523db250-1786-4091-8eda-5824a151b7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:49.252032 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523db250-1786-4091-8eda-5824a151b7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:49.252338 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523db250-1786-4091-8eda-5824a151b7e2 admin admin] PATH_INFO: `/v3/projects/76521e4f5f524b7e9d21874291bd7235/users/e6ba2cf2a2074edda57def17a53cfc69/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:49.269093 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523db250-1786-4091-8eda-5824a151b7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76521e4f5f524b7e9d21874291bd7235, user_id=e6ba2cf2a2074edda57def17a53cfc69, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:49.271809 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523db250-1786-4091-8eda-5824a151b7e2 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:49.288963 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1258/2520] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:49 2022] PUT /identity/v3/projects/76521e4f5f524b7e9d21874291bd7235/users/e6ba2cf2a2074edda57def17a53cfc69/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:49.293424 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0f428-ecf1-4bbd-95d8-365ba011053a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:49.303996 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0f428-ecf1-4bbd-95d8-365ba011053a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:49.364357 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7481c-7fdd-487e-b059-8ca3933ab466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:49.365457 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7481c-7fdd-487e-b059-8ca3933ab466 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:49.365734 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7481c-7fdd-487e-b059-8ca3933ab466 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:49.365991 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7481c-7fdd-487e-b059-8ca3933ab466 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:49.366745 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7481c-7fdd-487e-b059-8ca3933ab466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:49.368385 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7481c-7fdd-487e-b059-8ca3933ab466 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:49.378840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1263/2521] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:49.383200 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523db250-1786-4091-8eda-5824a151b7e2 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:49.395300 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523db250-1786-4091-8eda-5824a151b7e2 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:49.413139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd940e8-2b32-46f8-b444-dae44ebef740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:49.414095 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd940e8-2b32-46f8-b444-dae44ebef740 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:49.414377 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd940e8-2b32-46f8-b444-dae44ebef740 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:49.414652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd940e8-2b32-46f8-b444-dae44ebef740 admin admin] PATH_INFO: `/v3/projects/76521e4f5f524b7e9d21874291bd7235/users/e6ba2cf2a2074edda57def17a53cfc69/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:49.417011 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd940e8-2b32-46f8-b444-dae44ebef740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76521e4f5f524b7e9d21874291bd7235, user_id=e6ba2cf2a2074edda57def17a53cfc69, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:49.419883 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd940e8-2b32-46f8-b444-dae44ebef740 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:49.444231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1259/2522] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:49 2022] PUT /identity/v3/projects/76521e4f5f524b7e9d21874291bd7235/users/e6ba2cf2a2074edda57def17a53cfc69/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:49.446402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caf90b-95c4-42b7-8e3c-aa112b442b1f None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:49.446685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caf90b-95c4-42b7-8e3c-aa112b442b1f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:49.446954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caf90b-95c4-42b7-8e3c-aa112b442b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:49.482151 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-55caf90b-95c4-42b7-8e3c-aa112b442b1f None None] MFA Rules not processed for user `e6ba2cf2a2074edda57def17a53cfc69`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:49.483495 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-55caf90b-95c4-42b7-8e3c-aa112b442b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:49.597780 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1264/2523] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:01:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:49.611881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd940e8-2b32-46f8-b444-dae44ebef740 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:49.614141 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ddd940e8-2b32-46f8-b444-dae44ebef740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:49.686343 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd940e8-2b32-46f8-b444-dae44ebef740 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:49.691055 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247d11a-eba4-44a6-8b3e-ebee98f7a032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:49.691901 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d11a-eba4-44a6-8b3e-ebee98f7a032 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:49.692358 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d11a-eba4-44a6-8b3e-ebee98f7a032 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:49.692731 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d11a-eba4-44a6-8b3e-ebee98f7a032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:49.704485 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247d11a-eba4-44a6-8b3e-ebee98f7a032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:49.706442 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247d11a-eba4-44a6-8b3e-ebee98f7a032 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:49.732507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1260/2524] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:50.272851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caf90b-95c4-42b7-8e3c-aa112b442b1f None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:50.274692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-55caf90b-95c4-42b7-8e3c-aa112b442b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:50.288826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caf90b-95c4-42b7-8e3c-aa112b442b1f None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:50.294389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f578d-079e-4ff7-9a2d-89f066679f8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:50.295043 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f578d-079e-4ff7-9a2d-89f066679f8c service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:50.295324 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f578d-079e-4ff7-9a2d-89f066679f8c service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:50.295597 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f578d-079e-4ff7-9a2d-89f066679f8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:50.356979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f578d-079e-4ff7-9a2d-89f066679f8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:50.358702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f578d-079e-4ff7-9a2d-89f066679f8c service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:50.368077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1265/2525] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:52.663624 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9916c-6418-4118-bf21-e1510153b32e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:52.664165 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9916c-6418-4118-bf21-e1510153b32e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:52.664319 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9916c-6418-4118-bf21-e1510153b32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:52.683126 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e0d9916c-6418-4118-bf21-e1510153b32e None None] MFA Rules not processed for user `3a45298a10af4fc3991887cb4da55e86`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:52.684387 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e0d9916c-6418-4118-bf21-e1510153b32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:52.746570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1261/2526] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:01:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:54.569097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f578d-079e-4ff7-9a2d-89f066679f8c service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:54.582497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f578d-079e-4ff7-9a2d-89f066679f8c service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:54.586596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d412c-b7de-4232-b203-3309f25a1356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:54.587341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d412c-b7de-4232-b203-3309f25a1356 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:54.587915 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d412c-b7de-4232-b203-3309f25a1356 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:54.588567 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d412c-b7de-4232-b203-3309f25a1356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:54.666981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d412c-b7de-4232-b203-3309f25a1356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:54.669150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d412c-b7de-4232-b203-3309f25a1356 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:54.679787 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1266/2527] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:01:56.942336 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9916c-6418-4118-bf21-e1510153b32e None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:57.034499 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9916c-6418-4118-bf21-e1510153b32e None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:57.039175 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df52ed2-dbab-43c2-8f56-7b30ef7fc474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:57.040094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df52ed2-dbab-43c2-8f56-7b30ef7fc474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:57.040394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df52ed2-dbab-43c2-8f56-7b30ef7fc474 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:57.040667 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df52ed2-dbab-43c2-8f56-7b30ef7fc474 admin admin] PATH_INFO: `/v3/users/71a52258fe8c4db5812fdc749a144425` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:57.041883 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df52ed2-dbab-43c2-8f56-7b30ef7fc474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a52258fe8c4db5812fdc749a144425)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:57.043900 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df52ed2-dbab-43c2-8f56-7b30ef7fc474 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:57.109955 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8df52ed2-dbab-43c2-8f56-7b30ef7fc474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a52258fe8c4db5812fdc749a144425'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:57.111028 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8df52ed2-dbab-43c2-8f56-7b30ef7fc474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a52258fe8c4db5812fdc749a144425'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:57.125549 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8df52ed2-dbab-43c2-8f56-7b30ef7fc474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a52258fe8c4db5812fdc749a144425'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:57.126313 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8df52ed2-dbab-43c2-8f56-7b30ef7fc474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a52258fe8c4db5812fdc749a144425'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:57.135664 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8df52ed2-dbab-43c2-8f56-7b30ef7fc474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a52258fe8c4db5812fdc749a144425'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:57.151931 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1262/2528] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:56 2022] DELETE /identity/v3/users/71a52258fe8c4db5812fdc749a144425 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:57.156483 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1df15-e92b-4933-b517-ce92d57eebb3 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:57.157216 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1df15-e92b-4933-b517-ce92d57eebb3 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:57.157216 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1df15-e92b-4933-b517-ce92d57eebb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:57.175975 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-16e1df15-e92b-4933-b517-ce92d57eebb3 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:57.177317 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-16e1df15-e92b-4933-b517-ce92d57eebb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:57.246704 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1267/2529] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:57.258783 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df52ed2-dbab-43c2-8f56-7b30ef7fc474 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:57.260567 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-8df52ed2-dbab-43c2-8f56-7b30ef7fc474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:57.333973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df52ed2-dbab-43c2-8f56-7b30ef7fc474 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:57.338583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fe0f9-a2b6-442f-a818-d7789f2d4ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:57.339444 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fe0f9-a2b6-442f-a818-d7789f2d4ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:57.339843 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fe0f9-a2b6-442f-a818-d7789f2d4ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:57.340234 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fe0f9-a2b6-442f-a818-d7789f2d4ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:57.352549 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fe0f9-a2b6-442f-a818-d7789f2d4ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:57.356887 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fe0f9-a2b6-442f-a818-d7789f2d4ed4 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:57.368714 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1263/2530] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:57.736496 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1df15-e92b-4933-b517-ce92d57eebb3 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:57.738413 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-16e1df15-e92b-4933-b517-ce92d57eebb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:57.754291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1df15-e92b-4933-b517-ce92d57eebb3 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:57.767079 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109863db-7a92-44af-9ff5-174dd05a2299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:57.769933 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109863db-7a92-44af-9ff5-174dd05a2299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:57.770349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109863db-7a92-44af-9ff5-174dd05a2299 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:57.770814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109863db-7a92-44af-9ff5-174dd05a2299 admin admin] PATH_INFO: `/v3/projects/d60cd24c096b4b25982787fd2542a2ed` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:57.773552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109863db-7a92-44af-9ff5-174dd05a2299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60cd24c096b4b25982787fd2542a2ed)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:57.777741 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109863db-7a92-44af-9ff5-174dd05a2299 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:57.831467 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-109863db-7a92-44af-9ff5-174dd05a2299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60cd24c096b4b25982787fd2542a2ed', 'request_id': 'req-109863db-7a92-44af-9ff5-174dd05a2299'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:57.840016 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-109863db-7a92-44af-9ff5-174dd05a2299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60cd24c096b4b25982787fd2542a2ed', 'request_id': 'req-109863db-7a92-44af-9ff5-174dd05a2299'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:57.847520 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-109863db-7a92-44af-9ff5-174dd05a2299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60cd24c096b4b25982787fd2542a2ed', 'request_id': 'req-109863db-7a92-44af-9ff5-174dd05a2299'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:57.859534 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-109863db-7a92-44af-9ff5-174dd05a2299 admin admin] The token cache is being invalidate because project d60cd24c096b4b25982787fd2542a2ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:57.859818 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-109863db-7a92-44af-9ff5-174dd05a2299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:57.860543 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-109863db-7a92-44af-9ff5-174dd05a2299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:57.862191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1268/2531] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:57 2022] DELETE /identity/v3/projects/d60cd24c096b4b25982787fd2542a2ed => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:57.868572 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fe0f9-a2b6-442f-a818-d7789f2d4ed4 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:57.882670 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fe0f9-a2b6-442f-a818-d7789f2d4ed4 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:57.956501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5e1d1-1431-44bb-a4ed-44eb61b013e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:57.957851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5e1d1-1431-44bb-a4ed-44eb61b013e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:57.958221 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5e1d1-1431-44bb-a4ed-44eb61b013e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:57.958587 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5e1d1-1431-44bb-a4ed-44eb61b013e8 admin admin] PATH_INFO: `/v3/users/19213273da2a496bad003ff738893c2a` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:57.960013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5e1d1-1431-44bb-a4ed-44eb61b013e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19213273da2a496bad003ff738893c2a)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:57.962139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5e1d1-1431-44bb-a4ed-44eb61b013e8 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:58.017860 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36e5e1d1-1431-44bb-a4ed-44eb61b013e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19213273da2a496bad003ff738893c2a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:58.018441 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36e5e1d1-1431-44bb-a4ed-44eb61b013e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19213273da2a496bad003ff738893c2a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:58.032882 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36e5e1d1-1431-44bb-a4ed-44eb61b013e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19213273da2a496bad003ff738893c2a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:58.033757 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36e5e1d1-1431-44bb-a4ed-44eb61b013e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19213273da2a496bad003ff738893c2a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:58.041747 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36e5e1d1-1431-44bb-a4ed-44eb61b013e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19213273da2a496bad003ff738893c2a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:58.055212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1264/2532] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:57 2022] DELETE /identity/v3/users/19213273da2a496bad003ff738893c2a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:58.339574 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109863db-7a92-44af-9ff5-174dd05a2299 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:58.341212 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-109863db-7a92-44af-9ff5-174dd05a2299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:58.364743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109863db-7a92-44af-9ff5-174dd05a2299 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:58.424060 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383b151-92c0-41d5-a551-78771cd8e7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:58.425029 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383b151-92c0-41d5-a551-78771cd8e7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:58.425310 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383b151-92c0-41d5-a551-78771cd8e7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:58.425728 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383b151-92c0-41d5-a551-78771cd8e7b4 admin admin] PATH_INFO: `/v3/projects/6fe71093489e47b295c71bd37ca7bc3b` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:58.427273 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383b151-92c0-41d5-a551-78771cd8e7b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe71093489e47b295c71bd37ca7bc3b)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:58.429254 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383b151-92c0-41d5-a551-78771cd8e7b4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:58.476638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4383b151-92c0-41d5-a551-78771cd8e7b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe71093489e47b295c71bd37ca7bc3b', 'request_id': 'req-4383b151-92c0-41d5-a551-78771cd8e7b4'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:58.484859 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4383b151-92c0-41d5-a551-78771cd8e7b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe71093489e47b295c71bd37ca7bc3b', 'request_id': 'req-4383b151-92c0-41d5-a551-78771cd8e7b4'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:58.491063 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4383b151-92c0-41d5-a551-78771cd8e7b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe71093489e47b295c71bd37ca7bc3b', 'request_id': 'req-4383b151-92c0-41d5-a551-78771cd8e7b4'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:58.501415 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4383b151-92c0-41d5-a551-78771cd8e7b4 admin admin] The token cache is being invalidate because project 6fe71093489e47b295c71bd37ca7bc3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:58.501707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4383b151-92c0-41d5-a551-78771cd8e7b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:58.502339 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4383b151-92c0-41d5-a551-78771cd8e7b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:58.504146 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1269/2533] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:58 2022] DELETE /identity/v3/projects/6fe71093489e47b295c71bd37ca7bc3b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:58.508169 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5e1d1-1431-44bb-a4ed-44eb61b013e8 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:58.509665 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-36e5e1d1-1431-44bb-a4ed-44eb61b013e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:58.523578 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5e1d1-1431-44bb-a4ed-44eb61b013e8 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:58.580987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c65e5-8736-4c7c-a198-5254822a5f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:58.581804 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c65e5-8736-4c7c-a198-5254822a5f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:58.582083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c65e5-8736-4c7c-a198-5254822a5f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:58.582359 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c65e5-8736-4c7c-a198-5254822a5f1e admin admin] PATH_INFO: `/v3/users/e6ba2cf2a2074edda57def17a53cfc69` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:58.583637 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c65e5-8736-4c7c-a198-5254822a5f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ba2cf2a2074edda57def17a53cfc69)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:58.585625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c65e5-8736-4c7c-a198-5254822a5f1e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:58.642977 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f58c65e5-8736-4c7c-a198-5254822a5f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ba2cf2a2074edda57def17a53cfc69'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:58.643840 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f58c65e5-8736-4c7c-a198-5254822a5f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ba2cf2a2074edda57def17a53cfc69'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:58.657672 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f58c65e5-8736-4c7c-a198-5254822a5f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ba2cf2a2074edda57def17a53cfc69'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:58.658451 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f58c65e5-8736-4c7c-a198-5254822a5f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ba2cf2a2074edda57def17a53cfc69'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:58.667302 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f58c65e5-8736-4c7c-a198-5254822a5f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ba2cf2a2074edda57def17a53cfc69'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:58.680186 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1265/2534] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:58 2022] DELETE /identity/v3/users/e6ba2cf2a2074edda57def17a53cfc69 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:58.974750 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383b151-92c0-41d5-a551-78771cd8e7b4 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:58.977268 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4383b151-92c0-41d5-a551-78771cd8e7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:58.996599 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383b151-92c0-41d5-a551-78771cd8e7b4 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:59.065619 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e3fd8-b643-401d-a77e-56c92602d02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:59.066496 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3fd8-b643-401d-a77e-56c92602d02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:59.066775 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3fd8-b643-401d-a77e-56c92602d02d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:59.067046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3fd8-b643-401d-a77e-56c92602d02d admin admin] PATH_INFO: `/v3/projects/76521e4f5f524b7e9d21874291bd7235` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:59.068343 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e3fd8-b643-401d-a77e-56c92602d02d admin admin] RBAC: Authorizing `identity:delete_project(project_id=76521e4f5f524b7e9d21874291bd7235)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:59.070267 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e3fd8-b643-401d-a77e-56c92602d02d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:59.122241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-cb8e3fd8-b643-401d-a77e-56c92602d02d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76521e4f5f524b7e9d21874291bd7235', 'request_id': 'req-cb8e3fd8-b643-401d-a77e-56c92602d02d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:59.131079 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-cb8e3fd8-b643-401d-a77e-56c92602d02d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76521e4f5f524b7e9d21874291bd7235', 'request_id': 'req-cb8e3fd8-b643-401d-a77e-56c92602d02d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:59.138102 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-cb8e3fd8-b643-401d-a77e-56c92602d02d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76521e4f5f524b7e9d21874291bd7235', 'request_id': 'req-cb8e3fd8-b643-401d-a77e-56c92602d02d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:59.148542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-cb8e3fd8-b643-401d-a77e-56c92602d02d admin admin] The token cache is being invalidate because project 76521e4f5f524b7e9d21874291bd7235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:59.148828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-cb8e3fd8-b643-401d-a77e-56c92602d02d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:59.149455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-cb8e3fd8-b643-401d-a77e-56c92602d02d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:59.151059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1270/2535] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:58 2022] DELETE /identity/v3/projects/76521e4f5f524b7e9d21874291bd7235 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:59.157459 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e79a5-1e8a-4ce6-8fa0-2ca8e42e5ab7 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:59.157993 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e79a5-1e8a-4ce6-8fa0-2ca8e42e5ab7 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:59.157993 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e79a5-1e8a-4ce6-8fa0-2ca8e42e5ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:59.178881 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-846e79a5-1e8a-4ce6-8fa0-2ca8e42e5ab7 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:59.180101 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-846e79a5-1e8a-4ce6-8fa0-2ca8e42e5ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:59.245299 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1266/2536] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:59.255286 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcffc6-48bd-4150-b6fa-5de5ed9afa62 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:59.255568 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcffc6-48bd-4150-b6fa-5de5ed9afa62 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:59.255896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcffc6-48bd-4150-b6fa-5de5ed9afa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:59.282753 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-fbbcffc6-48bd-4150-b6fa-5de5ed9afa62 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:59.283966 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-fbbcffc6-48bd-4150-b6fa-5de5ed9afa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:59.293464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1271/2537] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:59.298397 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e79a5-1e8a-4ce6-8fa0-2ca8e42e5ab7 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:59.309372 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e79a5-1e8a-4ce6-8fa0-2ca8e42e5ab7 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:59.316452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ea812-6d6d-44e6-9d55-181b530d72be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:59.317373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ea812-6d6d-44e6-9d55-181b530d72be admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:59.317751 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ea812-6d6d-44e6-9d55-181b530d72be admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:59.318128 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ea812-6d6d-44e6-9d55-181b530d72be admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:59.319236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ea812-6d6d-44e6-9d55-181b530d72be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:01:59.319659 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ea812-6d6d-44e6-9d55-181b530d72be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:59.322189 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ea812-6d6d-44e6-9d55-181b530d72be admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:59.340604 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1267/2538] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:01:59.345267 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcffc6-48bd-4150-b6fa-5de5ed9afa62 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:59.355034 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcffc6-48bd-4150-b6fa-5de5ed9afa62 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:59.360281 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6125393-eac8-4356-a5b6-c2130e36e621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:59.360932 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6125393-eac8-4356-a5b6-c2130e36e621 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:59.361207 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6125393-eac8-4356-a5b6-c2130e36e621 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:59.361472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6125393-eac8-4356-a5b6-c2130e36e621 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:59.362153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6125393-eac8-4356-a5b6-c2130e36e621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:59.364055 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6125393-eac8-4356-a5b6-c2130e36e621 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:59.394413 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1272/2539] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:59 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:59.400913 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ea812-6d6d-44e6-9d55-181b530d72be admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:59.415169 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ea812-6d6d-44e6-9d55-181b530d72be admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:59.476750 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a73f7-ddea-4353-8e0b-a25bd8569081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:59.477436 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a73f7-ddea-4353-8e0b-a25bd8569081 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:59.477711 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a73f7-ddea-4353-8e0b-a25bd8569081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:59.477982 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a73f7-ddea-4353-8e0b-a25bd8569081 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:59.478687 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a73f7-ddea-4353-8e0b-a25bd8569081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:59.480730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a73f7-ddea-4353-8e0b-a25bd8569081 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:59.504004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1268/2540] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:59 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:59.508389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6125393-eac8-4356-a5b6-c2130e36e621 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:59.519871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6125393-eac8-4356-a5b6-c2130e36e621 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:59.524855 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de57fb-31da-40d3-a47b-2126c0d7cffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:59.525531 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de57fb-31da-40d3-a47b-2126c0d7cffe admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:59.525824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de57fb-31da-40d3-a47b-2126c0d7cffe admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:59.526091 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de57fb-31da-40d3-a47b-2126c0d7cffe admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:59.526811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de57fb-31da-40d3-a47b-2126c0d7cffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:59.528482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de57fb-31da-40d3-a47b-2126c0d7cffe admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:59.539388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1273/2541] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:59.543796 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a73f7-ddea-4353-8e0b-a25bd8569081 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:59.554238 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a73f7-ddea-4353-8e0b-a25bd8569081 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:59.559317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd99840-aec9-4161-91d6-e27024c4f44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:59.559997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd99840-aec9-4161-91d6-e27024c4f44c admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:59.560308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd99840-aec9-4161-91d6-e27024c4f44c admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:59.560666 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd99840-aec9-4161-91d6-e27024c4f44c admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:59.561384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd99840-aec9-4161-91d6-e27024c4f44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:59.563132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd99840-aec9-4161-91d6-e27024c4f44c admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:59.575070 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1269/2542] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:59.579700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de57fb-31da-40d3-a47b-2126c0d7cffe admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:59.592638 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de57fb-31da-40d3-a47b-2126c0d7cffe admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:59.599035 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938cfbe-1706-460d-9802-92078f0ab077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:59.599972 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938cfbe-1706-460d-9802-92078f0ab077 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:59.600275 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938cfbe-1706-460d-9802-92078f0ab077 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:59.600548 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938cfbe-1706-460d-9802-92078f0ab077 admin admin] PATH_INFO: `/v3/projects/6447a48915c447f384d030b2a5d0df2b/users/47bd09a38e544ee7ac818a0c84d2e273/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:59.618340 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938cfbe-1706-460d-9802-92078f0ab077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6447a48915c447f384d030b2a5d0df2b, user_id=47bd09a38e544ee7ac818a0c84d2e273, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:59.622039 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938cfbe-1706-460d-9802-92078f0ab077 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:59.638683 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1274/2543] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:59 2022] PUT /identity/v3/projects/6447a48915c447f384d030b2a5d0df2b/users/47bd09a38e544ee7ac818a0c84d2e273/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:59.653962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd30bde-d3c4-438c-9b0a-7fafe13f4842 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:59.654321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd30bde-d3c4-438c-9b0a-7fafe13f4842 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:59.654650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd30bde-d3c4-438c-9b0a-7fafe13f4842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:59.683127 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-ddd30bde-d3c4-438c-9b0a-7fafe13f4842 None None] MFA Rules not processed for user `47bd09a38e544ee7ac818a0c84d2e273`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:59.684486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ddd30bde-d3c4-438c-9b0a-7fafe13f4842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:59.758766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1270/2544] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:01:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:59.763924 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938cfbe-1706-460d-9802-92078f0ab077 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:59.829165 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938cfbe-1706-460d-9802-92078f0ab077 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:59.833849 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f85f-c524-41a2-b932-0fa10f5f1341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:59.834584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f85f-c524-41a2-b932-0fa10f5f1341 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:59.834849 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f85f-c524-41a2-b932-0fa10f5f1341 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:59.835118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f85f-c524-41a2-b932-0fa10f5f1341 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:59.835830 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06f85f-c524-41a2-b932-0fa10f5f1341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:59.838659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06f85f-c524-41a2-b932-0fa10f5f1341 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:59.865611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1275/2545] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:59 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:59.869953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd30bde-d3c4-438c-9b0a-7fafe13f4842 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:59.882114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd30bde-d3c4-438c-9b0a-7fafe13f4842 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:59.940085 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedf2c2-8f8e-46ac-9ef9-baa90a1850db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:59.940778 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedf2c2-8f8e-46ac-9ef9-baa90a1850db admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:59.941054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedf2c2-8f8e-46ac-9ef9-baa90a1850db admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:59.941324 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedf2c2-8f8e-46ac-9ef9-baa90a1850db admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:59.942021 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedf2c2-8f8e-46ac-9ef9-baa90a1850db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:59.943933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedf2c2-8f8e-46ac-9ef9-baa90a1850db admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:59.967119 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1271/2546] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:59 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:59.971530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f85f-c524-41a2-b932-0fa10f5f1341 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:59.983085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f85f-c524-41a2-b932-0fa10f5f1341 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:59.991181 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974abfb-1b73-474a-88f7-a0455edbaf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:59.992259 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974abfb-1b73-474a-88f7-a0455edbaf28 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:59.992640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974abfb-1b73-474a-88f7-a0455edbaf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:59.993051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974abfb-1b73-474a-88f7-a0455edbaf28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:59.994209 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974abfb-1b73-474a-88f7-a0455edbaf28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:59.996700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974abfb-1b73-474a-88f7-a0455edbaf28 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:00.008326 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1276/2547] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:00.013406 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedf2c2-8f8e-46ac-9ef9-baa90a1850db admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:00.025115 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedf2c2-8f8e-46ac-9ef9-baa90a1850db admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:00.030829 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78396c0c-c8d2-4eb4-a6e1-a9af7e9fd685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:00.031719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78396c0c-c8d2-4eb4-a6e1-a9af7e9fd685 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:00.031997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78396c0c-c8d2-4eb4-a6e1-a9af7e9fd685 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:00.032302 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78396c0c-c8d2-4eb4-a6e1-a9af7e9fd685 admin admin] PATH_INFO: `/v3/projects/05589d0e74fc4a7399cc618682b8645b/users/9c9651e86aaa44a2b60b91d7a8c657d8/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:00.054954 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78396c0c-c8d2-4eb4-a6e1-a9af7e9fd685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05589d0e74fc4a7399cc618682b8645b, user_id=9c9651e86aaa44a2b60b91d7a8c657d8, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:00.059192 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78396c0c-c8d2-4eb4-a6e1-a9af7e9fd685 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:00.078026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1272/2548] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:00 2022] PUT /identity/v3/projects/05589d0e74fc4a7399cc618682b8645b/users/9c9651e86aaa44a2b60b91d7a8c657d8/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:00.083559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974abfb-1b73-474a-88f7-a0455edbaf28 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:00.094158 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974abfb-1b73-474a-88f7-a0455edbaf28 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:00.151428 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e00184-a134-4d2e-8a04-a34d7161f2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:00.152102 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e00184-a134-4d2e-8a04-a34d7161f2ea admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:00.152540 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e00184-a134-4d2e-8a04-a34d7161f2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:00.152813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e00184-a134-4d2e-8a04-a34d7161f2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:00.153560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e00184-a134-4d2e-8a04-a34d7161f2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:00.155172 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e00184-a134-4d2e-8a04-a34d7161f2ea admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:00.165078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1277/2549] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:00.171383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78396c0c-c8d2-4eb4-a6e1-a9af7e9fd685 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:00.184376 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78396c0c-c8d2-4eb4-a6e1-a9af7e9fd685 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:00.192019 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04126af2-13e2-4325-aa01-f7b60f90fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:00.192872 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04126af2-13e2-4325-aa01-f7b60f90fef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:00.193146 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04126af2-13e2-4325-aa01-f7b60f90fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:00.193412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04126af2-13e2-4325-aa01-f7b60f90fef0 admin admin] PATH_INFO: `/v3/projects/05589d0e74fc4a7399cc618682b8645b/users/9c9651e86aaa44a2b60b91d7a8c657d8/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:00.195578 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04126af2-13e2-4325-aa01-f7b60f90fef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05589d0e74fc4a7399cc618682b8645b, user_id=9c9651e86aaa44a2b60b91d7a8c657d8, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:00.198382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04126af2-13e2-4325-aa01-f7b60f90fef0 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:00.209025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1273/2550] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:00 2022] PUT /identity/v3/projects/05589d0e74fc4a7399cc618682b8645b/users/9c9651e86aaa44a2b60b91d7a8c657d8/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:00.220196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cf922-ff66-41be-88dc-47666fa5f5e8 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:00.220516 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cf922-ff66-41be-88dc-47666fa5f5e8 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:00.220785 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cf922-ff66-41be-88dc-47666fa5f5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:00.250017 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-fe9cf922-ff66-41be-88dc-47666fa5f5e8 None None] MFA Rules not processed for user `9c9651e86aaa44a2b60b91d7a8c657d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:00.251318 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-fe9cf922-ff66-41be-88dc-47666fa5f5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:00.320715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1278/2551] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:00.332527 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04126af2-13e2-4325-aa01-f7b60f90fef0 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:00.334364 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-04126af2-13e2-4325-aa01-f7b60f90fef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:00.398604 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04126af2-13e2-4325-aa01-f7b60f90fef0 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:00.402394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039649ba-f217-4d29-b2c1-a6299db920e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:00.403057 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039649ba-f217-4d29-b2c1-a6299db920e1 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:00.403341 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039649ba-f217-4d29-b2c1-a6299db920e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:00.403613 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039649ba-f217-4d29-b2c1-a6299db920e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:00.413567 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039649ba-f217-4d29-b2c1-a6299db920e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:00.415030 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039649ba-f217-4d29-b2c1-a6299db920e1 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:00.425282 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1274/2552] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:00.546258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cf922-ff66-41be-88dc-47666fa5f5e8 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:00.556760 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cf922-ff66-41be-88dc-47666fa5f5e8 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:00.561257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf04c8c-bd4d-47de-9ddf-c9f05ecf38f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:00.561958 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf04c8c-bd4d-47de-9ddf-c9f05ecf38f5 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:00.562227 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf04c8c-bd4d-47de-9ddf-c9f05ecf38f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:00.562497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf04c8c-bd4d-47de-9ddf-c9f05ecf38f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:00.627675 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf04c8c-bd4d-47de-9ddf-c9f05ecf38f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:00.629246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf04c8c-bd4d-47de-9ddf-c9f05ecf38f5 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:00.639599 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1279/2553] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:03.286322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039649ba-f217-4d29-b2c1-a6299db920e1 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:03.367862 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039649ba-f217-4d29-b2c1-a6299db920e1 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:03.374026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df9aaa-29f2-4134-a20f-049fd9dbc30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:03.374959 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df9aaa-29f2-4134-a20f-049fd9dbc30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:03.375235 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df9aaa-29f2-4134-a20f-049fd9dbc30f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:03.375505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df9aaa-29f2-4134-a20f-049fd9dbc30f admin admin] PATH_INFO: `/v3/users/47bd09a38e544ee7ac818a0c84d2e273` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:03.376824 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df9aaa-29f2-4134-a20f-049fd9dbc30f admin admin] RBAC: Authorizing `identity:delete_user(user_id=47bd09a38e544ee7ac818a0c84d2e273)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:03.378753 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df9aaa-29f2-4134-a20f-049fd9dbc30f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:03.428813 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-95df9aaa-29f2-4134-a20f-049fd9dbc30f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47bd09a38e544ee7ac818a0c84d2e273'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:03.429490 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-95df9aaa-29f2-4134-a20f-049fd9dbc30f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47bd09a38e544ee7ac818a0c84d2e273'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:03.441985 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-95df9aaa-29f2-4134-a20f-049fd9dbc30f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47bd09a38e544ee7ac818a0c84d2e273'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:03.442664 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-95df9aaa-29f2-4134-a20f-049fd9dbc30f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47bd09a38e544ee7ac818a0c84d2e273'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:03.451318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-95df9aaa-29f2-4134-a20f-049fd9dbc30f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47bd09a38e544ee7ac818a0c84d2e273'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:03.465026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1275/2554] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:03 2022] DELETE /identity/v3/users/47bd09a38e544ee7ac818a0c84d2e273 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:03.470255 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a8277-6c7f-49c5-a0d6-7dba3277b692 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:03.470743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a8277-6c7f-49c5-a0d6-7dba3277b692 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:03.470743 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a8277-6c7f-49c5-a0d6-7dba3277b692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:03.497672 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-e33a8277-6c7f-49c5-a0d6-7dba3277b692 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:03.499035 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e33a8277-6c7f-49c5-a0d6-7dba3277b692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:03.574452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1280/2555] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:03.584867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df9aaa-29f2-4134-a20f-049fd9dbc30f admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:03.586477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-95df9aaa-29f2-4134-a20f-049fd9dbc30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:03.651910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df9aaa-29f2-4134-a20f-049fd9dbc30f admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:03.656914 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbe569-4d6f-401b-8062-887e7eb1e5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:03.657618 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbe569-4d6f-401b-8062-887e7eb1e5ba service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:03.657947 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbe569-4d6f-401b-8062-887e7eb1e5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:03.658222 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbe569-4d6f-401b-8062-887e7eb1e5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:03.670392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbe569-4d6f-401b-8062-887e7eb1e5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:03.672375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbe569-4d6f-401b-8062-887e7eb1e5ba service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:03.682743 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1276/2556] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:04.252579 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a8277-6c7f-49c5-a0d6-7dba3277b692 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:04.254738 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e33a8277-6c7f-49c5-a0d6-7dba3277b692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:04.280122 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a8277-6c7f-49c5-a0d6-7dba3277b692 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:04.286133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:04.287134 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:04.287348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:04.287615 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626 admin admin] PATH_INFO: `/v3/projects/6447a48915c447f384d030b2a5d0df2b` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:04.288912 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6447a48915c447f384d030b2a5d0df2b)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:04.290945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:04.342643 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6447a48915c447f384d030b2a5d0df2b', 'request_id': 'req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:04.350580 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6447a48915c447f384d030b2a5d0df2b', 'request_id': 'req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:04.360056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6447a48915c447f384d030b2a5d0df2b', 'request_id': 'req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:04.371154 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626 admin admin] The token cache is being invalidate because project 6447a48915c447f384d030b2a5d0df2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:04.371440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:04.372118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:04.374397 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1281/2557] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:04 2022] DELETE /identity/v3/projects/6447a48915c447f384d030b2a5d0df2b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:04.378758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbe569-4d6f-401b-8062-887e7eb1e5ba service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:04.389308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbe569-4d6f-401b-8062-887e7eb1e5ba service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:04.457750 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f76a7d-4456-4a87-8e6b-75a1caf51134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:04.459418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f76a7d-4456-4a87-8e6b-75a1caf51134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:04.459869 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f76a7d-4456-4a87-8e6b-75a1caf51134 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:04.460408 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f76a7d-4456-4a87-8e6b-75a1caf51134 admin admin] PATH_INFO: `/v3/users/9c9651e86aaa44a2b60b91d7a8c657d8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:04.462245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f76a7d-4456-4a87-8e6b-75a1caf51134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9651e86aaa44a2b60b91d7a8c657d8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:04.464971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f76a7d-4456-4a87-8e6b-75a1caf51134 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:04.534528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-35f76a7d-4456-4a87-8e6b-75a1caf51134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9651e86aaa44a2b60b91d7a8c657d8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:04.535338 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-35f76a7d-4456-4a87-8e6b-75a1caf51134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9651e86aaa44a2b60b91d7a8c657d8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:04.550142 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-35f76a7d-4456-4a87-8e6b-75a1caf51134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9651e86aaa44a2b60b91d7a8c657d8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:04.551233 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-35f76a7d-4456-4a87-8e6b-75a1caf51134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9651e86aaa44a2b60b91d7a8c657d8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:04.560628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-35f76a7d-4456-4a87-8e6b-75a1caf51134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9651e86aaa44a2b60b91d7a8c657d8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:04.574472 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1277/2558] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:04 2022] DELETE /identity/v3/users/9c9651e86aaa44a2b60b91d7a8c657d8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:05.145836 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:05.147600 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:05.161780 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfbe8a-4dd6-456a-bbbb-31f7e48b6626 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:05.230389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f0332-fd7b-403c-bcb6-cc73bd84bf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:05.231296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f0332-fd7b-403c-bcb6-cc73bd84bf5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:05.231579 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f0332-fd7b-403c-bcb6-cc73bd84bf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:05.231846 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f0332-fd7b-403c-bcb6-cc73bd84bf5d admin admin] PATH_INFO: `/v3/projects/05589d0e74fc4a7399cc618682b8645b` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:05.233531 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f0332-fd7b-403c-bcb6-cc73bd84bf5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=05589d0e74fc4a7399cc618682b8645b)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:05.238135 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f0332-fd7b-403c-bcb6-cc73bd84bf5d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:05.289814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-da6f0332-fd7b-403c-bcb6-cc73bd84bf5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05589d0e74fc4a7399cc618682b8645b', 'request_id': 'req-da6f0332-fd7b-403c-bcb6-cc73bd84bf5d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:05.298685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-da6f0332-fd7b-403c-bcb6-cc73bd84bf5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05589d0e74fc4a7399cc618682b8645b', 'request_id': 'req-da6f0332-fd7b-403c-bcb6-cc73bd84bf5d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:05.305486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-da6f0332-fd7b-403c-bcb6-cc73bd84bf5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05589d0e74fc4a7399cc618682b8645b', 'request_id': 'req-da6f0332-fd7b-403c-bcb6-cc73bd84bf5d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:05.316692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-da6f0332-fd7b-403c-bcb6-cc73bd84bf5d admin admin] The token cache is being invalidate because project 05589d0e74fc4a7399cc618682b8645b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:05.316980 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-da6f0332-fd7b-403c-bcb6-cc73bd84bf5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:05.317645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-da6f0332-fd7b-403c-bcb6-cc73bd84bf5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:05.319229 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1282/2559] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:05 2022] DELETE /identity/v3/projects/05589d0e74fc4a7399cc618682b8645b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:05.324416 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c03dc-d3bb-4399-983b-f5ade69a0608 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:05.324785 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c03dc-d3bb-4399-983b-f5ade69a0608 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:05.325116 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c03dc-d3bb-4399-983b-f5ade69a0608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:05.343898 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-2b7c03dc-d3bb-4399-983b-f5ade69a0608 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:05.345290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-2b7c03dc-d3bb-4399-983b-f5ade69a0608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:05.407933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1278/2560] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:05.416113 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1941-35e0-439e-8021-2745b4811b32 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:05.416436 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1941-35e0-439e-8021-2745b4811b32 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:05.416716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1941-35e0-439e-8021-2745b4811b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:05.435526 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-319a1941-35e0-439e-8021-2745b4811b32 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:05.437246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-319a1941-35e0-439e-8021-2745b4811b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:05.445701 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1283/2561] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:05.450009 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c03dc-d3bb-4399-983b-f5ade69a0608 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:05.460326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c03dc-d3bb-4399-983b-f5ade69a0608 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:05.465157 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b52dd-9262-4cf2-9524-9ac9081af998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:05.465847 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b52dd-9262-4cf2-9524-9ac9081af998 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:05.466101 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b52dd-9262-4cf2-9524-9ac9081af998 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:05.466838 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b52dd-9262-4cf2-9524-9ac9081af998 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:05.467177 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b52dd-9262-4cf2-9524-9ac9081af998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:02:05.467497 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b52dd-9262-4cf2-9524-9ac9081af998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:05.469314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b52dd-9262-4cf2-9524-9ac9081af998 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:05.482337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1279/2562] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 13:02:05.487554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a1941-35e0-439e-8021-2745b4811b32 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:05.496913 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a1941-35e0-439e-8021-2745b4811b32 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:05.506355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd591cf-cc99-45c5-a70e-1165c5a75288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:05.507044 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd591cf-cc99-45c5-a70e-1165c5a75288 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:05.507325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd591cf-cc99-45c5-a70e-1165c5a75288 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:05.507597 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd591cf-cc99-45c5-a70e-1165c5a75288 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:05.508335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd591cf-cc99-45c5-a70e-1165c5a75288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:05.510260 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd591cf-cc99-45c5-a70e-1165c5a75288 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:05.539378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1284/2563] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:02:05 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:05.543764 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b52dd-9262-4cf2-9524-9ac9081af998 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:05.554279 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b52dd-9262-4cf2-9524-9ac9081af998 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:05.613545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4ddd3-b0cf-4fac-ae33-274028dd5539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:05.614407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4ddd3-b0cf-4fac-ae33-274028dd5539 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:05.614695 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4ddd3-b0cf-4fac-ae33-274028dd5539 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:05.614970 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4ddd3-b0cf-4fac-ae33-274028dd5539 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:05.615719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4ddd3-b0cf-4fac-ae33-274028dd5539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:05.617800 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4ddd3-b0cf-4fac-ae33-274028dd5539 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:05.644083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1280/2564] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:02:05 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:05.646071 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd591cf-cc99-45c5-a70e-1165c5a75288 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:05.657910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd591cf-cc99-45c5-a70e-1165c5a75288 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:05.664553 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d381c8b-4560-464a-8f8d-26abd8e47ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:05.665958 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d381c8b-4560-464a-8f8d-26abd8e47ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:05.666384 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d381c8b-4560-464a-8f8d-26abd8e47ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:05.666801 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d381c8b-4560-464a-8f8d-26abd8e47ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:05.667704 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d381c8b-4560-464a-8f8d-26abd8e47ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:05.670291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d381c8b-4560-464a-8f8d-26abd8e47ef7 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:05.682526 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1285/2565] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:02:05.687905 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4ddd3-b0cf-4fac-ae33-274028dd5539 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:05.698575 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4ddd3-b0cf-4fac-ae33-274028dd5539 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:05.713004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf0dc4-3d96-4ea1-a2a4-9a9ad52849af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:05.713910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf0dc4-3d96-4ea1-a2a4-9a9ad52849af admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:05.714191 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf0dc4-3d96-4ea1-a2a4-9a9ad52849af admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:05.714458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf0dc4-3d96-4ea1-a2a4-9a9ad52849af admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:05.715225 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf0dc4-3d96-4ea1-a2a4-9a9ad52849af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:05.717784 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf0dc4-3d96-4ea1-a2a4-9a9ad52849af admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:05.732267 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1281/2566] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:05.735090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d381c8b-4560-464a-8f8d-26abd8e47ef7 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:05.746253 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d381c8b-4560-464a-8f8d-26abd8e47ef7 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:05.753474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53bad2-dfad-49bb-b748-501ce7b26952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:05.754404 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53bad2-dfad-49bb-b748-501ce7b26952 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:05.754692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53bad2-dfad-49bb-b748-501ce7b26952 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:05.755010 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53bad2-dfad-49bb-b748-501ce7b26952 admin admin] PATH_INFO: `/v3/projects/7690a781e3ea4b1d8061a032da3da26a/users/c720efb6ae644325a10ccb707edcd6cc/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:05.772890 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53bad2-dfad-49bb-b748-501ce7b26952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7690a781e3ea4b1d8061a032da3da26a, user_id=c720efb6ae644325a10ccb707edcd6cc, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:05.775927 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53bad2-dfad-49bb-b748-501ce7b26952 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:05.792580 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1286/2567] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:05 2022] PUT /identity/v3/projects/7690a781e3ea4b1d8061a032da3da26a/users/c720efb6ae644325a10ccb707edcd6cc/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:05.798172 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811b575-9bf1-492c-8c75-8732cc68f78e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:05.798507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811b575-9bf1-492c-8c75-8732cc68f78e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:05.798736 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811b575-9bf1-492c-8c75-8732cc68f78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:05.825649 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-3811b575-9bf1-492c-8c75-8732cc68f78e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:05.827592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-3811b575-9bf1-492c-8c75-8732cc68f78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:05.927479 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1282/2568] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:05.935086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53bad2-dfad-49bb-b748-501ce7b26952 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:05.937129 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ce53bad2-dfad-49bb-b748-501ce7b26952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:06.018489 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53bad2-dfad-49bb-b748-501ce7b26952 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:06.024978 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ae22e-bda9-44e9-95fc-8479ad47e028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:06.026045 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ae22e-bda9-44e9-95fc-8479ad47e028 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:06.026513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ae22e-bda9-44e9-95fc-8479ad47e028 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:06.026969 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ae22e-bda9-44e9-95fc-8479ad47e028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:06.043560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ae22e-bda9-44e9-95fc-8479ad47e028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:06.045849 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ae22e-bda9-44e9-95fc-8479ad47e028 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:06.062056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1287/2569] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:06.840856 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e20e50-6637-4544-a955-61336ce8f0df None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:06.841404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e20e50-6637-4544-a955-61336ce8f0df None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:06.841404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e20e50-6637-4544-a955-61336ce8f0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:07.016507 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-26e20e50-6637-4544-a955-61336ce8f0df None None] MFA Rules not processed for user `c720efb6ae644325a10ccb707edcd6cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:07.017775 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-26e20e50-6637-4544-a955-61336ce8f0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:07.082872 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1283/2570] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:07.087700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ae22e-bda9-44e9-95fc-8479ad47e028 service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:07.098003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ae22e-bda9-44e9-95fc-8479ad47e028 service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:07.102927 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04399aad-d028-4739-a748-bfe7bf7061e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:07.103602 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04399aad-d028-4739-a748-bfe7bf7061e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:07.103884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04399aad-d028-4739-a748-bfe7bf7061e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:07.104157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04399aad-d028-4739-a748-bfe7bf7061e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:07.104900 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04399aad-d028-4739-a748-bfe7bf7061e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:07.106832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04399aad-d028-4739-a748-bfe7bf7061e3 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:07.138621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1288/2571] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:02:07 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:07.140039 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e20e50-6637-4544-a955-61336ce8f0df None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:07.152106 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e20e50-6637-4544-a955-61336ce8f0df None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:07.219951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b671c8-34d3-464c-a540-12870b0f9922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:07.220690 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b671c8-34d3-464c-a540-12870b0f9922 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:07.220973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b671c8-34d3-464c-a540-12870b0f9922 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:07.221231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b671c8-34d3-464c-a540-12870b0f9922 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:07.221921 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b671c8-34d3-464c-a540-12870b0f9922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:07.223843 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b671c8-34d3-464c-a540-12870b0f9922 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:07.249754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1284/2572] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:02:07 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:07.254239 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04399aad-d028-4739-a748-bfe7bf7061e3 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:07.270062 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04399aad-d028-4739-a748-bfe7bf7061e3 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:07.277819 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe273537-4cd9-457e-a053-a1c69c665275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:07.279098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe273537-4cd9-457e-a053-a1c69c665275 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:07.279098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe273537-4cd9-457e-a053-a1c69c665275 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:07.279330 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe273537-4cd9-457e-a053-a1c69c665275 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:07.280134 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe273537-4cd9-457e-a053-a1c69c665275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:07.281835 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe273537-4cd9-457e-a053-a1c69c665275 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:07.293231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1289/2573] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:07.297872 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b671c8-34d3-464c-a540-12870b0f9922 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:07.308763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b671c8-34d3-464c-a540-12870b0f9922 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:07.313923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cb5c0-7892-4d70-8c43-fb3b68443f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:07.314850 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cb5c0-7892-4d70-8c43-fb3b68443f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:07.315127 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cb5c0-7892-4d70-8c43-fb3b68443f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:07.315404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cb5c0-7892-4d70-8c43-fb3b68443f5a admin admin] PATH_INFO: `/v3/projects/7f4ce499de5640698ad46d4ad923bf12/users/4a84774fc962402abbcd84758b92b86a/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:07.330333 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cb5c0-7892-4d70-8c43-fb3b68443f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4ce499de5640698ad46d4ad923bf12, user_id=4a84774fc962402abbcd84758b92b86a, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:07.333060 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cb5c0-7892-4d70-8c43-fb3b68443f5a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:07.348824 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1285/2574] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:07 2022] PUT /identity/v3/projects/7f4ce499de5640698ad46d4ad923bf12/users/4a84774fc962402abbcd84758b92b86a/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:07.353670 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe273537-4cd9-457e-a053-a1c69c665275 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:07.367831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe273537-4cd9-457e-a053-a1c69c665275 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:07.433842 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28c4a5-0600-492c-9431-0ff9d7658004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:07.434540 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28c4a5-0600-492c-9431-0ff9d7658004 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:07.434815 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28c4a5-0600-492c-9431-0ff9d7658004 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:07.435085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28c4a5-0600-492c-9431-0ff9d7658004 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:07.435947 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28c4a5-0600-492c-9431-0ff9d7658004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:07.437560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28c4a5-0600-492c-9431-0ff9d7658004 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:07.447564 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1290/2575] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:02:07.452582 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cb5c0-7892-4d70-8c43-fb3b68443f5a admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:07.463878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cb5c0-7892-4d70-8c43-fb3b68443f5a admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:07.469752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3b2db-c56f-47c8-ad6d-a76ed0fc761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:07.470653 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3b2db-c56f-47c8-ad6d-a76ed0fc761d admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:07.470928 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3b2db-c56f-47c8-ad6d-a76ed0fc761d admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:07.471196 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3b2db-c56f-47c8-ad6d-a76ed0fc761d admin admin] PATH_INFO: `/v3/projects/7f4ce499de5640698ad46d4ad923bf12/users/4a84774fc962402abbcd84758b92b86a/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:07.473186 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3b2db-c56f-47c8-ad6d-a76ed0fc761d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4ce499de5640698ad46d4ad923bf12, user_id=4a84774fc962402abbcd84758b92b86a, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:07.475824 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3b2db-c56f-47c8-ad6d-a76ed0fc761d admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:07.489162 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1286/2576] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:07 2022] PUT /identity/v3/projects/7f4ce499de5640698ad46d4ad923bf12/users/4a84774fc962402abbcd84758b92b86a/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:08.130140 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926edd7-a519-46be-94c2-d86af0e5af32 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:08.130688 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926edd7-a519-46be-94c2-d86af0e5af32 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:08.130688 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926edd7-a519-46be-94c2-d86af0e5af32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:08.164182 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-a926edd7-a519-46be-94c2-d86af0e5af32 None None] MFA Rules not processed for user `4a84774fc962402abbcd84758b92b86a`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:08.165687 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-a926edd7-a519-46be-94c2-d86af0e5af32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:08.239767 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1291/2577] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:08.252320 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3b2db-c56f-47c8-ad6d-a76ed0fc761d admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:08.254275 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-01a3b2db-c56f-47c8-ad6d-a76ed0fc761d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:08.313864 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3b2db-c56f-47c8-ad6d-a76ed0fc761d admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:08.317231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e57ea-f1b8-4e9b-8aa8-06e1e7ea2e63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:08.317895 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e57ea-f1b8-4e9b-8aa8-06e1e7ea2e63 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:08.318464 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e57ea-f1b8-4e9b-8aa8-06e1e7ea2e63 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:08.318740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e57ea-f1b8-4e9b-8aa8-06e1e7ea2e63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:08.376573 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e57ea-f1b8-4e9b-8aa8-06e1e7ea2e63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:08.378034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e57ea-f1b8-4e9b-8aa8-06e1e7ea2e63 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:08.387610 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1287/2578] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:09.772053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926edd7-a519-46be-94c2-d86af0e5af32 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:09.773749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-a926edd7-a519-46be-94c2-d86af0e5af32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:09.787100 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926edd7-a519-46be-94c2-d86af0e5af32 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:09.791798 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c14772-b8f7-4efa-bd11-397631192789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:09.792514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c14772-b8f7-4efa-bd11-397631192789 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:09.792797 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c14772-b8f7-4efa-bd11-397631192789 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:09.793069 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c14772-b8f7-4efa-bd11-397631192789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:09.806733 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c14772-b8f7-4efa-bd11-397631192789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:09.809077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c14772-b8f7-4efa-bd11-397631192789 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:09.824186 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1292/2579] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:23.494919 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e57ea-f1b8-4e9b-8aa8-06e1e7ea2e63 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:23.496759 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ce9e57ea-f1b8-4e9b-8aa8-06e1e7ea2e63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:23.596750 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e57ea-f1b8-4e9b-8aa8-06e1e7ea2e63 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:23.604004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be99b7-1c02-4532-8d65-3ea8a09535a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:23.605061 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be99b7-1c02-4532-8d65-3ea8a09535a3 service placement] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:23.605529 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be99b7-1c02-4532-8d65-3ea8a09535a3 service placement] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:23.605905 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be99b7-1c02-4532-8d65-3ea8a09535a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:23.608052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-59be99b7-1c02-4532-8d65-3ea8a09535a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:23.617287 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c14772-b8f7-4efa-bd11-397631192789 service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:23.627701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be99b7-1c02-4532-8d65-3ea8a09535a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:23.629801 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be99b7-1c02-4532-8d65-3ea8a09535a3 service placement] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:23.646385 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1288/2580] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:23.707559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c14772-b8f7-4efa-bd11-397631192789 service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:23.714495 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459cdc5-9f69-428e-8565-292989070a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:23.715915 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459cdc5-9f69-428e-8565-292989070a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:23.716409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459cdc5-9f69-428e-8565-292989070a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:23.716854 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459cdc5-9f69-428e-8565-292989070a10 admin admin] PATH_INFO: `/v3/users/c720efb6ae644325a10ccb707edcd6cc` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:23.718222 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459cdc5-9f69-428e-8565-292989070a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c720efb6ae644325a10ccb707edcd6cc)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:23.721157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459cdc5-9f69-428e-8565-292989070a10 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:23.774661 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6459cdc5-9f69-428e-8565-292989070a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c720efb6ae644325a10ccb707edcd6cc'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:23.775334 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6459cdc5-9f69-428e-8565-292989070a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c720efb6ae644325a10ccb707edcd6cc'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:23.788619 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6459cdc5-9f69-428e-8565-292989070a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c720efb6ae644325a10ccb707edcd6cc'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:23.789580 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6459cdc5-9f69-428e-8565-292989070a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c720efb6ae644325a10ccb707edcd6cc'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:23.800603 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-6459cdc5-9f69-428e-8565-292989070a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c720efb6ae644325a10ccb707edcd6cc'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:23.814519 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1293/2581] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:23 2022] DELETE /identity/v3/users/c720efb6ae644325a10ccb707edcd6cc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:02:24.013975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be99b7-1c02-4532-8d65-3ea8a09535a3 service placement] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:24.028430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be99b7-1c02-4532-8d65-3ea8a09535a3 service placement] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:24.103210 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:24.104089 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:24.104396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:24.104668 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661 admin admin] PATH_INFO: `/v3/projects/7690a781e3ea4b1d8061a032da3da26a` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:24.105983 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7690a781e3ea4b1d8061a032da3da26a)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:24.110564 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:24.168194 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7690a781e3ea4b1d8061a032da3da26a', 'request_id': 'req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:24.177446 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7690a781e3ea4b1d8061a032da3da26a', 'request_id': 'req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:24.183546 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7690a781e3ea4b1d8061a032da3da26a', 'request_id': 'req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:24.195512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661 admin admin] The token cache is being invalidate because project 7690a781e3ea4b1d8061a032da3da26a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:24.195782 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:24.196582 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:24.198278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1289/2582] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:24 2022] DELETE /identity/v3/projects/7690a781e3ea4b1d8061a032da3da26a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:24.204884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459cdc5-9f69-428e-8565-292989070a10 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:24.207346 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6459cdc5-9f69-428e-8565-292989070a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:24.229923 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459cdc5-9f69-428e-8565-292989070a10 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:24.305677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bfc9f-623c-4982-aa6f-2d79aba4b65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:24.306586 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bfc9f-623c-4982-aa6f-2d79aba4b65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:24.306860 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bfc9f-623c-4982-aa6f-2d79aba4b65f admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:24.307130 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bfc9f-623c-4982-aa6f-2d79aba4b65f admin admin] PATH_INFO: `/v3/users/4a84774fc962402abbcd84758b92b86a` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:24.308396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bfc9f-623c-4982-aa6f-2d79aba4b65f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a84774fc962402abbcd84758b92b86a)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:24.310324 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bfc9f-623c-4982-aa6f-2d79aba4b65f admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:24.373202 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bc8bfc9f-623c-4982-aa6f-2d79aba4b65f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a84774fc962402abbcd84758b92b86a'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:24.374076 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bc8bfc9f-623c-4982-aa6f-2d79aba4b65f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a84774fc962402abbcd84758b92b86a'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:24.388781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bc8bfc9f-623c-4982-aa6f-2d79aba4b65f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a84774fc962402abbcd84758b92b86a'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:24.389649 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bc8bfc9f-623c-4982-aa6f-2d79aba4b65f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a84774fc962402abbcd84758b92b86a'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:24.398696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bc8bfc9f-623c-4982-aa6f-2d79aba4b65f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a84774fc962402abbcd84758b92b86a'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:24.411396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1294/2583] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:24 2022] DELETE /identity/v3/users/4a84774fc962402abbcd84758b92b86a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:24.613381 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:24.615129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:24.633939 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96c8e9-6dbe-4f47-b13f-7116b35f1661 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:24.696105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9a122-0ac3-416a-a158-289610fa6e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:24.697011 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9a122-0ac3-416a-a158-289610fa6e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:24.697290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9a122-0ac3-416a-a158-289610fa6e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:24.697558 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9a122-0ac3-416a-a158-289610fa6e9e admin admin] PATH_INFO: `/v3/projects/7f4ce499de5640698ad46d4ad923bf12` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:24.698731 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9a122-0ac3-416a-a158-289610fa6e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4ce499de5640698ad46d4ad923bf12)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:24.700680 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9a122-0ac3-416a-a158-289610fa6e9e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:24.751940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-45b9a122-0ac3-416a-a158-289610fa6e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4ce499de5640698ad46d4ad923bf12', 'request_id': 'req-45b9a122-0ac3-416a-a158-289610fa6e9e'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:24.766263 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-45b9a122-0ac3-416a-a158-289610fa6e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4ce499de5640698ad46d4ad923bf12', 'request_id': 'req-45b9a122-0ac3-416a-a158-289610fa6e9e'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:24.773288 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-45b9a122-0ac3-416a-a158-289610fa6e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4ce499de5640698ad46d4ad923bf12', 'request_id': 'req-45b9a122-0ac3-416a-a158-289610fa6e9e'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:24.785815 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-45b9a122-0ac3-416a-a158-289610fa6e9e admin admin] The token cache is being invalidate because project 7f4ce499de5640698ad46d4ad923bf12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:24.786104 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-45b9a122-0ac3-416a-a158-289610fa6e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:24.786775 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-45b9a122-0ac3-416a-a158-289610fa6e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:24.788423 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1290/2584] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:24 2022] DELETE /identity/v3/projects/7f4ce499de5640698ad46d4ad923bf12 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:24.794700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3144585-499a-4e95-9d54-994c67e75223 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:24.795395 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3144585-499a-4e95-9d54-994c67e75223 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:24.795395 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3144585-499a-4e95-9d54-994c67e75223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:24.814156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-b3144585-499a-4e95-9d54-994c67e75223 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:24.815352 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b3144585-499a-4e95-9d54-994c67e75223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:24.877376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1295/2585] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:24.946049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9770c-b2ad-46aa-9091-4a3082ccdc2f None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:24.946404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9770c-b2ad-46aa-9091-4a3082ccdc2f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:24.946726 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9770c-b2ad-46aa-9091-4a3082ccdc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:24.967177 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-75b9770c-b2ad-46aa-9091-4a3082ccdc2f None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:24.968513 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-75b9770c-b2ad-46aa-9091-4a3082ccdc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:24.977540 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1291/2586] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:24.982128 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3144585-499a-4e95-9d54-994c67e75223 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:24.993416 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3144585-499a-4e95-9d54-994c67e75223 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:24.998258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e8f5a-2af8-4540-bdbf-5c744b4c72d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:24.998906 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e8f5a-2af8-4540-bdbf-5c744b4c72d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:24.999344 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e8f5a-2af8-4540-bdbf-5c744b4c72d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:24.999535 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e8f5a-2af8-4540-bdbf-5c744b4c72d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:25.000254 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e8f5a-2af8-4540-bdbf-5c744b4c72d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:02:25.000558 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e8f5a-2af8-4540-bdbf-5c744b4c72d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:25.002304 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e8f5a-2af8-4540-bdbf-5c744b4c72d4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:25.015264 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1296/2587] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 13:02:25.019795 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9770c-b2ad-46aa-9091-4a3082ccdc2f None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:25.032008 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9770c-b2ad-46aa-9091-4a3082ccdc2f None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:25.037866 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2475502-b26f-4a80-a07c-07023b5219f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:25.038549 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2475502-b26f-4a80-a07c-07023b5219f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:25.038826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2475502-b26f-4a80-a07c-07023b5219f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:25.039091 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2475502-b26f-4a80-a07c-07023b5219f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:25.039760 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2475502-b26f-4a80-a07c-07023b5219f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:25.041676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2475502-b26f-4a80-a07c-07023b5219f6 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:25.069309 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1292/2588] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:02:25 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:25.073641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e8f5a-2af8-4540-bdbf-5c744b4c72d4 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:25.084497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e8f5a-2af8-4540-bdbf-5c744b4c72d4 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:25.157811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9c2a7-d1e5-43ce-b198-2c20630066eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:25.158484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9c2a7-d1e5-43ce-b198-2c20630066eb admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:25.159084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9c2a7-d1e5-43ce-b198-2c20630066eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:25.159084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9c2a7-d1e5-43ce-b198-2c20630066eb admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:25.159739 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9c2a7-d1e5-43ce-b198-2c20630066eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:25.161677 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9c2a7-d1e5-43ce-b198-2c20630066eb admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:25.187096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1297/2589] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:02:25 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:02:25.192343 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2475502-b26f-4a80-a07c-07023b5219f6 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:25.209710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2475502-b26f-4a80-a07c-07023b5219f6 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:25.215984 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505836d9-d85f-4889-a924-463ea173dff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:25.216690 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505836d9-d85f-4889-a924-463ea173dff6 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:25.216982 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505836d9-d85f-4889-a924-463ea173dff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:25.217251 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505836d9-d85f-4889-a924-463ea173dff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:25.217986 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505836d9-d85f-4889-a924-463ea173dff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:25.219827 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505836d9-d85f-4889-a924-463ea173dff6 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:25.231422 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1293/2590] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:25.236117 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9c2a7-d1e5-43ce-b198-2c20630066eb admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:25.248016 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9c2a7-d1e5-43ce-b198-2c20630066eb admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:25.253881 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c784624-cfbf-4fae-a3f2-8e3d26e33c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:25.254477 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c784624-cfbf-4fae-a3f2-8e3d26e33c42 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:25.254756 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c784624-cfbf-4fae-a3f2-8e3d26e33c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:25.255023 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c784624-cfbf-4fae-a3f2-8e3d26e33c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:25.255751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c784624-cfbf-4fae-a3f2-8e3d26e33c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:25.257364 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c784624-cfbf-4fae-a3f2-8e3d26e33c42 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:25.269698 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1298/2591] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:02:25.276572 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505836d9-d85f-4889-a924-463ea173dff6 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:25.287090 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505836d9-d85f-4889-a924-463ea173dff6 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:25.294599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523cd89-9873-48f8-9132-b1261c99fb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:25.295936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523cd89-9873-48f8-9132-b1261c99fb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:25.296434 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523cd89-9873-48f8-9132-b1261c99fb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:25.296884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523cd89-9873-48f8-9132-b1261c99fb7a admin admin] PATH_INFO: `/v3/projects/5d502ceb49104b0e9b09de1990ec7474/users/cb14d105cafc44e39af6fbedd23d54a5/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:25.313348 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523cd89-9873-48f8-9132-b1261c99fb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d502ceb49104b0e9b09de1990ec7474, user_id=cb14d105cafc44e39af6fbedd23d54a5, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:25.316274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523cd89-9873-48f8-9132-b1261c99fb7a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:25.331097 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1294/2592] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:25 2022] PUT /identity/v3/projects/5d502ceb49104b0e9b09de1990ec7474/users/cb14d105cafc44e39af6fbedd23d54a5/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:25.342816 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc6a2d-6d6e-4e40-a5ad-cc79af3de6ce None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:25.343344 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc6a2d-6d6e-4e40-a5ad-cc79af3de6ce None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:25.343794 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc6a2d-6d6e-4e40-a5ad-cc79af3de6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:25.376276 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-7cfc6a2d-6d6e-4e40-a5ad-cc79af3de6ce None None] MFA Rules not processed for user `cb14d105cafc44e39af6fbedd23d54a5`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:25.377535 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-7cfc6a2d-6d6e-4e40-a5ad-cc79af3de6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:25.444353 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1299/2593] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:25.457743 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523cd89-9873-48f8-9132-b1261c99fb7a admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:25.459687 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e523cd89-9873-48f8-9132-b1261c99fb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:25.536149 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523cd89-9873-48f8-9132-b1261c99fb7a admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:25.539923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87527e4-fc0a-4f90-9e94-fb048c1a602e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:25.540645 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87527e4-fc0a-4f90-9e94-fb048c1a602e service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:25.540951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87527e4-fc0a-4f90-9e94-fb048c1a602e service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:25.541226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87527e4-fc0a-4f90-9e94-fb048c1a602e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:25.550675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87527e4-fc0a-4f90-9e94-fb048c1a602e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:25.552160 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87527e4-fc0a-4f90-9e94-fb048c1a602e service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:25.561710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1295/2594] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:28.672254 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc6a2d-6d6e-4e40-a5ad-cc79af3de6ce None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:28.740774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc6a2d-6d6e-4e40-a5ad-cc79af3de6ce None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:28.745245 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22177299-74ab-45e9-96a0-cca287eadd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:28.746126 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22177299-74ab-45e9-96a0-cca287eadd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:28.746398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22177299-74ab-45e9-96a0-cca287eadd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:28.746669 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22177299-74ab-45e9-96a0-cca287eadd61 admin admin] PATH_INFO: `/v3/users/cb14d105cafc44e39af6fbedd23d54a5` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:28.747852 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22177299-74ab-45e9-96a0-cca287eadd61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb14d105cafc44e39af6fbedd23d54a5)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:28.749840 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22177299-74ab-45e9-96a0-cca287eadd61 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:28.807922 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-22177299-74ab-45e9-96a0-cca287eadd61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb14d105cafc44e39af6fbedd23d54a5'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:28.808607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-22177299-74ab-45e9-96a0-cca287eadd61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb14d105cafc44e39af6fbedd23d54a5'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:28.820483 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-22177299-74ab-45e9-96a0-cca287eadd61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb14d105cafc44e39af6fbedd23d54a5'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:28.821183 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-22177299-74ab-45e9-96a0-cca287eadd61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb14d105cafc44e39af6fbedd23d54a5'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:28.835239 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-22177299-74ab-45e9-96a0-cca287eadd61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb14d105cafc44e39af6fbedd23d54a5'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:28.851374 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1300/2595] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:28 2022] DELETE /identity/v3/users/cb14d105cafc44e39af6fbedd23d54a5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:28.856071 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380655f7-ea15-4990-9b88-ba4325bfe1ea None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:28.856688 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380655f7-ea15-4990-9b88-ba4325bfe1ea None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:28.856819 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380655f7-ea15-4990-9b88-ba4325bfe1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:28.874780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-380655f7-ea15-4990-9b88-ba4325bfe1ea None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:28.876467 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-380655f7-ea15-4990-9b88-ba4325bfe1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:28.946877 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1296/2596] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:02:28.958611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22177299-74ab-45e9-96a0-cca287eadd61 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:28.960332 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-22177299-74ab-45e9-96a0-cca287eadd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:29.031771 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22177299-74ab-45e9-96a0-cca287eadd61 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:29.036018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0aef9c-b5ef-4b0d-aad4-deb56c9f280a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:29.036721 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aef9c-b5ef-4b0d-aad4-deb56c9f280a service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:29.037027 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aef9c-b5ef-4b0d-aad4-deb56c9f280a service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:29.037325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0aef9c-b5ef-4b0d-aad4-deb56c9f280a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:29.048412 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0aef9c-b5ef-4b0d-aad4-deb56c9f280a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:29.049945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0aef9c-b5ef-4b0d-aad4-deb56c9f280a service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:29.062368 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1301/2597] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:29.363709 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380655f7-ea15-4990-9b88-ba4325bfe1ea None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:29.365943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-380655f7-ea15-4990-9b88-ba4325bfe1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:29.382358 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380655f7-ea15-4990-9b88-ba4325bfe1ea None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:29.388092 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22345460-a35e-4931-95cd-e77e1ccbc6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:29.389192 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22345460-a35e-4931-95cd-e77e1ccbc6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:29.389627 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22345460-a35e-4931-95cd-e77e1ccbc6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:29.389986 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22345460-a35e-4931-95cd-e77e1ccbc6cf admin admin] PATH_INFO: `/v3/projects/5d502ceb49104b0e9b09de1990ec7474` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:29.391615 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22345460-a35e-4931-95cd-e77e1ccbc6cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d502ceb49104b0e9b09de1990ec7474)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:29.393583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22345460-a35e-4931-95cd-e77e1ccbc6cf admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:29.455481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-22345460-a35e-4931-95cd-e77e1ccbc6cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d502ceb49104b0e9b09de1990ec7474', 'request_id': 'req-22345460-a35e-4931-95cd-e77e1ccbc6cf'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:29.468279 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-22345460-a35e-4931-95cd-e77e1ccbc6cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d502ceb49104b0e9b09de1990ec7474', 'request_id': 'req-22345460-a35e-4931-95cd-e77e1ccbc6cf'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:29.474623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-22345460-a35e-4931-95cd-e77e1ccbc6cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d502ceb49104b0e9b09de1990ec7474', 'request_id': 'req-22345460-a35e-4931-95cd-e77e1ccbc6cf'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:29.487191 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-22345460-a35e-4931-95cd-e77e1ccbc6cf admin admin] The token cache is being invalidate because project 5d502ceb49104b0e9b09de1990ec7474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:29.487534 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-22345460-a35e-4931-95cd-e77e1ccbc6cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:29.488446 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-22345460-a35e-4931-95cd-e77e1ccbc6cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:29.490209 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1297/2598] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:29 2022] DELETE /identity/v3/projects/5d502ceb49104b0e9b09de1990ec7474 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:02:29.495603 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ab584-fe5c-499b-b179-2668d4d233f5 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:29.495918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ab584-fe5c-499b-b179-2668d4d233f5 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:29.496240 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ab584-fe5c-499b-b179-2668d4d233f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:29.516194 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-924ab584-fe5c-499b-b179-2668d4d233f5 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:29.517474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-924ab584-fe5c-499b-b179-2668d4d233f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:29.585806 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1302/2599] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:29.594318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85f29c-977a-422b-9974-3a63a5969742 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:29.594643 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85f29c-977a-422b-9974-3a63a5969742 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:29.594935 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85f29c-977a-422b-9974-3a63a5969742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:29.614425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-8e85f29c-977a-422b-9974-3a63a5969742 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:29.615621 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-8e85f29c-977a-422b-9974-3a63a5969742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:29.624776 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1298/2600] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:29.630056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ab584-fe5c-499b-b179-2668d4d233f5 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:29.641062 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ab584-fe5c-499b-b179-2668d4d233f5 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:29.647570 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d4ab1-f619-4861-b338-dd0670dc6bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:29.648566 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d4ab1-f619-4861-b338-dd0670dc6bad admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:29.649257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d4ab1-f619-4861-b338-dd0670dc6bad admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:29.649385 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d4ab1-f619-4861-b338-dd0670dc6bad admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:29.650328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d4ab1-f619-4861-b338-dd0670dc6bad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:02:29.651348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d4ab1-f619-4861-b338-dd0670dc6bad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:29.653381 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d4ab1-f619-4861-b338-dd0670dc6bad admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:29.671410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1303/2601] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:02:29.676125 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85f29c-977a-422b-9974-3a63a5969742 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:29.686541 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85f29c-977a-422b-9974-3a63a5969742 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:29.692322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9401dd2-b3b8-4672-9b69-ee921ed39d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:29.692996 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9401dd2-b3b8-4672-9b69-ee921ed39d40 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:29.693365 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9401dd2-b3b8-4672-9b69-ee921ed39d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:29.693654 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9401dd2-b3b8-4672-9b69-ee921ed39d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:29.694369 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9401dd2-b3b8-4672-9b69-ee921ed39d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:29.696333 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9401dd2-b3b8-4672-9b69-ee921ed39d40 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:29.730233 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1299/2602] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:02:29 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:29.735620 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d4ab1-f619-4861-b338-dd0670dc6bad admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:29.749184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d4ab1-f619-4861-b338-dd0670dc6bad admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:29.811452 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c42d3-70c7-44b7-be36-4e9e6a8ad97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:29.812160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c42d3-70c7-44b7-be36-4e9e6a8ad97a admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:29.812663 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c42d3-70c7-44b7-be36-4e9e6a8ad97a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:29.812935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c42d3-70c7-44b7-be36-4e9e6a8ad97a admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:29.813631 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c42d3-70c7-44b7-be36-4e9e6a8ad97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:29.815536 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c42d3-70c7-44b7-be36-4e9e6a8ad97a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:29.841030 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1304/2603] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:02:29 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:29.845827 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9401dd2-b3b8-4672-9b69-ee921ed39d40 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:29.856174 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9401dd2-b3b8-4672-9b69-ee921ed39d40 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:29.862573 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041fdbc-2e90-46b2-bd00-c879cf5a51f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:29.863628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041fdbc-2e90-46b2-bd00-c879cf5a51f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:29.864078 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041fdbc-2e90-46b2-bd00-c879cf5a51f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:29.864602 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041fdbc-2e90-46b2-bd00-c879cf5a51f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:29.865835 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041fdbc-2e90-46b2-bd00-c879cf5a51f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:29.868480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041fdbc-2e90-46b2-bd00-c879cf5a51f3 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:29.888658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1300/2604] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:29.893784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c42d3-70c7-44b7-be36-4e9e6a8ad97a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:29.910728 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c42d3-70c7-44b7-be36-4e9e6a8ad97a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:29.915880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa52a39-06bf-446e-b7dd-49d662520fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:29.916573 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa52a39-06bf-446e-b7dd-49d662520fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:29.916857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa52a39-06bf-446e-b7dd-49d662520fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:29.917133 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa52a39-06bf-446e-b7dd-49d662520fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:29.917857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa52a39-06bf-446e-b7dd-49d662520fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:29.919454 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa52a39-06bf-446e-b7dd-49d662520fb2 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:29.930205 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1305/2605] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:29.936107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041fdbc-2e90-46b2-bd00-c879cf5a51f3 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:29.946000 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041fdbc-2e90-46b2-bd00-c879cf5a51f3 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:29.950458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4256ca-eb79-435e-9e8a-2cc06aca71d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:29.951321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4256ca-eb79-435e-9e8a-2cc06aca71d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:29.951595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4256ca-eb79-435e-9e8a-2cc06aca71d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:29.951862 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4256ca-eb79-435e-9e8a-2cc06aca71d5 admin admin] PATH_INFO: `/v3/projects/88c86212a3124bc2883830613eb3ca1d/users/95da40a66efb465d9b5e71066bc59cca/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:29.972462 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4256ca-eb79-435e-9e8a-2cc06aca71d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c86212a3124bc2883830613eb3ca1d, user_id=95da40a66efb465d9b5e71066bc59cca, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:29.982278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4256ca-eb79-435e-9e8a-2cc06aca71d5 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:29.996956 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1301/2606] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:29 2022] PUT /identity/v3/projects/88c86212a3124bc2883830613eb3ca1d/users/95da40a66efb465d9b5e71066bc59cca/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:30.009372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d7019-fa25-46af-8711-d39319c547b4 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:30.009659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d7019-fa25-46af-8711-d39319c547b4 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:30.009966 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d7019-fa25-46af-8711-d39319c547b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:30.037589 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-973d7019-fa25-46af-8711-d39319c547b4 None None] MFA Rules not processed for user `95da40a66efb465d9b5e71066bc59cca`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:30.038888 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-973d7019-fa25-46af-8711-d39319c547b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:30.103484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1306/2607] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:30.116381 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4256ca-eb79-435e-9e8a-2cc06aca71d5 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:30.119001 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5d4256ca-eb79-435e-9e8a-2cc06aca71d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:30.185113 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4256ca-eb79-435e-9e8a-2cc06aca71d5 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:30.189519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12354b35-87ef-474a-bad0-eeb7c5801107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:30.190172 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12354b35-87ef-474a-bad0-eeb7c5801107 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:30.190455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12354b35-87ef-474a-bad0-eeb7c5801107 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:30.190726 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12354b35-87ef-474a-bad0-eeb7c5801107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:30.199921 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12354b35-87ef-474a-bad0-eeb7c5801107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:30.201392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12354b35-87ef-474a-bad0-eeb7c5801107 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:30.210709 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1302/2608] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:40.688628 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d7019-fa25-46af-8711-d39319c547b4 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:40.778746 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d7019-fa25-46af-8711-d39319c547b4 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:40.783880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edcb0f-d93c-469b-882c-653ad8dee25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:40.784793 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edcb0f-d93c-469b-882c-653ad8dee25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:40.785067 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edcb0f-d93c-469b-882c-653ad8dee25c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:40.785333 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edcb0f-d93c-469b-882c-653ad8dee25c admin admin] PATH_INFO: `/v3/users/95da40a66efb465d9b5e71066bc59cca` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:40.786537 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edcb0f-d93c-469b-882c-653ad8dee25c admin admin] RBAC: Authorizing `identity:delete_user(user_id=95da40a66efb465d9b5e71066bc59cca)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:40.788519 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edcb0f-d93c-469b-882c-653ad8dee25c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:40.844547 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e0edcb0f-d93c-469b-882c-653ad8dee25c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95da40a66efb465d9b5e71066bc59cca'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:40.845229 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e0edcb0f-d93c-469b-882c-653ad8dee25c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95da40a66efb465d9b5e71066bc59cca'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:40.858506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e0edcb0f-d93c-469b-882c-653ad8dee25c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95da40a66efb465d9b5e71066bc59cca'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:40.859296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e0edcb0f-d93c-469b-882c-653ad8dee25c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95da40a66efb465d9b5e71066bc59cca'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:40.869867 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e0edcb0f-d93c-469b-882c-653ad8dee25c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95da40a66efb465d9b5e71066bc59cca'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:40.889781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1307/2609] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:40 2022] DELETE /identity/v3/users/95da40a66efb465d9b5e71066bc59cca => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:40.896842 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e2e5c-c24f-43dc-a26a-3079dc31d314 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:40.897558 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e2e5c-c24f-43dc-a26a-3079dc31d314 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:40.897558 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e2e5c-c24f-43dc-a26a-3079dc31d314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:40.916697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-3e1e2e5c-c24f-43dc-a26a-3079dc31d314 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:40.917944 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-3e1e2e5c-c24f-43dc-a26a-3079dc31d314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:40.988067 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1303/2610] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:02:41.000376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edcb0f-d93c-469b-882c-653ad8dee25c admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:41.001967 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e0edcb0f-d93c-469b-882c-653ad8dee25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:41.068175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edcb0f-d93c-469b-882c-653ad8dee25c admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:41.071884 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65227d0-518c-4ff5-81a1-879ca0f8a232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:41.072649 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65227d0-518c-4ff5-81a1-879ca0f8a232 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:41.072960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65227d0-518c-4ff5-81a1-879ca0f8a232 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:41.073296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65227d0-518c-4ff5-81a1-879ca0f8a232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:41.084235 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65227d0-518c-4ff5-81a1-879ca0f8a232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:41.085736 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65227d0-518c-4ff5-81a1-879ca0f8a232 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:41.097217 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1308/2611] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:41.403906 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e2e5c-c24f-43dc-a26a-3079dc31d314 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:41.405692 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-3e1e2e5c-c24f-43dc-a26a-3079dc31d314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:41.421520 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e2e5c-c24f-43dc-a26a-3079dc31d314 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:41.426739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6966341-b88d-4d34-9241-a16fb4aa0009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:41.427628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6966341-b88d-4d34-9241-a16fb4aa0009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:41.427906 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6966341-b88d-4d34-9241-a16fb4aa0009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:41.428190 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6966341-b88d-4d34-9241-a16fb4aa0009 admin admin] PATH_INFO: `/v3/projects/88c86212a3124bc2883830613eb3ca1d` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:41.429553 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6966341-b88d-4d34-9241-a16fb4aa0009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c86212a3124bc2883830613eb3ca1d)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:41.431653 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6966341-b88d-4d34-9241-a16fb4aa0009 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:41.494806 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-d6966341-b88d-4d34-9241-a16fb4aa0009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c86212a3124bc2883830613eb3ca1d', 'request_id': 'req-d6966341-b88d-4d34-9241-a16fb4aa0009'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:41.506673 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-d6966341-b88d-4d34-9241-a16fb4aa0009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c86212a3124bc2883830613eb3ca1d', 'request_id': 'req-d6966341-b88d-4d34-9241-a16fb4aa0009'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:41.514090 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-d6966341-b88d-4d34-9241-a16fb4aa0009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c86212a3124bc2883830613eb3ca1d', 'request_id': 'req-d6966341-b88d-4d34-9241-a16fb4aa0009'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:41.532927 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-d6966341-b88d-4d34-9241-a16fb4aa0009 admin admin] The token cache is being invalidate because project 88c86212a3124bc2883830613eb3ca1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:41.533297 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-d6966341-b88d-4d34-9241-a16fb4aa0009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:41.534093 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-d6966341-b88d-4d34-9241-a16fb4aa0009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:41.536017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1304/2612] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:41 2022] DELETE /identity/v3/projects/88c86212a3124bc2883830613eb3ca1d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:41.545375 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da72a72-dc19-43ca-8b52-2e1e43a14cff None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:41.545862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da72a72-dc19-43ca-8b52-2e1e43a14cff None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:41.546336 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da72a72-dc19-43ca-8b52-2e1e43a14cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:41.571666 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-7da72a72-dc19-43ca-8b52-2e1e43a14cff None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:41.573012 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-7da72a72-dc19-43ca-8b52-2e1e43a14cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:41.637978 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1309/2613] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:41.646977 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c953fab-e34a-43c3-ae31-64ec32d4b5ec None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:41.647271 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c953fab-e34a-43c3-ae31-64ec32d4b5ec None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:41.647605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c953fab-e34a-43c3-ae31-64ec32d4b5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:41.669987 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-2c953fab-e34a-43c3-ae31-64ec32d4b5ec None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:41.671494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-2c953fab-e34a-43c3-ae31-64ec32d4b5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:41.680489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1305/2614] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:41.684894 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da72a72-dc19-43ca-8b52-2e1e43a14cff None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:41.696127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da72a72-dc19-43ca-8b52-2e1e43a14cff None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:41.701140 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba94889-bf42-401e-9af8-4cddc79b4842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:41.701804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba94889-bf42-401e-9af8-4cddc79b4842 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:41.702084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba94889-bf42-401e-9af8-4cddc79b4842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:41.702354 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba94889-bf42-401e-9af8-4cddc79b4842 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:41.703204 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba94889-bf42-401e-9af8-4cddc79b4842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:02:41.703625 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba94889-bf42-401e-9af8-4cddc79b4842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:41.705372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba94889-bf42-401e-9af8-4cddc79b4842 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:41.718736 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1310/2615] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:02:41.723996 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c953fab-e34a-43c3-ae31-64ec32d4b5ec None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:41.740248 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c953fab-e34a-43c3-ae31-64ec32d4b5ec None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:41.748435 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6057b-76a6-4217-a1f1-2943d3845242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:41.749554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6057b-76a6-4217-a1f1-2943d3845242 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:41.750006 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6057b-76a6-4217-a1f1-2943d3845242 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:41.750279 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6057b-76a6-4217-a1f1-2943d3845242 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:41.751103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6057b-76a6-4217-a1f1-2943d3845242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:41.753164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6057b-76a6-4217-a1f1-2943d3845242 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:41.786595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1306/2616] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:02:41 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:41.791033 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba94889-bf42-401e-9af8-4cddc79b4842 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:41.802808 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba94889-bf42-401e-9af8-4cddc79b4842 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:41.879026 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d6f29-2722-4c7b-aac2-faa0265b8560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:41.879939 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d6f29-2722-4c7b-aac2-faa0265b8560 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:41.880372 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d6f29-2722-4c7b-aac2-faa0265b8560 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:41.880814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d6f29-2722-4c7b-aac2-faa0265b8560 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:41.881727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d6f29-2722-4c7b-aac2-faa0265b8560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:41.884002 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d6f29-2722-4c7b-aac2-faa0265b8560 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:41.911555 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1311/2617] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:02:41 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:41.915724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6057b-76a6-4217-a1f1-2943d3845242 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:41.927684 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6057b-76a6-4217-a1f1-2943d3845242 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:41.933250 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900efe86-00dd-4a00-bf34-a81950f8b433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:41.934045 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900efe86-00dd-4a00-bf34-a81950f8b433 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:41.934397 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900efe86-00dd-4a00-bf34-a81950f8b433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:41.934728 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900efe86-00dd-4a00-bf34-a81950f8b433 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:41.935526 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900efe86-00dd-4a00-bf34-a81950f8b433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:41.937294 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900efe86-00dd-4a00-bf34-a81950f8b433 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:41.948922 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1307/2618] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:41.953353 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d6f29-2722-4c7b-aac2-faa0265b8560 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:41.965092 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d6f29-2722-4c7b-aac2-faa0265b8560 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:41.970402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b5839-7901-4166-a268-168fe8091507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:41.971430 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b5839-7901-4166-a268-168fe8091507 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:41.971713 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b5839-7901-4166-a268-168fe8091507 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:41.971983 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b5839-7901-4166-a268-168fe8091507 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:41.972763 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b5839-7901-4166-a268-168fe8091507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:41.974378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b5839-7901-4166-a268-168fe8091507 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:41.987593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1312/2619] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:02:41.992482 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900efe86-00dd-4a00-bf34-a81950f8b433 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:42.004606 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900efe86-00dd-4a00-bf34-a81950f8b433 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:42.010944 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026608e2-c5fd-4212-8ed9-30cf4e8b1124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:42.012513 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026608e2-c5fd-4212-8ed9-30cf4e8b1124 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:42.012839 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026608e2-c5fd-4212-8ed9-30cf4e8b1124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:42.013205 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026608e2-c5fd-4212-8ed9-30cf4e8b1124 admin admin] PATH_INFO: `/v3/projects/5716ca4d4fc14873bdb6a99cecc9ed64/users/68c52946945e41e8910c7179b03af2b6/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:42.031026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026608e2-c5fd-4212-8ed9-30cf4e8b1124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5716ca4d4fc14873bdb6a99cecc9ed64, user_id=68c52946945e41e8910c7179b03af2b6, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:42.033742 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026608e2-c5fd-4212-8ed9-30cf4e8b1124 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:42.048832 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1308/2620] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:41 2022] PUT /identity/v3/projects/5716ca4d4fc14873bdb6a99cecc9ed64/users/68c52946945e41e8910c7179b03af2b6/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:42.054445 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1a6d2-6e86-40fb-a8b7-8074491f8abd None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:42.054730 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1a6d2-6e86-40fb-a8b7-8074491f8abd None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:42.055005 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1a6d2-6e86-40fb-a8b7-8074491f8abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:42.074796 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-17e1a6d2-6e86-40fb-a8b7-8074491f8abd None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:42.076068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-17e1a6d2-6e86-40fb-a8b7-8074491f8abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:42.142692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1313/2621] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:02:42.154072 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026608e2-c5fd-4212-8ed9-30cf4e8b1124 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:42.156139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-026608e2-c5fd-4212-8ed9-30cf4e8b1124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:42.229318 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026608e2-c5fd-4212-8ed9-30cf4e8b1124 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:42.233386 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80cd04-fde6-4028-b90f-fdd7bb2c334f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:42.234179 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80cd04-fde6-4028-b90f-fdd7bb2c334f service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:42.234464 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80cd04-fde6-4028-b90f-fdd7bb2c334f service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:42.234793 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80cd04-fde6-4028-b90f-fdd7bb2c334f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:42.245834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80cd04-fde6-4028-b90f-fdd7bb2c334f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:42.247325 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80cd04-fde6-4028-b90f-fdd7bb2c334f service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:42.259536 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1309/2622] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:45.386299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1a6d2-6e86-40fb-a8b7-8074491f8abd None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:45.389592 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-17e1a6d2-6e86-40fb-a8b7-8074491f8abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:45.470639 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1a6d2-6e86-40fb-a8b7-8074491f8abd None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:45.477104 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fbf83-0941-441a-a51f-6f08bfe57702 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0303312c6cec4067a4a92d38edb59086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:45.478103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fbf83-0941-441a-a51f-6f08bfe57702 service glance] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:45.478536 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fbf83-0941-441a-a51f-6f08bfe57702 service glance] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:45.479124 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fbf83-0941-441a-a51f-6f08bfe57702 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:45.481666 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4b0fbf83-0941-441a-a51f-6f08bfe57702 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:45.620054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fbf83-0941-441a-a51f-6f08bfe57702 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:45.621887 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fbf83-0941-441a-a51f-6f08bfe57702 service glance] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:45.642380 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1314/2623] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:45.950797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80cd04-fde6-4028-b90f-fdd7bb2c334f service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:45.966879 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80cd04-fde6-4028-b90f-fdd7bb2c334f service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:45.973313 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca804ba-bcfe-44ee-a196-f9246b735703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:45.974304 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca804ba-bcfe-44ee-a196-f9246b735703 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:45.974750 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca804ba-bcfe-44ee-a196-f9246b735703 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:45.975307 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca804ba-bcfe-44ee-a196-f9246b735703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:45.978375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-2ca804ba-bcfe-44ee-a196-f9246b735703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:45.999999 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca804ba-bcfe-44ee-a196-f9246b735703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:46.002073 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca804ba-bcfe-44ee-a196-f9246b735703 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:46.018254 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1310/2624] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:47.275321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8df481-57f1-4ad7-bac7-6f8673cae469 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:47.276128 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8df481-57f1-4ad7-bac7-6f8673cae469 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:47.276128 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8df481-57f1-4ad7-bac7-6f8673cae469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:47.316766 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-ab8df481-57f1-4ad7-bac7-6f8673cae469 None None] MFA Rules not processed for user `68c52946945e41e8910c7179b03af2b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:47.318914 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ab8df481-57f1-4ad7-bac7-6f8673cae469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:47.433260 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1315/2625] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:47.435255 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca804ba-bcfe-44ee-a196-f9246b735703 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:47.452401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca804ba-bcfe-44ee-a196-f9246b735703 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:47.464483 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c058e-7be6-442d-9547-5ac1c900958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:47.465956 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c058e-7be6-442d-9547-5ac1c900958e admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:47.466518 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c058e-7be6-442d-9547-5ac1c900958e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:47.467001 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c058e-7be6-442d-9547-5ac1c900958e admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:47.468379 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c058e-7be6-442d-9547-5ac1c900958e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:47.471192 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c058e-7be6-442d-9547-5ac1c900958e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:47.510221 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1311/2626] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:02:47 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:47.516368 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8df481-57f1-4ad7-bac7-6f8673cae469 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:47.530009 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8df481-57f1-4ad7-bac7-6f8673cae469 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:47.606871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4f85b-9343-412a-8e0e-9aaf13179313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:47.608046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4f85b-9343-412a-8e0e-9aaf13179313 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:47.608533 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4f85b-9343-412a-8e0e-9aaf13179313 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:47.608871 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4f85b-9343-412a-8e0e-9aaf13179313 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:47.609746 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4f85b-9343-412a-8e0e-9aaf13179313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:47.612584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4f85b-9343-412a-8e0e-9aaf13179313 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:47.644707 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1316/2627] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:02:47 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:47.649775 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c058e-7be6-442d-9547-5ac1c900958e admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:47.664923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c058e-7be6-442d-9547-5ac1c900958e admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:47.672004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63e75f-6f4d-49e5-8d86-e37570de0c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:47.673107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63e75f-6f4d-49e5-8d86-e37570de0c46 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:47.673516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63e75f-6f4d-49e5-8d86-e37570de0c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:47.673911 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63e75f-6f4d-49e5-8d86-e37570de0c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:47.674746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63e75f-6f4d-49e5-8d86-e37570de0c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:47.676920 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63e75f-6f4d-49e5-8d86-e37570de0c46 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:47.693544 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1312/2628] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:02:47.697850 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4f85b-9343-412a-8e0e-9aaf13179313 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:47.711741 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4f85b-9343-412a-8e0e-9aaf13179313 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:47.723556 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9777b1-0756-4d00-a22d-24e71b2f964a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:47.725496 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9777b1-0756-4d00-a22d-24e71b2f964a admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:47.726839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9777b1-0756-4d00-a22d-24e71b2f964a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:47.727485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9777b1-0756-4d00-a22d-24e71b2f964a admin admin] PATH_INFO: `/v3/projects/f43c077d00bf496ba3a6d9df1400e35e/users/8f6ea06b452d4f85829008d7fc3ea858/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:47.749516 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9777b1-0756-4d00-a22d-24e71b2f964a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43c077d00bf496ba3a6d9df1400e35e, user_id=8f6ea06b452d4f85829008d7fc3ea858, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:47.752323 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9777b1-0756-4d00-a22d-24e71b2f964a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:47.770448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1317/2629] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:47 2022] PUT /identity/v3/projects/f43c077d00bf496ba3a6d9df1400e35e/users/8f6ea06b452d4f85829008d7fc3ea858/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:47.776018 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63e75f-6f4d-49e5-8d86-e37570de0c46 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:47.790961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63e75f-6f4d-49e5-8d86-e37570de0c46 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:47.884794 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d46fc-837c-4871-9a10-74bee6522b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:47.885855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d46fc-837c-4871-9a10-74bee6522b98 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:47.886293 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d46fc-837c-4871-9a10-74bee6522b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:47.886741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d46fc-837c-4871-9a10-74bee6522b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:47.887907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d46fc-837c-4871-9a10-74bee6522b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:47.890032 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d46fc-837c-4871-9a10-74bee6522b98 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:47.904034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1313/2630] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:47.908591 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9777b1-0756-4d00-a22d-24e71b2f964a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:47.920005 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9777b1-0756-4d00-a22d-24e71b2f964a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:47.925241 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbcddf-867a-408a-8bed-75730e89e32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:47.926155 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbcddf-867a-408a-8bed-75730e89e32b admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:47.926438 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbcddf-867a-408a-8bed-75730e89e32b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:47.926709 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbcddf-867a-408a-8bed-75730e89e32b admin admin] PATH_INFO: `/v3/projects/f43c077d00bf496ba3a6d9df1400e35e/users/8f6ea06b452d4f85829008d7fc3ea858/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:47.928805 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbcddf-867a-408a-8bed-75730e89e32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43c077d00bf496ba3a6d9df1400e35e, user_id=8f6ea06b452d4f85829008d7fc3ea858, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:47.931735 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbcddf-867a-408a-8bed-75730e89e32b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:47.942948 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1318/2631] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:47 2022] PUT /identity/v3/projects/f43c077d00bf496ba3a6d9df1400e35e/users/8f6ea06b452d4f85829008d7fc3ea858/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:53.589747 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba383c2-d5ea-47f3-86fb-7d1a9b144162 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:53.590456 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba383c2-d5ea-47f3-86fb-7d1a9b144162 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:53.590456 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba383c2-d5ea-47f3-86fb-7d1a9b144162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:53.626645 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-cba383c2-d5ea-47f3-86fb-7d1a9b144162 None None] MFA Rules not processed for user `8f6ea06b452d4f85829008d7fc3ea858`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:53.627860 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-cba383c2-d5ea-47f3-86fb-7d1a9b144162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:53.713390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1314/2632] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:02:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:53.741004 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbcddf-867a-408a-8bed-75730e89e32b admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:53.834977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbcddf-867a-408a-8bed-75730e89e32b admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:53.839318 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98221c0f-64dc-4376-8c33-826ab15d48ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0303312c6cec4067a4a92d38edb59086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:53.839996 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98221c0f-64dc-4376-8c33-826ab15d48ba service glance] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:53.840338 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98221c0f-64dc-4376-8c33-826ab15d48ba service glance] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:53.840608 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98221c0f-64dc-4376-8c33-826ab15d48ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:53.938391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98221c0f-64dc-4376-8c33-826ab15d48ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:53.939909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98221c0f-64dc-4376-8c33-826ab15d48ba service glance] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:53.954221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1319/2633] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:54.098308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa27db-c18f-4ac9-9893-87a6e01b83b9 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:54.098605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa27db-c18f-4ac9-9893-87a6e01b83b9 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:54.098888 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa27db-c18f-4ac9-9893-87a6e01b83b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:54.130390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-f1aa27db-c18f-4ac9-9893-87a6e01b83b9 None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:54.133294 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f1aa27db-c18f-4ac9-9893-87a6e01b83b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:54.226242 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1315/2634] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Nov 2 13:02:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:54.295223 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98221c0f-64dc-4376-8c33-826ab15d48ba service glance] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:54.296947 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-98221c0f-64dc-4376-8c33-826ab15d48ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:54.403710 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98221c0f-64dc-4376-8c33-826ab15d48ba service glance] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:54.410374 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8b634-3738-4fbf-8027-e3b7efee16be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:54.411185 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8b634-3738-4fbf-8027-e3b7efee16be service swift] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:54.411590 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8b634-3738-4fbf-8027-e3b7efee16be service swift] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:54.411987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8b634-3738-4fbf-8027-e3b7efee16be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:54.422554 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8b634-3738-4fbf-8027-e3b7efee16be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:54.424054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8b634-3738-4fbf-8027-e3b7efee16be service swift] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:54.433759 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1320/2635] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 13:02:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:03:00.565834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa27db-c18f-4ac9-9893-87a6e01b83b9 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:00.569348 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f1aa27db-c18f-4ac9-9893-87a6e01b83b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:00.776042 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa27db-c18f-4ac9-9893-87a6e01b83b9 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:00.782013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd82be-eaf9-4527-918b-2d668f8e3908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:00.782770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd82be-eaf9-4527-918b-2d668f8e3908 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:00.782940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd82be-eaf9-4527-918b-2d668f8e3908 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:00.783217 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd82be-eaf9-4527-918b-2d668f8e3908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:00.785820 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-37fd82be-eaf9-4527-918b-2d668f8e3908 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:00.944789 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd82be-eaf9-4527-918b-2d668f8e3908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:00.951259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd82be-eaf9-4527-918b-2d668f8e3908 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:00.995937 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1316/2636] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:03.927782 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063fb1e-f09e-4156-bdcb-2ca79833b448 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:03.928388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063fb1e-f09e-4156-bdcb-2ca79833b448 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:03.928388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063fb1e-f09e-4156-bdcb-2ca79833b448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:03.948949 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-3063fb1e-f09e-4156-bdcb-2ca79833b448 None None] MFA Rules not processed for user `68c52946945e41e8910c7179b03af2b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:03.950496 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-3063fb1e-f09e-4156-bdcb-2ca79833b448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:03.958203 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1321/2637] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:03:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:04.191758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e6e56-75ce-43f3-b89e-ab861f20847f None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:04.192317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e6e56-75ce-43f3-b89e-ab861f20847f None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:04.192452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e6e56-75ce-43f3-b89e-ab861f20847f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:04.212953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-cc9e6e56-75ce-43f3-b89e-ab861f20847f None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:04.214468 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-cc9e6e56-75ce-43f3-b89e-ab861f20847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:04.228323 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1317/2638] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Nov 2 13:03:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:04.239918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063fb1e-f09e-4156-bdcb-2ca79833b448 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:04.257394 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063fb1e-f09e-4156-bdcb-2ca79833b448 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:04.258848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f71da2-4687-40d4-89f5-3e5a2434363e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:04.259507 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f71da2-4687-40d4-89f5-3e5a2434363e service swift] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:04.259785 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f71da2-4687-40d4-89f5-3e5a2434363e service swift] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:04.260056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f71da2-4687-40d4-89f5-3e5a2434363e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:04.270573 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f71da2-4687-40d4-89f5-3e5a2434363e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:04.272276 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f71da2-4687-40d4-89f5-3e5a2434363e service swift] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:04.281945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1322/2639] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 13:03:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 13:03:08.497441 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20847-0c87-408e-b1ab-9a6ef2ea5ab1 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:08.498006 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20847-0c87-408e-b1ab-9a6ef2ea5ab1 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:08.498164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20847-0c87-408e-b1ab-9a6ef2ea5ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:08.533607 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-71b20847-0c87-408e-b1ab-9a6ef2ea5ab1 None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:08.534959 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-71b20847-0c87-408e-b1ab-9a6ef2ea5ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:08.543401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1318/2640] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Nov 2 13:03:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:08.557348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f71da2-4687-40d4-89f5-3e5a2434363e service swift] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:08.569777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f71da2-4687-40d4-89f5-3e5a2434363e service swift] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:08.577303 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c400e1-17c8-477b-8e5b-d2ad3cb32244 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:08.578296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c400e1-17c8-477b-8e5b-d2ad3cb32244 service swift] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:08.579335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c400e1-17c8-477b-8e5b-d2ad3cb32244 service swift] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:08.579949 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c400e1-17c8-477b-8e5b-d2ad3cb32244 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:08.592841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c400e1-17c8-477b-8e5b-d2ad3cb32244 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:08.594999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c400e1-17c8-477b-8e5b-d2ad3cb32244 service swift] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:08.606363 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1323/2641] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 13:03:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:03:18.122163 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ab00d-d0ef-4e89-8092-99026ee15287 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:18.122826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ab00d-d0ef-4e89-8092-99026ee15287 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:18.122826 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ab00d-d0ef-4e89-8092-99026ee15287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:18.141821 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-5d1ab00d-d0ef-4e89-8092-99026ee15287 None None] MFA Rules not processed for user `8c01ed6e76ef4ee4ba5356c526e113e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:18.143066 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5d1ab00d-d0ef-4e89-8092-99026ee15287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:18.204819 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1319/2642] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:03:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:24.742705 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c400e1-17c8-477b-8e5b-d2ad3cb32244 service swift] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:24.744299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-07c400e1-17c8-477b-8e5b-d2ad3cb32244 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:24.760173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c400e1-17c8-477b-8e5b-d2ad3cb32244 service swift] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:24.767548 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceac96-1151-4480-9aa4-5ad768a6ae1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:24.768224 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceac96-1151-4480-9aa4-5ad768a6ae1f service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:24.768577 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceac96-1151-4480-9aa4-5ad768a6ae1f service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:24.768856 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceac96-1151-4480-9aa4-5ad768a6ae1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:24.770691 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-afceac96-1151-4480-9aa4-5ad768a6ae1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:24.783507 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceac96-1151-4480-9aa4-5ad768a6ae1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:24.785177 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceac96-1151-4480-9aa4-5ad768a6ae1f service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:24.797384 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1324/2643] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:34.415937 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b58b1c-c4eb-45f3-aafd-de08ed5e3ba2 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:34.416524 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b58b1c-c4eb-45f3-aafd-de08ed5e3ba2 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:34.416661 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b58b1c-c4eb-45f3-aafd-de08ed5e3ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:34.434939 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-10b58b1c-c4eb-45f3-aafd-de08ed5e3ba2 None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:34.436480 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-10b58b1c-c4eb-45f3-aafd-de08ed5e3ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:34.445107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1320/2644] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Nov 2 13:03:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:34.458469 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceac96-1151-4480-9aa4-5ad768a6ae1f service nova] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:34.470733 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceac96-1151-4480-9aa4-5ad768a6ae1f service nova] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:34.476472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82c8e5-c140-4c9f-9874-a6a247eee5ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:34.477150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82c8e5-c140-4c9f-9874-a6a247eee5ae service swift] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:34.477455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82c8e5-c140-4c9f-9874-a6a247eee5ae service swift] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:34.477729 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82c8e5-c140-4c9f-9874-a6a247eee5ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:34.486187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82c8e5-c140-4c9f-9874-a6a247eee5ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:34.487814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82c8e5-c140-4c9f-9874-a6a247eee5ae service swift] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:34.495776 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1325/2645] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 13:03:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:03:52.570288 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b58b1c-c4eb-45f3-aafd-de08ed5e3ba2 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:52.584231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b58b1c-c4eb-45f3-aafd-de08ed5e3ba2 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:52.589832 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23f8fa-493e-4f83-ba9b-3f0ad362019f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:52.590492 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23f8fa-493e-4f83-ba9b-3f0ad362019f service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:52.590765 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23f8fa-493e-4f83-ba9b-3f0ad362019f service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:52.591033 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23f8fa-493e-4f83-ba9b-3f0ad362019f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:52.592972 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0d23f8fa-493e-4f83-ba9b-3f0ad362019f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:52.606496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23f8fa-493e-4f83-ba9b-3f0ad362019f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:52.608450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23f8fa-493e-4f83-ba9b-3f0ad362019f service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:52.622246 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1321/2646] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:53.033394 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82c8e5-c140-4c9f-9874-a6a247eee5ae service swift] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:53.095334 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82c8e5-c140-4c9f-9874-a6a247eee5ae service swift] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:53.099628 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d59cf-3740-46f1-8c5c-c5582555f794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:53.100332 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d59cf-3740-46f1-8c5c-c5582555f794 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:53.100612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d59cf-3740-46f1-8c5c-c5582555f794 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:53.100880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d59cf-3740-46f1-8c5c-c5582555f794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:53.102950 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b21d59cf-3740-46f1-8c5c-c5582555f794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:53.115066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d59cf-3740-46f1-8c5c-c5582555f794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:53.116771 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d59cf-3740-46f1-8c5c-c5582555f794 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:53.125330 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1326/2647] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:55.937314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23f8fa-493e-4f83-ba9b-3f0ad362019f service nova] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:55.939414 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0d23f8fa-493e-4f83-ba9b-3f0ad362019f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:55.953916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23f8fa-493e-4f83-ba9b-3f0ad362019f service nova] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:55.959609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a17807-f31c-4ba0-9d28-ecd7c2dcb4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:55.960398 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a17807-f31c-4ba0-9d28-ecd7c2dcb4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:55.960721 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a17807-f31c-4ba0-9d28-ecd7c2dcb4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:55.961078 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a17807-f31c-4ba0-9d28-ecd7c2dcb4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:55.963201 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-53a17807-f31c-4ba0-9d28-ecd7c2dcb4f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:56.040024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a17807-f31c-4ba0-9d28-ecd7c2dcb4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:56.041638 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a17807-f31c-4ba0-9d28-ecd7c2dcb4f9 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:56.055964 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1322/2648] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:59.263998 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ce18a-9bac-4ce6-84b3-ebc5dbd1d8f8 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:59.264868 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ce18a-9bac-4ce6-84b3-ebc5dbd1d8f8 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:59.264868 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ce18a-9bac-4ce6-84b3-ebc5dbd1d8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:59.288542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-295ce18a-9bac-4ce6-84b3-ebc5dbd1d8f8 None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:59.289876 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-295ce18a-9bac-4ce6-84b3-ebc5dbd1d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:59.298273 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1327/2649] 10.222.0.90 () {58 vars in 967 bytes} [Wed Nov 2 13:03:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:59.321926 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a17807-f31c-4ba0-9d28-ecd7c2dcb4f9 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:59.341225 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a17807-f31c-4ba0-9d28-ecd7c2dcb4f9 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:59.348568 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d3c64-b4fe-4fdc-97cd-9c393441524f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:59.349345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d3c64-b4fe-4fdc-97cd-9c393441524f service swift] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:59.349661 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d3c64-b4fe-4fdc-97cd-9c393441524f service swift] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:59.349937 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d3c64-b4fe-4fdc-97cd-9c393441524f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:59.360053 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d3c64-b4fe-4fdc-97cd-9c393441524f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:59.361690 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d3c64-b4fe-4fdc-97cd-9c393441524f service swift] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:59.370501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1323/2650] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 13:03:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:04:00.258848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ce18a-9bac-4ce6-84b3-ebc5dbd1d8f8 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:00.275213 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ce18a-9bac-4ce6-84b3-ebc5dbd1d8f8 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:00.280111 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668e132-73cb-407f-a524-1d92a9f36386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:00.280826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668e132-73cb-407f-a524-1d92a9f36386 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:00.281108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668e132-73cb-407f-a524-1d92a9f36386 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:00.281378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668e132-73cb-407f-a524-1d92a9f36386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:00.291464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668e132-73cb-407f-a524-1d92a9f36386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:00.293111 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668e132-73cb-407f-a524-1d92a9f36386 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:00.303450 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1328/2651] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:01.513308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d3c64-b4fe-4fdc-97cd-9c393441524f service swift] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:01.526834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d3c64-b4fe-4fdc-97cd-9c393441524f service swift] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:01.533930 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94002a3a-66c6-4762-ab96-b2e789904ce9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:01.534592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94002a3a-66c6-4762-ab96-b2e789904ce9 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:01.534859 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94002a3a-66c6-4762-ab96-b2e789904ce9 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:01.535130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94002a3a-66c6-4762-ab96-b2e789904ce9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:01.537264 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-94002a3a-66c6-4762-ab96-b2e789904ce9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:01.626116 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94002a3a-66c6-4762-ab96-b2e789904ce9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:01.627717 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94002a3a-66c6-4762-ab96-b2e789904ce9 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:01.648319 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1324/2652] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:36.038936 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668e132-73cb-407f-a524-1d92a9f36386 service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:36.050810 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668e132-73cb-407f-a524-1d92a9f36386 service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:36.055545 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2e24e-6c9c-47a4-880a-257ea1043126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:36.056229 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2e24e-6c9c-47a4-880a-257ea1043126 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:36.056750 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2e24e-6c9c-47a4-880a-257ea1043126 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:36.056960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2e24e-6c9c-47a4-880a-257ea1043126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:36.059163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-bef2e24e-6c9c-47a4-880a-257ea1043126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:36.135058 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2e24e-6c9c-47a4-880a-257ea1043126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:36.136911 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2e24e-6c9c-47a4-880a-257ea1043126 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:36.149794 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1329/2653] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:39.470174 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94002a3a-66c6-4762-ab96-b2e789904ce9 service nova] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:39.471737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-94002a3a-66c6-4762-ab96-b2e789904ce9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:39.565327 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94002a3a-66c6-4762-ab96-b2e789904ce9 service nova] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:39.571339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ac034-0f68-45d4-a1a4-499bd0d58bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:39.572265 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ac034-0f68-45d4-a1a4-499bd0d58bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:39.572576 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ac034-0f68-45d4-a1a4-499bd0d58bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:39.572806 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ac034-0f68-45d4-a1a4-499bd0d58bbc admin admin] PATH_INFO: `/v3/users/3a45298a10af4fc3991887cb4da55e86` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:39.574109 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ac034-0f68-45d4-a1a4-499bd0d58bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a45298a10af4fc3991887cb4da55e86)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:39.576052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ac034-0f68-45d4-a1a4-499bd0d58bbc admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:39.629436 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-da7ac034-0f68-45d4-a1a4-499bd0d58bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a45298a10af4fc3991887cb4da55e86'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:39.630321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-da7ac034-0f68-45d4-a1a4-499bd0d58bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a45298a10af4fc3991887cb4da55e86'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:39.647807 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-da7ac034-0f68-45d4-a1a4-499bd0d58bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a45298a10af4fc3991887cb4da55e86'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:39.648832 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-da7ac034-0f68-45d4-a1a4-499bd0d58bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a45298a10af4fc3991887cb4da55e86'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:39.664754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-da7ac034-0f68-45d4-a1a4-499bd0d58bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a45298a10af4fc3991887cb4da55e86'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:39.677813 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1325/2654] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:04:39 2022] DELETE /identity/v3/users/3a45298a10af4fc3991887cb4da55e86 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:39.883002 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2e24e-6c9c-47a4-880a-257ea1043126 service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:39.942490 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2e24e-6c9c-47a4-880a-257ea1043126 service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:40.006485 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972cf61-b221-4ddf-bf4d-bcdc29a92ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:40.007292 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972cf61-b221-4ddf-bf4d-bcdc29a92ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:40.007570 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972cf61-b221-4ddf-bf4d-bcdc29a92ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:40.007848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972cf61-b221-4ddf-bf4d-bcdc29a92ffc admin admin] PATH_INFO: `/v3/projects/ac56ac8efe2d4a07aa0f1c7976ad8fe7` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:40.009074 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972cf61-b221-4ddf-bf4d-bcdc29a92ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac56ac8efe2d4a07aa0f1c7976ad8fe7)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:40.011522 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972cf61-b221-4ddf-bf4d-bcdc29a92ffc admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:40.066113 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4972cf61-b221-4ddf-bf4d-bcdc29a92ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'request_id': 'req-4972cf61-b221-4ddf-bf4d-bcdc29a92ffc'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:40.074697 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4972cf61-b221-4ddf-bf4d-bcdc29a92ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'request_id': 'req-4972cf61-b221-4ddf-bf4d-bcdc29a92ffc'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:40.083052 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4972cf61-b221-4ddf-bf4d-bcdc29a92ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'request_id': 'req-4972cf61-b221-4ddf-bf4d-bcdc29a92ffc'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:40.095160 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4972cf61-b221-4ddf-bf4d-bcdc29a92ffc admin admin] The token cache is being invalidate because project ac56ac8efe2d4a07aa0f1c7976ad8fe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:04:40.095456 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4972cf61-b221-4ddf-bf4d-bcdc29a92ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:40.096413 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4972cf61-b221-4ddf-bf4d-bcdc29a92ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:40.098042 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1330/2655] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:04:39 2022] DELETE /identity/v3/projects/ac56ac8efe2d4a07aa0f1c7976ad8fe7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:40.104539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b2bc4-3a55-48f9-a06f-d3f86af60829 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:40.104838 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b2bc4-3a55-48f9-a06f-d3f86af60829 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:40.105108 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b2bc4-3a55-48f9-a06f-d3f86af60829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:40.136638 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-9c1b2bc4-3a55-48f9-a06f-d3f86af60829 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:40.137883 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-9c1b2bc4-3a55-48f9-a06f-d3f86af60829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:40.198673 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1326/2656] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:04:40.206974 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac6c72-c1e3-45d8-b8dc-d53fdb5cce29 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:40.207270 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac6c72-c1e3-45d8-b8dc-d53fdb5cce29 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:40.207547 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac6c72-c1e3-45d8-b8dc-d53fdb5cce29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:40.228124 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-daac6c72-c1e3-45d8-b8dc-d53fdb5cce29 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:40.229369 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-daac6c72-c1e3-45d8-b8dc-d53fdb5cce29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:40.239589 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1331/2657] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:40.244303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b2bc4-3a55-48f9-a06f-d3f86af60829 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:40.256467 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b2bc4-3a55-48f9-a06f-d3f86af60829 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:40.262989 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362fec2-9a04-4e21-b4cc-eaebf7a7366c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:40.263585 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362fec2-9a04-4e21-b4cc-eaebf7a7366c admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:40.263865 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362fec2-9a04-4e21-b4cc-eaebf7a7366c admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:40.264140 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362fec2-9a04-4e21-b4cc-eaebf7a7366c admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:40.264920 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362fec2-9a04-4e21-b4cc-eaebf7a7366c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:04:40.265227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362fec2-9a04-4e21-b4cc-eaebf7a7366c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:40.266831 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362fec2-9a04-4e21-b4cc-eaebf7a7366c admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:40.279889 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1327/2658] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 13:04:40.285002 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac6c72-c1e3-45d8-b8dc-d53fdb5cce29 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:40.294866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac6c72-c1e3-45d8-b8dc-d53fdb5cce29 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:40.300572 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924188a-fa83-4f7a-be15-3dcb8536eea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:40.301242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924188a-fa83-4f7a-be15-3dcb8536eea1 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:40.301523 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924188a-fa83-4f7a-be15-3dcb8536eea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:40.301801 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924188a-fa83-4f7a-be15-3dcb8536eea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:40.302499 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924188a-fa83-4f7a-be15-3dcb8536eea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:40.304476 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924188a-fa83-4f7a-be15-3dcb8536eea1 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:40.339195 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1332/2659] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:04:40 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:04:40.345766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362fec2-9a04-4e21-b4cc-eaebf7a7366c admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:40.357102 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362fec2-9a04-4e21-b4cc-eaebf7a7366c admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:40.420178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06816003-fe55-4015-a904-f880535ba3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:40.420924 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06816003-fe55-4015-a904-f880535ba3fb admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:40.421271 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06816003-fe55-4015-a904-f880535ba3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:40.421548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06816003-fe55-4015-a904-f880535ba3fb admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:40.422270 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06816003-fe55-4015-a904-f880535ba3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:40.424412 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06816003-fe55-4015-a904-f880535ba3fb admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:40.448440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1328/2660] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:04:40 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:04:40.453542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924188a-fa83-4f7a-be15-3dcb8536eea1 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:40.465308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924188a-fa83-4f7a-be15-3dcb8536eea1 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:40.471523 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad590e-a613-4c2d-8760-dd902904aaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:40.472252 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad590e-a613-4c2d-8760-dd902904aaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:40.472586 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad590e-a613-4c2d-8760-dd902904aaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:40.472866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad590e-a613-4c2d-8760-dd902904aaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:40.473639 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad590e-a613-4c2d-8760-dd902904aaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:40.475277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad590e-a613-4c2d-8760-dd902904aaa6 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:40.486892 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1333/2661] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:04:40.493039 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06816003-fe55-4015-a904-f880535ba3fb admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:40.505038 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06816003-fe55-4015-a904-f880535ba3fb admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:40.511857 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c65408-fd30-47d0-8a4d-b73a1936d3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:40.512661 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c65408-fd30-47d0-8a4d-b73a1936d3ee admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:40.513246 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c65408-fd30-47d0-8a4d-b73a1936d3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:40.513630 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c65408-fd30-47d0-8a4d-b73a1936d3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:40.514364 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c65408-fd30-47d0-8a4d-b73a1936d3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:40.516957 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c65408-fd30-47d0-8a4d-b73a1936d3ee admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:40.530455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1329/2662] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:04:40.537197 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad590e-a613-4c2d-8760-dd902904aaa6 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:40.548617 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad590e-a613-4c2d-8760-dd902904aaa6 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:40.553880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd022978-3bfa-4436-8020-a71309237e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:40.555254 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd022978-3bfa-4436-8020-a71309237e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:40.555254 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd022978-3bfa-4436-8020-a71309237e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:40.555468 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd022978-3bfa-4436-8020-a71309237e73 admin admin] PATH_INFO: `/v3/projects/19aa22fb93224586a50c7447a5310ecd/users/6c571f8eb3fc4943b2316de141d624c8/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:40.573288 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd022978-3bfa-4436-8020-a71309237e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19aa22fb93224586a50c7447a5310ecd, user_id=6c571f8eb3fc4943b2316de141d624c8, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:40.576585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd022978-3bfa-4436-8020-a71309237e73 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:40.594729 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1334/2663] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:04:40 2022] PUT /identity/v3/projects/19aa22fb93224586a50c7447a5310ecd/users/6c571f8eb3fc4943b2316de141d624c8/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:40.600226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d15325-65c1-4069-9dfd-a3c5bde23bec None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:40.600560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d15325-65c1-4069-9dfd-a3c5bde23bec None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:40.600851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d15325-65c1-4069-9dfd-a3c5bde23bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:40.619911 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e8d15325-65c1-4069-9dfd-a3c5bde23bec None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:40.621303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e8d15325-65c1-4069-9dfd-a3c5bde23bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:40.693766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1330/2664] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:40.704882 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd022978-3bfa-4436-8020-a71309237e73 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:40.707526 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-bd022978-3bfa-4436-8020-a71309237e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:40.826054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd022978-3bfa-4436-8020-a71309237e73 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:40.832762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180b2e5-06ca-4dca-bc37-fbab4c3f8736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:40.833440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180b2e5-06ca-4dca-bc37-fbab4c3f8736 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:40.834140 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180b2e5-06ca-4dca-bc37-fbab4c3f8736 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:40.834459 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180b2e5-06ca-4dca-bc37-fbab4c3f8736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:40.847845 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180b2e5-06ca-4dca-bc37-fbab4c3f8736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:40.849339 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180b2e5-06ca-4dca-bc37-fbab4c3f8736 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:40.861337 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1335/2665] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:44.953307 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d55ff-f4b6-4603-9ed0-5f9a1e885c94 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:44.954163 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d55ff-f4b6-4603-9ed0-5f9a1e885c94 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:44.954434 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d55ff-f4b6-4603-9ed0-5f9a1e885c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:44.989512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-200d55ff-f4b6-4603-9ed0-5f9a1e885c94 None None] MFA Rules not processed for user `6c571f8eb3fc4943b2316de141d624c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:44.990416 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-200d55ff-f4b6-4603-9ed0-5f9a1e885c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:45.066589 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1331/2666] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:04:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:45.082841 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180b2e5-06ca-4dca-bc37-fbab4c3f8736 service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:45.084333 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b180b2e5-06ca-4dca-bc37-fbab4c3f8736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:45.175396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180b2e5-06ca-4dca-bc37-fbab4c3f8736 service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:45.181175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc1ef9-424d-43c3-a841-38e34fe9f285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:45.181862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc1ef9-424d-43c3-a841-38e34fe9f285 service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:45.182142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc1ef9-424d-43c3-a841-38e34fe9f285 service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:45.182415 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc1ef9-424d-43c3-a841-38e34fe9f285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:45.191800 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc1ef9-424d-43c3-a841-38e34fe9f285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:45.193544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc1ef9-424d-43c3-a841-38e34fe9f285 service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:45.204284 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1336/2667] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:46.570071 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a12da-67f8-4219-92aa-902d73cf3e4e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:46.570570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a12da-67f8-4219-92aa-902d73cf3e4e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:46.570570 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a12da-67f8-4219-92aa-902d73cf3e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:46.597278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-a46a12da-67f8-4219-92aa-902d73cf3e4e None None] MFA Rules not processed for user `6c571f8eb3fc4943b2316de141d624c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:46.598530 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a46a12da-67f8-4219-92aa-902d73cf3e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:46.606898 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1332/2668] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:04:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:04:46.936381 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc1ef9-424d-43c3-a841-38e34fe9f285 service nova] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:46.948402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc1ef9-424d-43c3-a841-38e34fe9f285 service nova] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:46.952715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb580d-b40d-4bc1-923b-30551a62c95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:46.953364 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb580d-b40d-4bc1-923b-30551a62c95e service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:46.953636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb580d-b40d-4bc1-923b-30551a62c95e service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:46.953908 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb580d-b40d-4bc1-923b-30551a62c95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:46.955869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-7abb580d-b40d-4bc1-923b-30551a62c95e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:46.967664 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb580d-b40d-4bc1-923b-30551a62c95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:46.969190 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb580d-b40d-4bc1-923b-30551a62c95e service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:46.978507 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1337/2669] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:47.319253 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a12da-67f8-4219-92aa-902d73cf3e4e None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:47.320687 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a46a12da-67f8-4219-92aa-902d73cf3e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:47.417956 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a12da-67f8-4219-92aa-902d73cf3e4e None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:47.423013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17b90c-2bed-4bc5-882e-fb3aea4b91c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:47.423599 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17b90c-2bed-4bc5-882e-fb3aea4b91c6 service placement] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:47.423877 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17b90c-2bed-4bc5-882e-fb3aea4b91c6 service placement] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:47.424313 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17b90c-2bed-4bc5-882e-fb3aea4b91c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:47.426220 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0a17b90c-2bed-4bc5-882e-fb3aea4b91c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:47.438251 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17b90c-2bed-4bc5-882e-fb3aea4b91c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:47.439884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17b90c-2bed-4bc5-882e-fb3aea4b91c6 service placement] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:47.450662 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1333/2670] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:26.283110 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb580d-b40d-4bc1-923b-30551a62c95e service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:26.284905 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-7abb580d-b40d-4bc1-923b-30551a62c95e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:26.300694 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb580d-b40d-4bc1-923b-30551a62c95e service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:26.307720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9c699-ee09-488d-b191-8cb5bb32e2d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:26.308502 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9c699-ee09-488d-b191-8cb5bb32e2d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:26.308922 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9c699-ee09-488d-b191-8cb5bb32e2d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:26.309396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9c699-ee09-488d-b191-8cb5bb32e2d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:26.313484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-9ea9c699-ee09-488d-b191-8cb5bb32e2d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:26.327815 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9c699-ee09-488d-b191-8cb5bb32e2d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:26.329449 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9c699-ee09-488d-b191-8cb5bb32e2d0 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:26.340784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1338/2671] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:05:29.778441 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17b90c-2bed-4bc5-882e-fb3aea4b91c6 service placement] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:29.779940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0a17b90c-2bed-4bc5-882e-fb3aea4b91c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:29.796501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17b90c-2bed-4bc5-882e-fb3aea4b91c6 service placement] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:29.804315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c4a53-4ab7-49c9-bdf0-1ab42ec7424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:29.804315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c4a53-4ab7-49c9-bdf0-1ab42ec7424e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:29.804315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c4a53-4ab7-49c9-bdf0-1ab42ec7424e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:29.804315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c4a53-4ab7-49c9-bdf0-1ab42ec7424e admin admin] PATH_INFO: `/v3/users/a2c786462bac45848eeff3a966e71149` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:29.806605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c4a53-4ab7-49c9-bdf0-1ab42ec7424e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c786462bac45848eeff3a966e71149)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:29.808968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c4a53-4ab7-49c9-bdf0-1ab42ec7424e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:29.858515 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e15c4a53-4ab7-49c9-bdf0-1ab42ec7424e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c786462bac45848eeff3a966e71149'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:29.859216 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e15c4a53-4ab7-49c9-bdf0-1ab42ec7424e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c786462bac45848eeff3a966e71149'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:29.870538 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e15c4a53-4ab7-49c9-bdf0-1ab42ec7424e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c786462bac45848eeff3a966e71149'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:29.871243 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e15c4a53-4ab7-49c9-bdf0-1ab42ec7424e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c786462bac45848eeff3a966e71149'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:29.880415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e15c4a53-4ab7-49c9-bdf0-1ab42ec7424e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c786462bac45848eeff3a966e71149'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:29.893459 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1334/2672] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:05:29 2022] DELETE /identity/v3/users/a2c786462bac45848eeff3a966e71149 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:30.084626 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9c699-ee09-488d-b191-8cb5bb32e2d0 service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:30.095180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9c699-ee09-488d-b191-8cb5bb32e2d0 service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:30.160930 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2587a08-37e6-4a34-8cba-6b95a40b3df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:30.161779 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587a08-37e6-4a34-8cba-6b95a40b3df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:30.162054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587a08-37e6-4a34-8cba-6b95a40b3df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:30.162321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587a08-37e6-4a34-8cba-6b95a40b3df8 admin admin] PATH_INFO: `/v3/projects/7cf71ef682d140f9b9c9c756b24cbb5b` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:30.163628 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2587a08-37e6-4a34-8cba-6b95a40b3df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf71ef682d140f9b9c9c756b24cbb5b)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:30.165680 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2587a08-37e6-4a34-8cba-6b95a40b3df8 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:30.215486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c2587a08-37e6-4a34-8cba-6b95a40b3df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf71ef682d140f9b9c9c756b24cbb5b', 'request_id': 'req-c2587a08-37e6-4a34-8cba-6b95a40b3df8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:30.224988 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c2587a08-37e6-4a34-8cba-6b95a40b3df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf71ef682d140f9b9c9c756b24cbb5b', 'request_id': 'req-c2587a08-37e6-4a34-8cba-6b95a40b3df8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:30.232042 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c2587a08-37e6-4a34-8cba-6b95a40b3df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf71ef682d140f9b9c9c756b24cbb5b', 'request_id': 'req-c2587a08-37e6-4a34-8cba-6b95a40b3df8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:30.242364 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c2587a08-37e6-4a34-8cba-6b95a40b3df8 admin admin] The token cache is being invalidate because project 7cf71ef682d140f9b9c9c756b24cbb5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:05:30.242648 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c2587a08-37e6-4a34-8cba-6b95a40b3df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:30.243379 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c2587a08-37e6-4a34-8cba-6b95a40b3df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:30.245058 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1339/2673] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:05:30 2022] DELETE /identity/v3/projects/7cf71ef682d140f9b9c9c756b24cbb5b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:30.250510 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723709b-0017-4cd7-bb7a-0a3ba9fd2adf None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:30.250845 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723709b-0017-4cd7-bb7a-0a3ba9fd2adf None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:30.251126 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723709b-0017-4cd7-bb7a-0a3ba9fd2adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:30.306439 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-3723709b-0017-4cd7-bb7a-0a3ba9fd2adf None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:30.308248 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-3723709b-0017-4cd7-bb7a-0a3ba9fd2adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:30.378600 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1335/2674] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:30.387516 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0624-e506-498b-a2c9-d51684a500bf None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:30.387879 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0624-e506-498b-a2c9-d51684a500bf None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:30.388153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0624-e506-498b-a2c9-d51684a500bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:30.409225 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-0ced0624-e506-498b-a2c9-d51684a500bf None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:30.410642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0ced0624-e506-498b-a2c9-d51684a500bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:30.423750 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1340/2675] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:30.429112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723709b-0017-4cd7-bb7a-0a3ba9fd2adf None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:30.440346 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723709b-0017-4cd7-bb7a-0a3ba9fd2adf None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:30.446511 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a71228-d1c8-4291-9810-0d98606b887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:30.447174 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a71228-d1c8-4291-9810-0d98606b887d admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:30.447463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a71228-d1c8-4291-9810-0d98606b887d admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:30.447739 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a71228-d1c8-4291-9810-0d98606b887d admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:30.448523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a71228-d1c8-4291-9810-0d98606b887d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:05:30.448835 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a71228-d1c8-4291-9810-0d98606b887d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:30.450648 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a71228-d1c8-4291-9810-0d98606b887d admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:30.466376 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1336/2676] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:05:30.471236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0624-e506-498b-a2c9-d51684a500bf None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:30.484401 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0624-e506-498b-a2c9-d51684a500bf None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:30.490995 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfec6f-811c-44c9-a4ef-9a24f3c70350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:30.491740 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfec6f-811c-44c9-a4ef-9a24f3c70350 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:30.492025 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfec6f-811c-44c9-a4ef-9a24f3c70350 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:30.492336 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfec6f-811c-44c9-a4ef-9a24f3c70350 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:30.493055 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfec6f-811c-44c9-a4ef-9a24f3c70350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:30.495021 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfec6f-811c-44c9-a4ef-9a24f3c70350 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:30.527934 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1341/2677] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:05:30 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:05:30.532426 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a71228-d1c8-4291-9810-0d98606b887d admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:30.543347 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a71228-d1c8-4291-9810-0d98606b887d admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:30.606058 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3b7ac-06b0-4679-a67b-b1c426461dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:30.606889 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3b7ac-06b0-4679-a67b-b1c426461dde admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:30.607173 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3b7ac-06b0-4679-a67b-b1c426461dde admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:30.607433 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3b7ac-06b0-4679-a67b-b1c426461dde admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:30.608133 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3b7ac-06b0-4679-a67b-b1c426461dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:30.610241 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3b7ac-06b0-4679-a67b-b1c426461dde admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:30.632812 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1337/2678] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:05:30 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:05:30.637861 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfec6f-811c-44c9-a4ef-9a24f3c70350 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:30.649351 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfec6f-811c-44c9-a4ef-9a24f3c70350 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:30.657397 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b31c1-90f9-4bf0-a57b-d4ab7ea05a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:30.658085 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b31c1-90f9-4bf0-a57b-d4ab7ea05a0c admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:30.658358 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b31c1-90f9-4bf0-a57b-d4ab7ea05a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:30.658626 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b31c1-90f9-4bf0-a57b-d4ab7ea05a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:30.659552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b31c1-90f9-4bf0-a57b-d4ab7ea05a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:30.661461 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b31c1-90f9-4bf0-a57b-d4ab7ea05a0c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:30.674206 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1342/2679] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:05:30.679134 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3b7ac-06b0-4679-a67b-b1c426461dde admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:30.689628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3b7ac-06b0-4679-a67b-b1c426461dde admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:30.694818 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74498cd-2e1a-45db-acb5-b22607b90758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:30.695487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74498cd-2e1a-45db-acb5-b22607b90758 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:30.695778 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74498cd-2e1a-45db-acb5-b22607b90758 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:30.696046 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74498cd-2e1a-45db-acb5-b22607b90758 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:30.696916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74498cd-2e1a-45db-acb5-b22607b90758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:30.698525 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74498cd-2e1a-45db-acb5-b22607b90758 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:30.710056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1338/2680] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:05:30.714717 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b31c1-90f9-4bf0-a57b-d4ab7ea05a0c admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:30.726658 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b31c1-90f9-4bf0-a57b-d4ab7ea05a0c admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:30.733469 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae8006-7de9-4a41-a57c-53736a4c07e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:30.734787 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae8006-7de9-4a41-a57c-53736a4c07e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:30.735064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae8006-7de9-4a41-a57c-53736a4c07e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:30.735336 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae8006-7de9-4a41-a57c-53736a4c07e1 admin admin] PATH_INFO: `/v3/projects/fea16e8e2a3c47c7934c660e5f9f2802/users/fb55f1ff809b4ccf9a0a89f1cee10cdc/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:30.754394 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae8006-7de9-4a41-a57c-53736a4c07e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea16e8e2a3c47c7934c660e5f9f2802, user_id=fb55f1ff809b4ccf9a0a89f1cee10cdc, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:30.757107 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae8006-7de9-4a41-a57c-53736a4c07e1 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:30.773732 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1343/2681] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:05:30 2022] PUT /identity/v3/projects/fea16e8e2a3c47c7934c660e5f9f2802/users/fb55f1ff809b4ccf9a0a89f1cee10cdc/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:30.785112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4220c7-d7e7-48f5-af41-3d18f8a05996 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:30.785854 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4220c7-d7e7-48f5-af41-3d18f8a05996 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:30.785854 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4220c7-d7e7-48f5-af41-3d18f8a05996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:30.815277 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-6b4220c7-d7e7-48f5-af41-3d18f8a05996 None None] MFA Rules not processed for user `fb55f1ff809b4ccf9a0a89f1cee10cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:30.816863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-6b4220c7-d7e7-48f5-af41-3d18f8a05996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:30.893989 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1339/2682] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:30.906098 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae8006-7de9-4a41-a57c-53736a4c07e1 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:30.908103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-fdae8006-7de9-4a41-a57c-53736a4c07e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:31.000962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae8006-7de9-4a41-a57c-53736a4c07e1 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:31.008075 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428fdb8-4913-49ea-ac29-8c5cfea1481b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:31.008775 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428fdb8-4913-49ea-ac29-8c5cfea1481b service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:31.009061 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428fdb8-4913-49ea-ac29-8c5cfea1481b service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:31.009337 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428fdb8-4913-49ea-ac29-8c5cfea1481b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:31.018947 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428fdb8-4913-49ea-ac29-8c5cfea1481b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:31.020616 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428fdb8-4913-49ea-ac29-8c5cfea1481b service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:31.030748 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1344/2683] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:33.777049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4220c7-d7e7-48f5-af41-3d18f8a05996 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:33.858011 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4220c7-d7e7-48f5-af41-3d18f8a05996 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:33.862713 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3455dee-db4f-4b9a-812b-7b7e32738094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:33.863626 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3455dee-db4f-4b9a-812b-7b7e32738094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:33.863903 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3455dee-db4f-4b9a-812b-7b7e32738094 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:33.864171 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3455dee-db4f-4b9a-812b-7b7e32738094 admin admin] PATH_INFO: `/v3/users/fb55f1ff809b4ccf9a0a89f1cee10cdc` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:33.865402 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3455dee-db4f-4b9a-812b-7b7e32738094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb55f1ff809b4ccf9a0a89f1cee10cdc)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:33.867340 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3455dee-db4f-4b9a-812b-7b7e32738094 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:33.921422 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a3455dee-db4f-4b9a-812b-7b7e32738094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb55f1ff809b4ccf9a0a89f1cee10cdc'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:33.922101 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a3455dee-db4f-4b9a-812b-7b7e32738094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb55f1ff809b4ccf9a0a89f1cee10cdc'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:33.934172 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a3455dee-db4f-4b9a-812b-7b7e32738094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb55f1ff809b4ccf9a0a89f1cee10cdc'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:33.934827 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a3455dee-db4f-4b9a-812b-7b7e32738094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb55f1ff809b4ccf9a0a89f1cee10cdc'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:33.944277 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a3455dee-db4f-4b9a-812b-7b7e32738094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb55f1ff809b4ccf9a0a89f1cee10cdc'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:33.956979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1340/2684] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:05:33 2022] DELETE /identity/v3/users/fb55f1ff809b4ccf9a0a89f1cee10cdc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:33.961722 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3b204-e4ee-4192-a246-b764ba00157e None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:33.962218 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3b204-e4ee-4192-a246-b764ba00157e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:33.962365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3b204-e4ee-4192-a246-b764ba00157e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:33.980251 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-07a3b204-e4ee-4192-a246-b764ba00157e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:33.981560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-07a3b204-e4ee-4192-a246-b764ba00157e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:34.045095 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1345/2685] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:34.055982 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3455dee-db4f-4b9a-812b-7b7e32738094 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:34.058384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a3455dee-db4f-4b9a-812b-7b7e32738094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:34.135584 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3455dee-db4f-4b9a-812b-7b7e32738094 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:34.139855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04d6a4-8246-498a-97e7-e2fc39d4ff63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:34.140523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04d6a4-8246-498a-97e7-e2fc39d4ff63 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:34.140805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04d6a4-8246-498a-97e7-e2fc39d4ff63 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:34.141090 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04d6a4-8246-498a-97e7-e2fc39d4ff63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:34.150697 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04d6a4-8246-498a-97e7-e2fc39d4ff63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:34.152148 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04d6a4-8246-498a-97e7-e2fc39d4ff63 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:34.161668 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1341/2686] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:34.455243 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3b204-e4ee-4192-a246-b764ba00157e None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:34.456851 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-07a3b204-e4ee-4192-a246-b764ba00157e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:34.471328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3b204-e4ee-4192-a246-b764ba00157e None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:34.476796 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99485d-dcc9-465c-87af-6c410b4fa0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:34.477673 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99485d-dcc9-465c-87af-6c410b4fa0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:34.477962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99485d-dcc9-465c-87af-6c410b4fa0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:34.478230 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99485d-dcc9-465c-87af-6c410b4fa0ee admin admin] PATH_INFO: `/v3/projects/fea16e8e2a3c47c7934c660e5f9f2802` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:34.479481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99485d-dcc9-465c-87af-6c410b4fa0ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea16e8e2a3c47c7934c660e5f9f2802)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:34.481462 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99485d-dcc9-465c-87af-6c410b4fa0ee admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:34.535112 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3d99485d-dcc9-465c-87af-6c410b4fa0ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea16e8e2a3c47c7934c660e5f9f2802', 'request_id': 'req-3d99485d-dcc9-465c-87af-6c410b4fa0ee'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:34.544592 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3d99485d-dcc9-465c-87af-6c410b4fa0ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea16e8e2a3c47c7934c660e5f9f2802', 'request_id': 'req-3d99485d-dcc9-465c-87af-6c410b4fa0ee'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:34.554614 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3d99485d-dcc9-465c-87af-6c410b4fa0ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea16e8e2a3c47c7934c660e5f9f2802', 'request_id': 'req-3d99485d-dcc9-465c-87af-6c410b4fa0ee'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:34.567423 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3d99485d-dcc9-465c-87af-6c410b4fa0ee admin admin] The token cache is being invalidate because project fea16e8e2a3c47c7934c660e5f9f2802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:05:34.567644 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3d99485d-dcc9-465c-87af-6c410b4fa0ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:34.568366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-3d99485d-dcc9-465c-87af-6c410b4fa0ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:34.570081 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1346/2687] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:05:34 2022] DELETE /identity/v3/projects/fea16e8e2a3c47c7934c660e5f9f2802 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:34.577482 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f3ba2-d766-479c-9a33-67c0412267ae None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:34.577938 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f3ba2-d766-479c-9a33-67c0412267ae None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:34.578354 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f3ba2-d766-479c-9a33-67c0412267ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:34.599364 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-fb1f3ba2-d766-479c-9a33-67c0412267ae None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:34.600795 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-fb1f3ba2-d766-479c-9a33-67c0412267ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:34.683159 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1342/2688] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:34.696322 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bcdb8-9d7e-43ac-9ee5-de3a84229d31 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:34.696606 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bcdb8-9d7e-43ac-9ee5-de3a84229d31 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:34.696905 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bcdb8-9d7e-43ac-9ee5-de3a84229d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:34.716068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-351bcdb8-9d7e-43ac-9ee5-de3a84229d31 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:34.717315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-351bcdb8-9d7e-43ac-9ee5-de3a84229d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:34.725837 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1347/2689] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:34.731875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f3ba2-d766-479c-9a33-67c0412267ae None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:34.742868 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f3ba2-d766-479c-9a33-67c0412267ae None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:34.748547 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05269bc7-f519-4154-97da-9cc409ec2b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:34.749270 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05269bc7-f519-4154-97da-9cc409ec2b79 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:34.749552 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05269bc7-f519-4154-97da-9cc409ec2b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:34.749886 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05269bc7-f519-4154-97da-9cc409ec2b79 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:34.750638 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05269bc7-f519-4154-97da-9cc409ec2b79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:05:34.750951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05269bc7-f519-4154-97da-9cc409ec2b79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:34.752650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05269bc7-f519-4154-97da-9cc409ec2b79 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:34.765707 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1343/2690] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:05:34.770210 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bcdb8-9d7e-43ac-9ee5-de3a84229d31 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:34.781475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bcdb8-9d7e-43ac-9ee5-de3a84229d31 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:34.786718 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e21ca1-5eeb-46b7-b91c-a5a985c8eec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:34.787431 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e21ca1-5eeb-46b7-b91c-a5a985c8eec9 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:34.787711 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e21ca1-5eeb-46b7-b91c-a5a985c8eec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:34.788022 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e21ca1-5eeb-46b7-b91c-a5a985c8eec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:34.788771 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e21ca1-5eeb-46b7-b91c-a5a985c8eec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:34.790749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e21ca1-5eeb-46b7-b91c-a5a985c8eec9 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:34.821896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1348/2691] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:05:34 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:05:34.827522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05269bc7-f519-4154-97da-9cc409ec2b79 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:34.839281 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05269bc7-f519-4154-97da-9cc409ec2b79 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:34.901495 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe87514-4059-479b-a0b7-8866f5ce73ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:34.902259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe87514-4059-479b-a0b7-8866f5ce73ed admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:34.902553 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe87514-4059-479b-a0b7-8866f5ce73ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:34.902824 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe87514-4059-479b-a0b7-8866f5ce73ed admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:34.903536 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe87514-4059-479b-a0b7-8866f5ce73ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:34.905498 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe87514-4059-479b-a0b7-8866f5ce73ed admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:34.932300 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e21ca1-5eeb-46b7-b91c-a5a985c8eec9 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:34.932717 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1344/2692] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:05:34 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:05:34.942882 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e21ca1-5eeb-46b7-b91c-a5a985c8eec9 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:34.947749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04dcc6-b6ac-40c6-9e82-88a5ba0a565e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:34.948434 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04dcc6-b6ac-40c6-9e82-88a5ba0a565e admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:34.948720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04dcc6-b6ac-40c6-9e82-88a5ba0a565e admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:34.949146 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04dcc6-b6ac-40c6-9e82-88a5ba0a565e admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:34.949870 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04dcc6-b6ac-40c6-9e82-88a5ba0a565e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:34.951474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04dcc6-b6ac-40c6-9e82-88a5ba0a565e admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:34.962106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1349/2693] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:05:34.966393 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe87514-4059-479b-a0b7-8866f5ce73ed admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:34.977436 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe87514-4059-479b-a0b7-8866f5ce73ed admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:34.983277 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4305ef5-9405-4fb3-bd1f-a4637ff86caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:34.983925 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4305ef5-9405-4fb3-bd1f-a4637ff86caf admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:34.984223 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4305ef5-9405-4fb3-bd1f-a4637ff86caf admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:34.984510 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4305ef5-9405-4fb3-bd1f-a4637ff86caf admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:34.985245 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4305ef5-9405-4fb3-bd1f-a4637ff86caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:34.986830 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4305ef5-9405-4fb3-bd1f-a4637ff86caf admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:34.997091 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1345/2694] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:05:35.001378 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04dcc6-b6ac-40c6-9e82-88a5ba0a565e admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:35.012124 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04dcc6-b6ac-40c6-9e82-88a5ba0a565e admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:35.017108 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c296e6e-5b95-4a7c-ab21-983c121136ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:35.018011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c296e6e-5b95-4a7c-ab21-983c121136ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:35.018298 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c296e6e-5b95-4a7c-ab21-983c121136ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:35.018567 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c296e6e-5b95-4a7c-ab21-983c121136ae admin admin] PATH_INFO: `/v3/projects/a2fd0e54aa354aaa93535c67659509ec/users/a6316326dc4c4efe9c63b854579aa7ae/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:35.034340 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c296e6e-5b95-4a7c-ab21-983c121136ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fd0e54aa354aaa93535c67659509ec, user_id=a6316326dc4c4efe9c63b854579aa7ae, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:35.037096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c296e6e-5b95-4a7c-ab21-983c121136ae admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:35.052810 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1350/2695] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:05:35 2022] PUT /identity/v3/projects/a2fd0e54aa354aaa93535c67659509ec/users/a6316326dc4c4efe9c63b854579aa7ae/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:35.064345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f0a74-823d-47e1-8839-fedc514d1ab2 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:35.064686 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f0a74-823d-47e1-8839-fedc514d1ab2 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:35.065060 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f0a74-823d-47e1-8839-fedc514d1ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:35.099345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-fb2f0a74-823d-47e1-8839-fedc514d1ab2 None None] MFA Rules not processed for user `a6316326dc4c4efe9c63b854579aa7ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:35.100537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-fb2f0a74-823d-47e1-8839-fedc514d1ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:35.169401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1346/2696] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:35.174057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c296e6e-5b95-4a7c-ab21-983c121136ae admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:35.237607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c296e6e-5b95-4a7c-ab21-983c121136ae admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:35.242896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a898494-8bf1-473a-9dc3-84baf6355804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:35.243559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a898494-8bf1-473a-9dc3-84baf6355804 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:35.243836 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a898494-8bf1-473a-9dc3-84baf6355804 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:35.244106 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a898494-8bf1-473a-9dc3-84baf6355804 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:35.244850 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a898494-8bf1-473a-9dc3-84baf6355804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:35.246804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a898494-8bf1-473a-9dc3-84baf6355804 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:35.278770 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1351/2697] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:05:35 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:05:35.285040 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f0a74-823d-47e1-8839-fedc514d1ab2 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:35.297264 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f0a74-823d-47e1-8839-fedc514d1ab2 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:35.354227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648f97d-3e63-4a8b-8763-d8e779d65384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:35.354981 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f97d-3e63-4a8b-8763-d8e779d65384 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:35.355348 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f97d-3e63-4a8b-8763-d8e779d65384 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:35.355603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f97d-3e63-4a8b-8763-d8e779d65384 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:35.356375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648f97d-3e63-4a8b-8763-d8e779d65384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:35.359301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648f97d-3e63-4a8b-8763-d8e779d65384 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:35.383962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1347/2698] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:05:35 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:05:35.388635 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a898494-8bf1-473a-9dc3-84baf6355804 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:35.399897 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a898494-8bf1-473a-9dc3-84baf6355804 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:35.405386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791bb4c-843f-48eb-aa12-fc6d370f0e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:35.406047 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791bb4c-843f-48eb-aa12-fc6d370f0e8e admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:35.406365 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791bb4c-843f-48eb-aa12-fc6d370f0e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:35.406633 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791bb4c-843f-48eb-aa12-fc6d370f0e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:35.407355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791bb4c-843f-48eb-aa12-fc6d370f0e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:35.409019 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791bb4c-843f-48eb-aa12-fc6d370f0e8e admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:35.419845 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1352/2699] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:05:35.424512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648f97d-3e63-4a8b-8763-d8e779d65384 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:35.435023 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648f97d-3e63-4a8b-8763-d8e779d65384 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:35.440521 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3c256-8817-4811-8867-0a02b743f832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:35.441427 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3c256-8817-4811-8867-0a02b743f832 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:35.441698 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3c256-8817-4811-8867-0a02b743f832 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:35.441961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3c256-8817-4811-8867-0a02b743f832 admin admin] PATH_INFO: `/v3/projects/6d683a073a534f6484f7a5107b4fe92c/users/6eeb71f7754e4a81a5e8a095818b1da5/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:35.458467 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3c256-8817-4811-8867-0a02b743f832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d683a073a534f6484f7a5107b4fe92c, user_id=6eeb71f7754e4a81a5e8a095818b1da5, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:35.461139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3c256-8817-4811-8867-0a02b743f832 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:35.477368 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1348/2700] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:05:35 2022] PUT /identity/v3/projects/6d683a073a534f6484f7a5107b4fe92c/users/6eeb71f7754e4a81a5e8a095818b1da5/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:35.481579 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791bb4c-843f-48eb-aa12-fc6d370f0e8e admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:35.491824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791bb4c-843f-48eb-aa12-fc6d370f0e8e admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:35.552880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90341da0-91c3-4ab2-b814-73be9bba832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:35.553607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90341da0-91c3-4ab2-b814-73be9bba832c admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:35.553889 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90341da0-91c3-4ab2-b814-73be9bba832c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:35.554142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90341da0-91c3-4ab2-b814-73be9bba832c admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:35.554905 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90341da0-91c3-4ab2-b814-73be9bba832c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:35.556553 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90341da0-91c3-4ab2-b814-73be9bba832c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:35.566920 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1353/2701] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:05:35.572437 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3c256-8817-4811-8867-0a02b743f832 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:35.586500 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3c256-8817-4811-8867-0a02b743f832 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:35.591439 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67399c-f576-409e-a70b-8cfe9a6f4273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:35.592361 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67399c-f576-409e-a70b-8cfe9a6f4273 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:35.592640 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67399c-f576-409e-a70b-8cfe9a6f4273 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:35.592910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67399c-f576-409e-a70b-8cfe9a6f4273 admin admin] PATH_INFO: `/v3/projects/6d683a073a534f6484f7a5107b4fe92c/users/6eeb71f7754e4a81a5e8a095818b1da5/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:35.595003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67399c-f576-409e-a70b-8cfe9a6f4273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d683a073a534f6484f7a5107b4fe92c, user_id=6eeb71f7754e4a81a5e8a095818b1da5, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:35.597737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67399c-f576-409e-a70b-8cfe9a6f4273 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:35.609173 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1349/2702] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:05:35 2022] PUT /identity/v3/projects/6d683a073a534f6484f7a5107b4fe92c/users/6eeb71f7754e4a81a5e8a095818b1da5/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:35.621082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b2bcf-fbbf-41df-8e64-b3e7613998e2 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:35.621370 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b2bcf-fbbf-41df-8e64-b3e7613998e2 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:35.621647 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b2bcf-fbbf-41df-8e64-b3e7613998e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:35.648654 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-513b2bcf-fbbf-41df-8e64-b3e7613998e2 None None] MFA Rules not processed for user `6eeb71f7754e4a81a5e8a095818b1da5`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:35.649849 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-513b2bcf-fbbf-41df-8e64-b3e7613998e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:35.721543 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1354/2703] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:35.737220 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67399c-f576-409e-a70b-8cfe9a6f4273 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:35.740071 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ae67399c-f576-409e-a70b-8cfe9a6f4273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:35.830310 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67399c-f576-409e-a70b-8cfe9a6f4273 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:35.834503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d6b69-254d-4280-a43d-4ecd332fda87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:35.835166 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d6b69-254d-4280-a43d-4ecd332fda87 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:35.835442 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d6b69-254d-4280-a43d-4ecd332fda87 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:35.835710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d6b69-254d-4280-a43d-4ecd332fda87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:35.845747 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d6b69-254d-4280-a43d-4ecd332fda87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:35.847195 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d6b69-254d-4280-a43d-4ecd332fda87 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:35.856608 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1350/2704] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:35.912039 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b2bcf-fbbf-41df-8e64-b3e7613998e2 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:35.914328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-513b2bcf-fbbf-41df-8e64-b3e7613998e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:35.927772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b2bcf-fbbf-41df-8e64-b3e7613998e2 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:35.932595 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521f652-783a-4abf-9afc-51a45bf2c4f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:35.933236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521f652-783a-4abf-9afc-51a45bf2c4f6 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:35.933544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521f652-783a-4abf-9afc-51a45bf2c4f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:35.933808 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521f652-783a-4abf-9afc-51a45bf2c4f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:35.997482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521f652-783a-4abf-9afc-51a45bf2c4f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:35.998984 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521f652-783a-4abf-9afc-51a45bf2c4f6 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:36.009075 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1355/2705] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:39.401139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d6b69-254d-4280-a43d-4ecd332fda87 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:39.480046 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d6b69-254d-4280-a43d-4ecd332fda87 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:39.486983 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aef0e-8776-4c7d-90b9-079af985d52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:39.488084 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aef0e-8776-4c7d-90b9-079af985d52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:39.488424 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aef0e-8776-4c7d-90b9-079af985d52e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:39.488817 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aef0e-8776-4c7d-90b9-079af985d52e admin admin] PATH_INFO: `/v3/users/a6316326dc4c4efe9c63b854579aa7ae` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:39.490827 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479aef0e-8776-4c7d-90b9-079af985d52e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6316326dc4c4efe9c63b854579aa7ae)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:39.494212 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479aef0e-8776-4c7d-90b9-079af985d52e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:39.551336 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-479aef0e-8776-4c7d-90b9-079af985d52e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6316326dc4c4efe9c63b854579aa7ae'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:39.552055 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-479aef0e-8776-4c7d-90b9-079af985d52e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6316326dc4c4efe9c63b854579aa7ae'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:39.567719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-479aef0e-8776-4c7d-90b9-079af985d52e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6316326dc4c4efe9c63b854579aa7ae'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:39.568499 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-479aef0e-8776-4c7d-90b9-079af985d52e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6316326dc4c4efe9c63b854579aa7ae'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:39.577558 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-479aef0e-8776-4c7d-90b9-079af985d52e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6316326dc4c4efe9c63b854579aa7ae'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:39.590689 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1351/2706] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:05:39 2022] DELETE /identity/v3/users/a6316326dc4c4efe9c63b854579aa7ae => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:39.597475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bb95e-19fc-4074-b9aa-ef5c1dff9e3b None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:39.598002 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bb95e-19fc-4074-b9aa-ef5c1dff9e3b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:39.598128 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bb95e-19fc-4074-b9aa-ef5c1dff9e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:39.623141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-bf0bb95e-19fc-4074-b9aa-ef5c1dff9e3b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:39.624411 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-bf0bb95e-19fc-4074-b9aa-ef5c1dff9e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:39.694282 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1356/2707] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:39.705952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aef0e-8776-4c7d-90b9-079af985d52e admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:39.708512 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-479aef0e-8776-4c7d-90b9-079af985d52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:39.784025 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aef0e-8776-4c7d-90b9-079af985d52e admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:39.788873 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0211cf9-e68b-4339-9862-518931329ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:39.789536 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0211cf9-e68b-4339-9862-518931329ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:39.789819 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0211cf9-e68b-4339-9862-518931329ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:39.790218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0211cf9-e68b-4339-9862-518931329ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:39.801665 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0211cf9-e68b-4339-9862-518931329ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:39.803096 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0211cf9-e68b-4339-9862-518931329ab8 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:39.814386 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1352/2708] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:40.101607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bb95e-19fc-4074-b9aa-ef5c1dff9e3b None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:40.103178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-bf0bb95e-19fc-4074-b9aa-ef5c1dff9e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:40.115773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bb95e-19fc-4074-b9aa-ef5c1dff9e3b None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:40.121058 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:40.122213 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:40.122491 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:40.122764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c admin admin] PATH_INFO: `/v3/projects/a2fd0e54aa354aaa93535c67659509ec` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:40.124123 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2fd0e54aa354aaa93535c67659509ec)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:40.126069 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:40.181699 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fd0e54aa354aaa93535c67659509ec', 'request_id': 'req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:40.190687 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fd0e54aa354aaa93535c67659509ec', 'request_id': 'req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:40.197179 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fd0e54aa354aaa93535c67659509ec', 'request_id': 'req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:40.207272 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c admin admin] The token cache is being invalidate because project a2fd0e54aa354aaa93535c67659509ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:05:40.207556 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:40.208178 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:40.209765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1357/2709] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:05:40 2022] DELETE /identity/v3/projects/a2fd0e54aa354aaa93535c67659509ec => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:40.214086 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0211cf9-e68b-4339-9862-518931329ab8 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:40.224065 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0211cf9-e68b-4339-9862-518931329ab8 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:40.284474 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd99fa-2b47-4cd7-b73b-cf7dd7062375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:40.285374 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd99fa-2b47-4cd7-b73b-cf7dd7062375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:40.285672 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd99fa-2b47-4cd7-b73b-cf7dd7062375 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:40.285943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd99fa-2b47-4cd7-b73b-cf7dd7062375 admin admin] PATH_INFO: `/v3/users/6eeb71f7754e4a81a5e8a095818b1da5` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:40.287109 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd99fa-2b47-4cd7-b73b-cf7dd7062375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eeb71f7754e4a81a5e8a095818b1da5)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:40.289114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd99fa-2b47-4cd7-b73b-cf7dd7062375 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:40.341944 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36dd99fa-2b47-4cd7-b73b-cf7dd7062375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eeb71f7754e4a81a5e8a095818b1da5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:40.342719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36dd99fa-2b47-4cd7-b73b-cf7dd7062375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eeb71f7754e4a81a5e8a095818b1da5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:40.354676 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36dd99fa-2b47-4cd7-b73b-cf7dd7062375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eeb71f7754e4a81a5e8a095818b1da5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:40.355388 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36dd99fa-2b47-4cd7-b73b-cf7dd7062375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eeb71f7754e4a81a5e8a095818b1da5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:40.363518 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-36dd99fa-2b47-4cd7-b73b-cf7dd7062375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eeb71f7754e4a81a5e8a095818b1da5'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:40.377508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1353/2710] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:05:40 2022] DELETE /identity/v3/users/6eeb71f7754e4a81a5e8a095818b1da5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:40.664701 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:40.666451 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:40.680081 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40e202-5ada-49d9-a8f1-92ff10c5ce1c admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:40.736153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918f089-f3bd-4b41-b5b8-787aa3ade576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:40.737124 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918f089-f3bd-4b41-b5b8-787aa3ade576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:40.737422 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918f089-f3bd-4b41-b5b8-787aa3ade576 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:40.737692 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918f089-f3bd-4b41-b5b8-787aa3ade576 admin admin] PATH_INFO: `/v3/projects/6d683a073a534f6484f7a5107b4fe92c` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:40.738921 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918f089-f3bd-4b41-b5b8-787aa3ade576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d683a073a534f6484f7a5107b4fe92c)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:40.740938 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918f089-f3bd-4b41-b5b8-787aa3ade576 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:40.799110 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-9918f089-f3bd-4b41-b5b8-787aa3ade576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d683a073a534f6484f7a5107b4fe92c', 'request_id': 'req-9918f089-f3bd-4b41-b5b8-787aa3ade576'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:40.809334 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-9918f089-f3bd-4b41-b5b8-787aa3ade576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d683a073a534f6484f7a5107b4fe92c', 'request_id': 'req-9918f089-f3bd-4b41-b5b8-787aa3ade576'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:40.815916 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-9918f089-f3bd-4b41-b5b8-787aa3ade576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d683a073a534f6484f7a5107b4fe92c', 'request_id': 'req-9918f089-f3bd-4b41-b5b8-787aa3ade576'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:40.827152 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-9918f089-f3bd-4b41-b5b8-787aa3ade576 admin admin] The token cache is being invalidate because project 6d683a073a534f6484f7a5107b4fe92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:05:40.827446 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-9918f089-f3bd-4b41-b5b8-787aa3ade576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:40.828340 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-9918f089-f3bd-4b41-b5b8-787aa3ade576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:40.830096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1358/2711] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:05:40 2022] DELETE /identity/v3/projects/6d683a073a534f6484f7a5107b4fe92c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:40.835314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d32b2a-5660-4d63-bea9-f790025357c4 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:40.835817 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d32b2a-5660-4d63-bea9-f790025357c4 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:40.835817 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d32b2a-5660-4d63-bea9-f790025357c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:40.854731 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-57d32b2a-5660-4d63-bea9-f790025357c4 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:40.855997 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-57d32b2a-5660-4d63-bea9-f790025357c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:40.917017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1354/2712] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:40.926696 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bde040-20b4-489a-b4ec-a0507482c52e None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:40.926930 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bde040-20b4-489a-b4ec-a0507482c52e None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:40.927229 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bde040-20b4-489a-b4ec-a0507482c52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:40.948799 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-05bde040-20b4-489a-b4ec-a0507482c52e None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:40.950073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-05bde040-20b4-489a-b4ec-a0507482c52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:40.959659 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1359/2713] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:40.965065 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d32b2a-5660-4d63-bea9-f790025357c4 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:40.976667 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d32b2a-5660-4d63-bea9-f790025357c4 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:40.982377 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149ab0f-f5f2-4287-afaf-20981ba024de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:40.983041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149ab0f-f5f2-4287-afaf-20981ba024de admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:40.983326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149ab0f-f5f2-4287-afaf-20981ba024de admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:40.983581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149ab0f-f5f2-4287-afaf-20981ba024de admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:40.984345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149ab0f-f5f2-4287-afaf-20981ba024de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:05:40.984650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149ab0f-f5f2-4287-afaf-20981ba024de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:40.986391 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149ab0f-f5f2-4287-afaf-20981ba024de admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:40.999593 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1355/2714] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:05:41.004805 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bde040-20b4-489a-b4ec-a0507482c52e None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:41.020400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bde040-20b4-489a-b4ec-a0507482c52e None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:41.028121 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794334d-0fbc-4b9f-942f-a3bb37b70073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:41.028946 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794334d-0fbc-4b9f-942f-a3bb37b70073 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:41.029224 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794334d-0fbc-4b9f-942f-a3bb37b70073 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:41.029489 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794334d-0fbc-4b9f-942f-a3bb37b70073 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:41.030204 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794334d-0fbc-4b9f-942f-a3bb37b70073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:41.032168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794334d-0fbc-4b9f-942f-a3bb37b70073 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:41.065636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1360/2715] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:05:41 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:05:41.070218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149ab0f-f5f2-4287-afaf-20981ba024de admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:41.081712 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149ab0f-f5f2-4287-afaf-20981ba024de admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:41.143158 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b858b81-d157-437d-b1d9-6855377c440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:41.144147 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b858b81-d157-437d-b1d9-6855377c440f admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:41.144522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b858b81-d157-437d-b1d9-6855377c440f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:41.144869 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b858b81-d157-437d-b1d9-6855377c440f admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:41.145889 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b858b81-d157-437d-b1d9-6855377c440f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:41.148770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b858b81-d157-437d-b1d9-6855377c440f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:41.177107 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1356/2716] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:05:41 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:05:41.181431 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794334d-0fbc-4b9f-942f-a3bb37b70073 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:41.191907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794334d-0fbc-4b9f-942f-a3bb37b70073 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:41.196492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766c18f-ce78-4214-8ef2-e39d82e341a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:41.197280 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766c18f-ce78-4214-8ef2-e39d82e341a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:41.197575 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766c18f-ce78-4214-8ef2-e39d82e341a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:41.197856 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766c18f-ce78-4214-8ef2-e39d82e341a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:41.198617 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766c18f-ce78-4214-8ef2-e39d82e341a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:41.200869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766c18f-ce78-4214-8ef2-e39d82e341a7 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:41.212516 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1361/2717] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:05:41.218694 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b858b81-d157-437d-b1d9-6855377c440f admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:41.232683 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b858b81-d157-437d-b1d9-6855377c440f admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:41.238136 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4781749-2967-4803-9843-52e80e32046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:41.238812 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4781749-2967-4803-9843-52e80e32046e admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:41.239098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4781749-2967-4803-9843-52e80e32046e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:41.239373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4781749-2967-4803-9843-52e80e32046e admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:41.240141 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4781749-2967-4803-9843-52e80e32046e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:41.241921 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4781749-2967-4803-9843-52e80e32046e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:41.252118 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1357/2718] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:05:41.257067 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766c18f-ce78-4214-8ef2-e39d82e341a7 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:41.268880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766c18f-ce78-4214-8ef2-e39d82e341a7 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:41.274533 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c59728-5638-4406-b721-2a735be5e3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:41.275444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c59728-5638-4406-b721-2a735be5e3da admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:41.275716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c59728-5638-4406-b721-2a735be5e3da admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:41.275979 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c59728-5638-4406-b721-2a735be5e3da admin admin] PATH_INFO: `/v3/projects/293374846946441eb33773753d72d754/users/06379d9387d445668cc16a186f688d49/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:41.293517 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c59728-5638-4406-b721-2a735be5e3da admin admin] RBAC: Authorizing `identity:create_grant(project_id=293374846946441eb33773753d72d754, user_id=06379d9387d445668cc16a186f688d49, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:41.296278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c59728-5638-4406-b721-2a735be5e3da admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:41.312249 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1362/2719] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:05:41 2022] PUT /identity/v3/projects/293374846946441eb33773753d72d754/users/06379d9387d445668cc16a186f688d49/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:41.323272 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321efe2a-50ad-4492-be01-f808adcf4564 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:41.323489 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321efe2a-50ad-4492-be01-f808adcf4564 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:41.323773 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321efe2a-50ad-4492-be01-f808adcf4564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:41.352239 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-321efe2a-50ad-4492-be01-f808adcf4564 None None] MFA Rules not processed for user `06379d9387d445668cc16a186f688d49`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:41.353474 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-321efe2a-50ad-4492-be01-f808adcf4564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:41.422770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1358/2720] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:41.429032 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c59728-5638-4406-b721-2a735be5e3da admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:41.496916 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c59728-5638-4406-b721-2a735be5e3da admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:41.502801 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31048888-5753-4d8d-bd87-d5cd5398fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:41.503481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31048888-5753-4d8d-bd87-d5cd5398fae5 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:41.503762 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31048888-5753-4d8d-bd87-d5cd5398fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:41.504006 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31048888-5753-4d8d-bd87-d5cd5398fae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:41.504735 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31048888-5753-4d8d-bd87-d5cd5398fae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:41.506670 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31048888-5753-4d8d-bd87-d5cd5398fae5 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:41.537306 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1363/2721] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:05:41 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:05:41.541730 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321efe2a-50ad-4492-be01-f808adcf4564 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:41.554406 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321efe2a-50ad-4492-be01-f808adcf4564 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:41.614000 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899936aa-907e-4228-bc4d-2c87d38341fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:41.614641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899936aa-907e-4228-bc4d-2c87d38341fe admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:41.615077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899936aa-907e-4228-bc4d-2c87d38341fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:41.615457 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899936aa-907e-4228-bc4d-2c87d38341fe admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:41.616547 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899936aa-907e-4228-bc4d-2c87d38341fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:41.618467 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899936aa-907e-4228-bc4d-2c87d38341fe admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:41.642463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1359/2722] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:05:41 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:05:41.648153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31048888-5753-4d8d-bd87-d5cd5398fae5 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:41.658748 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31048888-5753-4d8d-bd87-d5cd5398fae5 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:41.663737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c150bd-d69f-45a9-9574-f3de5cf976cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:41.664414 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c150bd-d69f-45a9-9574-f3de5cf976cb admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:41.664695 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c150bd-d69f-45a9-9574-f3de5cf976cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:41.664966 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c150bd-d69f-45a9-9574-f3de5cf976cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:41.665700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c150bd-d69f-45a9-9574-f3de5cf976cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:41.667345 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c150bd-d69f-45a9-9574-f3de5cf976cb admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:41.679399 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1364/2723] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:05:41.683970 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899936aa-907e-4228-bc4d-2c87d38341fe admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:41.694608 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899936aa-907e-4228-bc4d-2c87d38341fe admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:41.699917 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ad0be-aa1d-474f-9cba-b27a4342a793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:41.700851 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ad0be-aa1d-474f-9cba-b27a4342a793 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:41.701129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ad0be-aa1d-474f-9cba-b27a4342a793 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:41.701401 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ad0be-aa1d-474f-9cba-b27a4342a793 admin admin] PATH_INFO: `/v3/projects/7ebc47cb8ec8437cb785e44ebe316351/users/1ff9e261c6664bb89dbcf02d9eb6ec01/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:41.719714 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ad0be-aa1d-474f-9cba-b27a4342a793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebc47cb8ec8437cb785e44ebe316351, user_id=1ff9e261c6664bb89dbcf02d9eb6ec01, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:41.722454 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ad0be-aa1d-474f-9cba-b27a4342a793 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:41.738962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1360/2724] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:05:41 2022] PUT /identity/v3/projects/7ebc47cb8ec8437cb785e44ebe316351/users/1ff9e261c6664bb89dbcf02d9eb6ec01/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:41.743021 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c150bd-d69f-45a9-9574-f3de5cf976cb admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:41.753751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c150bd-d69f-45a9-9574-f3de5cf976cb admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:41.814271 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff293a9-8848-4ce8-9f0f-e5933678e5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:41.814966 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff293a9-8848-4ce8-9f0f-e5933678e5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:41.815243 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff293a9-8848-4ce8-9f0f-e5933678e5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:41.815514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff293a9-8848-4ce8-9f0f-e5933678e5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:41.816296 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff293a9-8848-4ce8-9f0f-e5933678e5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:41.817985 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff293a9-8848-4ce8-9f0f-e5933678e5b4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:41.828547 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1365/2725] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:05:41.832951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ad0be-aa1d-474f-9cba-b27a4342a793 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:41.845064 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ad0be-aa1d-474f-9cba-b27a4342a793 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:41.849904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6797ae5-9e46-4f2a-88f9-2d8e5470850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:41.850797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6797ae5-9e46-4f2a-88f9-2d8e5470850a admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:41.851078 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6797ae5-9e46-4f2a-88f9-2d8e5470850a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:41.851346 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6797ae5-9e46-4f2a-88f9-2d8e5470850a admin admin] PATH_INFO: `/v3/projects/7ebc47cb8ec8437cb785e44ebe316351/users/1ff9e261c6664bb89dbcf02d9eb6ec01/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:41.853486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6797ae5-9e46-4f2a-88f9-2d8e5470850a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebc47cb8ec8437cb785e44ebe316351, user_id=1ff9e261c6664bb89dbcf02d9eb6ec01, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:41.856208 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6797ae5-9e46-4f2a-88f9-2d8e5470850a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:41.868457 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1361/2726] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:05:41 2022] PUT /identity/v3/projects/7ebc47cb8ec8437cb785e44ebe316351/users/1ff9e261c6664bb89dbcf02d9eb6ec01/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:41.880417 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34abb-6880-4297-9eac-c32d2c4db8e4 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:41.880705 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34abb-6880-4297-9eac-c32d2c4db8e4 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:41.881008 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34abb-6880-4297-9eac-c32d2c4db8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:41.908688 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-44d34abb-6880-4297-9eac-c32d2c4db8e4 None None] MFA Rules not processed for user `1ff9e261c6664bb89dbcf02d9eb6ec01`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:41.909923 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-44d34abb-6880-4297-9eac-c32d2c4db8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:41.985700 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1366/2727] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:05:42.002910 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6797ae5-9e46-4f2a-88f9-2d8e5470850a admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:42.004992 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-c6797ae5-9e46-4f2a-88f9-2d8e5470850a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:42.069230 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6797ae5-9e46-4f2a-88f9-2d8e5470850a admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:42.073653 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a0ec9-dff4-468f-ab34-7a6ccdf0d2da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:42.074308 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a0ec9-dff4-468f-ab34-7a6ccdf0d2da service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:42.074608 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a0ec9-dff4-468f-ab34-7a6ccdf0d2da service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:42.074873 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a0ec9-dff4-468f-ab34-7a6ccdf0d2da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:42.089267 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a0ec9-dff4-468f-ab34-7a6ccdf0d2da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:42.091404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a0ec9-dff4-468f-ab34-7a6ccdf0d2da service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:42.106031 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1362/2728] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:42.191513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34abb-6880-4297-9eac-c32d2c4db8e4 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:42.202196 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34abb-6880-4297-9eac-c32d2c4db8e4 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:42.206607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a819234-f8e1-4cff-88e5-8deb7892b20d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:42.207247 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a819234-f8e1-4cff-88e5-8deb7892b20d service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:42.207529 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a819234-f8e1-4cff-88e5-8deb7892b20d service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:42.207793 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a819234-f8e1-4cff-88e5-8deb7892b20d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:42.268989 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a819234-f8e1-4cff-88e5-8deb7892b20d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:42.270481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a819234-f8e1-4cff-88e5-8deb7892b20d service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:42.281149 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1367/2729] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:42.590820 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a0ec9-dff4-468f-ab34-7a6ccdf0d2da service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:42.654001 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a0ec9-dff4-468f-ab34-7a6ccdf0d2da service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:42.659111 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff43ab1-dee8-4720-8bf5-56e4a4683c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:42.659974 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff43ab1-dee8-4720-8bf5-56e4a4683c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:42.660237 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff43ab1-dee8-4720-8bf5-56e4a4683c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:42.660694 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff43ab1-dee8-4720-8bf5-56e4a4683c1b admin admin] PATH_INFO: `/v3/users/06379d9387d445668cc16a186f688d49` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:42.661866 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff43ab1-dee8-4720-8bf5-56e4a4683c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=06379d9387d445668cc16a186f688d49)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:42.663774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff43ab1-dee8-4720-8bf5-56e4a4683c1b admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:42.719471 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-9ff43ab1-dee8-4720-8bf5-56e4a4683c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06379d9387d445668cc16a186f688d49'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:42.720283 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-9ff43ab1-dee8-4720-8bf5-56e4a4683c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06379d9387d445668cc16a186f688d49'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:42.732027 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-9ff43ab1-dee8-4720-8bf5-56e4a4683c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06379d9387d445668cc16a186f688d49'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:42.732767 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-9ff43ab1-dee8-4720-8bf5-56e4a4683c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06379d9387d445668cc16a186f688d49'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:42.742224 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-9ff43ab1-dee8-4720-8bf5-56e4a4683c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06379d9387d445668cc16a186f688d49'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:42.755644 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1363/2730] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:05:42 2022] DELETE /identity/v3/users/06379d9387d445668cc16a186f688d49 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:42.760792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6af35-f1ee-4e7b-b480-327dcd4baf8b None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:42.761375 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6af35-f1ee-4e7b-b480-327dcd4baf8b None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:42.761375 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6af35-f1ee-4e7b-b480-327dcd4baf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:42.781308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-a3b6af35-f1ee-4e7b-b480-327dcd4baf8b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:42.782511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-a3b6af35-f1ee-4e7b-b480-327dcd4baf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:42.842307 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1368/2731] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:42.852655 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff43ab1-dee8-4720-8bf5-56e4a4683c1b admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:42.854299 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-9ff43ab1-dee8-4720-8bf5-56e4a4683c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:42.916158 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff43ab1-dee8-4720-8bf5-56e4a4683c1b admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:42.920363 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ad8e3-405e-4550-9b51-e490c62fd7de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:42.921011 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ad8e3-405e-4550-9b51-e490c62fd7de service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:42.921287 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ad8e3-405e-4550-9b51-e490c62fd7de service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:42.921559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ad8e3-405e-4550-9b51-e490c62fd7de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:42.931200 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ad8e3-405e-4550-9b51-e490c62fd7de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:42.932673 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ad8e3-405e-4550-9b51-e490c62fd7de service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:42.942895 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1364/2732] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:05:43.210747 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6af35-f1ee-4e7b-b480-327dcd4baf8b None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:43.212290 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-a3b6af35-f1ee-4e7b-b480-327dcd4baf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:43.224812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6af35-f1ee-4e7b-b480-327dcd4baf8b None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:43.229774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5216e-9f58-4fa1-b940-de68f4735492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:43.230749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5216e-9f58-4fa1-b940-de68f4735492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:43.231119 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5216e-9f58-4fa1-b940-de68f4735492 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:43.231482 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5216e-9f58-4fa1-b940-de68f4735492 admin admin] PATH_INFO: `/v3/projects/293374846946441eb33773753d72d754` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:43.232804 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5216e-9f58-4fa1-b940-de68f4735492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=293374846946441eb33773753d72d754)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:43.234856 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5216e-9f58-4fa1-b940-de68f4735492 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:43.282265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bff5216e-9f58-4fa1-b940-de68f4735492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293374846946441eb33773753d72d754', 'request_id': 'req-bff5216e-9f58-4fa1-b940-de68f4735492'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:43.293190 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bff5216e-9f58-4fa1-b940-de68f4735492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293374846946441eb33773753d72d754', 'request_id': 'req-bff5216e-9f58-4fa1-b940-de68f4735492'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:43.299713 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bff5216e-9f58-4fa1-b940-de68f4735492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293374846946441eb33773753d72d754', 'request_id': 'req-bff5216e-9f58-4fa1-b940-de68f4735492'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:43.310827 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bff5216e-9f58-4fa1-b940-de68f4735492 admin admin] The token cache is being invalidate because project 293374846946441eb33773753d72d754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:05:43.311118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bff5216e-9f58-4fa1-b940-de68f4735492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:43.311817 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bff5216e-9f58-4fa1-b940-de68f4735492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:43.313481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1369/2733] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:05:43 2022] DELETE /identity/v3/projects/293374846946441eb33773753d72d754 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:43.317684 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ad8e3-405e-4550-9b51-e490c62fd7de service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:43.328037 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ad8e3-405e-4550-9b51-e490c62fd7de service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:43.387004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ae724-a68b-4505-9c41-d059a1b03815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:43.387957 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ae724-a68b-4505-9c41-d059a1b03815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:43.388381 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ae724-a68b-4505-9c41-d059a1b03815 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:43.388688 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ae724-a68b-4505-9c41-d059a1b03815 admin admin] PATH_INFO: `/v3/users/1ff9e261c6664bb89dbcf02d9eb6ec01` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:43.389965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ae724-a68b-4505-9c41-d059a1b03815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff9e261c6664bb89dbcf02d9eb6ec01)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:43.391888 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ae724-a68b-4505-9c41-d059a1b03815 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:43.441348 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-536ae724-a68b-4505-9c41-d059a1b03815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff9e261c6664bb89dbcf02d9eb6ec01'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:43.442083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-536ae724-a68b-4505-9c41-d059a1b03815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff9e261c6664bb89dbcf02d9eb6ec01'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:43.456264 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-536ae724-a68b-4505-9c41-d059a1b03815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff9e261c6664bb89dbcf02d9eb6ec01'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:43.457182 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-536ae724-a68b-4505-9c41-d059a1b03815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff9e261c6664bb89dbcf02d9eb6ec01'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:43.466606 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-536ae724-a68b-4505-9c41-d059a1b03815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff9e261c6664bb89dbcf02d9eb6ec01'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:43.483132 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1365/2734] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:05:43 2022] DELETE /identity/v3/users/1ff9e261c6664bb89dbcf02d9eb6ec01 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:43.770740 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5216e-9f58-4fa1-b940-de68f4735492 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:43.772257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-bff5216e-9f58-4fa1-b940-de68f4735492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:43.787887 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5216e-9f58-4fa1-b940-de68f4735492 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:43.848723 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db889246-95c2-4e06-9a66-ce0c2b408014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:43.849643 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db889246-95c2-4e06-9a66-ce0c2b408014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:43.849909 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db889246-95c2-4e06-9a66-ce0c2b408014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:43.850179 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db889246-95c2-4e06-9a66-ce0c2b408014 admin admin] PATH_INFO: `/v3/projects/7ebc47cb8ec8437cb785e44ebe316351` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:43.851407 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db889246-95c2-4e06-9a66-ce0c2b408014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ebc47cb8ec8437cb785e44ebe316351)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:43.853476 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db889246-95c2-4e06-9a66-ce0c2b408014 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:43.905627 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-db889246-95c2-4e06-9a66-ce0c2b408014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebc47cb8ec8437cb785e44ebe316351', 'request_id': 'req-db889246-95c2-4e06-9a66-ce0c2b408014'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:43.914915 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-db889246-95c2-4e06-9a66-ce0c2b408014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebc47cb8ec8437cb785e44ebe316351', 'request_id': 'req-db889246-95c2-4e06-9a66-ce0c2b408014'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:43.922168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-db889246-95c2-4e06-9a66-ce0c2b408014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebc47cb8ec8437cb785e44ebe316351', 'request_id': 'req-db889246-95c2-4e06-9a66-ce0c2b408014'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:43.933596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-db889246-95c2-4e06-9a66-ce0c2b408014 admin admin] The token cache is being invalidate because project 7ebc47cb8ec8437cb785e44ebe316351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:05:43.933931 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-db889246-95c2-4e06-9a66-ce0c2b408014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:43.934575 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-db889246-95c2-4e06-9a66-ce0c2b408014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:43.936364 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1370/2735] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:05:43 2022] DELETE /identity/v3/projects/7ebc47cb8ec8437cb785e44ebe316351 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:43.941764 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ffcac-7ea2-4bae-8eaf-3147d0a82bb1 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:43.942274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ffcac-7ea2-4bae-8eaf-3147d0a82bb1 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:43.942274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ffcac-7ea2-4bae-8eaf-3147d0a82bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:43.961383 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-4a1ffcac-7ea2-4bae-8eaf-3147d0a82bb1 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:43.962652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4a1ffcac-7ea2-4bae-8eaf-3147d0a82bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:44.034326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1366/2736] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:44.046187 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2246718-1c1b-4bb4-b85e-1618d97ade70 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:44.046432 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2246718-1c1b-4bb4-b85e-1618d97ade70 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:44.046749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2246718-1c1b-4bb4-b85e-1618d97ade70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:44.066105 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-f2246718-1c1b-4bb4-b85e-1618d97ade70 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:44.067320 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f2246718-1c1b-4bb4-b85e-1618d97ade70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:44.077289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1371/2737] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:44.083501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ffcac-7ea2-4bae-8eaf-3147d0a82bb1 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:44.093946 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ffcac-7ea2-4bae-8eaf-3147d0a82bb1 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:44.098867 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fab43d-d30c-4e71-b2f9-34e874b33fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:44.099524 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fab43d-d30c-4e71-b2f9-34e874b33fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:44.099804 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fab43d-d30c-4e71-b2f9-34e874b33fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:44.100078 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fab43d-d30c-4e71-b2f9-34e874b33fe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:44.100847 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fab43d-d30c-4e71-b2f9-34e874b33fe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:05:44.101170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fab43d-d30c-4e71-b2f9-34e874b33fe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:44.102774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fab43d-d30c-4e71-b2f9-34e874b33fe3 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:44.114520 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1367/2738] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:05:44.119065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2246718-1c1b-4bb4-b85e-1618d97ade70 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:44.128476 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2246718-1c1b-4bb4-b85e-1618d97ade70 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:44.133450 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2e7f0-4a10-4705-9b3a-07a8ad49a998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:44.134109 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2e7f0-4a10-4705-9b3a-07a8ad49a998 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:44.134746 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2e7f0-4a10-4705-9b3a-07a8ad49a998 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:44.135019 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2e7f0-4a10-4705-9b3a-07a8ad49a998 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:44.135831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2e7f0-4a10-4705-9b3a-07a8ad49a998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:44.137912 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2e7f0-4a10-4705-9b3a-07a8ad49a998 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:44.167808 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1372/2739] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:05:44 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:05:44.172244 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fab43d-d30c-4e71-b2f9-34e874b33fe3 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:44.182208 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fab43d-d30c-4e71-b2f9-34e874b33fe3 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:44.245893 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c357c5-029d-4e66-84dd-8c3188907c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:44.246766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c357c5-029d-4e66-84dd-8c3188907c7f admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:44.247065 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c357c5-029d-4e66-84dd-8c3188907c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:44.247295 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c357c5-029d-4e66-84dd-8c3188907c7f admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:44.248419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c357c5-029d-4e66-84dd-8c3188907c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:44.251337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c357c5-029d-4e66-84dd-8c3188907c7f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:44.278802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1368/2740] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:05:44 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:05:44.283251 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2e7f0-4a10-4705-9b3a-07a8ad49a998 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:44.294629 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2e7f0-4a10-4705-9b3a-07a8ad49a998 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:44.300011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9a447-ccf1-466c-a8a4-380eade8ab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:44.300730 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9a447-ccf1-466c-a8a4-380eade8ab47 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:44.301009 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9a447-ccf1-466c-a8a4-380eade8ab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:44.301280 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9a447-ccf1-466c-a8a4-380eade8ab47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:44.302006 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9a447-ccf1-466c-a8a4-380eade8ab47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:44.303611 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9a447-ccf1-466c-a8a4-380eade8ab47 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:44.314838 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1373/2741] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:05:44.319246 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c357c5-029d-4e66-84dd-8c3188907c7f admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:44.330715 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c357c5-029d-4e66-84dd-8c3188907c7f admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:44.337403 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa359235-0c2e-4630-9f06-9594c71435de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:44.338094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa359235-0c2e-4630-9f06-9594c71435de admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:44.338382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa359235-0c2e-4630-9f06-9594c71435de admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:44.338654 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa359235-0c2e-4630-9f06-9594c71435de admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:44.339382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa359235-0c2e-4630-9f06-9594c71435de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:44.341065 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa359235-0c2e-4630-9f06-9594c71435de admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:44.356734 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1369/2742] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:05:44.361335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9a447-ccf1-466c-a8a4-380eade8ab47 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:44.372587 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9a447-ccf1-466c-a8a4-380eade8ab47 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:44.378431 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517f983-53fa-4202-a2ce-39a9cc5c58a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:44.379310 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517f983-53fa-4202-a2ce-39a9cc5c58a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:44.379582 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517f983-53fa-4202-a2ce-39a9cc5c58a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:44.379849 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517f983-53fa-4202-a2ce-39a9cc5c58a9 admin admin] PATH_INFO: `/v3/projects/3e5f710887d34a449168d236fdf362b4/users/47a519a5cf674ea5bf9cd8fafa374f2f/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:44.398236 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517f983-53fa-4202-a2ce-39a9cc5c58a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5f710887d34a449168d236fdf362b4, user_id=47a519a5cf674ea5bf9cd8fafa374f2f, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:44.402086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517f983-53fa-4202-a2ce-39a9cc5c58a9 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:44.419234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1374/2743] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:05:44 2022] PUT /identity/v3/projects/3e5f710887d34a449168d236fdf362b4/users/47a519a5cf674ea5bf9cd8fafa374f2f/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:44.430452 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e789e-a625-4c4a-a5a8-f08de8caf563 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:44.430740 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e789e-a625-4c4a-a5a8-f08de8caf563 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:44.431015 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e789e-a625-4c4a-a5a8-f08de8caf563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:44.461061 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-533e789e-a625-4c4a-a5a8-f08de8caf563 None None] MFA Rules not processed for user `47a519a5cf674ea5bf9cd8fafa374f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:44.462294 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-533e789e-a625-4c4a-a5a8-f08de8caf563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:44.544634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1370/2744] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:05:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:44.559500 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517f983-53fa-4202-a2ce-39a9cc5c58a9 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:44.561510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6517f983-53fa-4202-a2ce-39a9cc5c58a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:44.649808 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517f983-53fa-4202-a2ce-39a9cc5c58a9 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:44.654251 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee7293-6e7a-46dc-8e18-f59ada785d4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0303312c6cec4067a4a92d38edb59086', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:44.654910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7293-6e7a-46dc-8e18-f59ada785d4f service glance] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:44.655186 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7293-6e7a-46dc-8e18-f59ada785d4f service glance] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:44.655522 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7293-6e7a-46dc-8e18-f59ada785d4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:44.665256 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee7293-6e7a-46dc-8e18-f59ada785d4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:44.666791 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee7293-6e7a-46dc-8e18-f59ada785d4f service glance] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:44.676720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1375/2745] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:06:00.920639 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e789e-a625-4c4a-a5a8-f08de8caf563 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:00.922172 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-533e789e-a625-4c4a-a5a8-f08de8caf563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:00.981656 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e789e-a625-4c4a-a5a8-f08de8caf563 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:00.985907 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533d2f5-8695-421e-88a2-02577a6ebb4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:00.986751 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533d2f5-8695-421e-88a2-02577a6ebb4a service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:00.987032 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533d2f5-8695-421e-88a2-02577a6ebb4a service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:00.987303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533d2f5-8695-421e-88a2-02577a6ebb4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:00.989459 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a533d2f5-8695-421e-88a2-02577a6ebb4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:01.074087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533d2f5-8695-421e-88a2-02577a6ebb4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:01.075583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533d2f5-8695-421e-88a2-02577a6ebb4a service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:01.098406 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1371/2746] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:06:05.763474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee7293-6e7a-46dc-8e18-f59ada785d4f service glance] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:05.765078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-66ee7293-6e7a-46dc-8e18-f59ada785d4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:05.866198 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee7293-6e7a-46dc-8e18-f59ada785d4f service glance] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:05.871709 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b009973-9dca-49a8-bc9c-d50803885ded service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:05.872484 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b009973-9dca-49a8-bc9c-d50803885ded service placement] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:05.872816 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b009973-9dca-49a8-bc9c-d50803885ded service placement] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:05.873003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b009973-9dca-49a8-bc9c-d50803885ded service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:05.874924 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2b009973-9dca-49a8-bc9c-d50803885ded service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:05.888067 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b009973-9dca-49a8-bc9c-d50803885ded service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:05.889720 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b009973-9dca-49a8-bc9c-d50803885ded service placement] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:05.900961 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1376/2747] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:06:10.250017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533d2f5-8695-421e-88a2-02577a6ebb4a service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:10.252112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a533d2f5-8695-421e-88a2-02577a6ebb4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:10.341618 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533d2f5-8695-421e-88a2-02577a6ebb4a service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:10.348547 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e0ca3-5888-4b43-a0e7-86c57ebae2f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:10.348768 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e0ca3-5888-4b43-a0e7-86c57ebae2f9 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:10.349407 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e0ca3-5888-4b43-a0e7-86c57ebae2f9 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:10.349702 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e0ca3-5888-4b43-a0e7-86c57ebae2f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:10.351727 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ff6e0ca3-5888-4b43-a0e7-86c57ebae2f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:10.364601 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e0ca3-5888-4b43-a0e7-86c57ebae2f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:10.366325 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e0ca3-5888-4b43-a0e7-86c57ebae2f9 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:10.380951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1372/2748] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:06:12.041830 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b009973-9dca-49a8-bc9c-d50803885ded service placement] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:12.113070 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b009973-9dca-49a8-bc9c-d50803885ded service placement] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:12.120398 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effbfe2-d73f-4ca0-90e9-c99966ab1454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:12.121806 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effbfe2-d73f-4ca0-90e9-c99966ab1454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:12.122305 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effbfe2-d73f-4ca0-90e9-c99966ab1454 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:12.122803 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effbfe2-d73f-4ca0-90e9-c99966ab1454 admin admin] PATH_INFO: `/v3/users/47a519a5cf674ea5bf9cd8fafa374f2f` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:12.124899 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effbfe2-d73f-4ca0-90e9-c99966ab1454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a519a5cf674ea5bf9cd8fafa374f2f)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:12.128022 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effbfe2-d73f-4ca0-90e9-c99966ab1454 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:12.191642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-2effbfe2-d73f-4ca0-90e9-c99966ab1454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a519a5cf674ea5bf9cd8fafa374f2f'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:12.192558 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-2effbfe2-d73f-4ca0-90e9-c99966ab1454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a519a5cf674ea5bf9cd8fafa374f2f'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:12.206557 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-2effbfe2-d73f-4ca0-90e9-c99966ab1454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a519a5cf674ea5bf9cd8fafa374f2f'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:12.207346 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-2effbfe2-d73f-4ca0-90e9-c99966ab1454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a519a5cf674ea5bf9cd8fafa374f2f'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:12.214465 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-2effbfe2-d73f-4ca0-90e9-c99966ab1454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a519a5cf674ea5bf9cd8fafa374f2f'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:12.228455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1377/2749] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:06:12 2022] DELETE /identity/v3/users/47a519a5cf674ea5bf9cd8fafa374f2f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:12.234224 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976edccf-1b20-487d-b282-b4ecf187b98a None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:12.235149 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976edccf-1b20-487d-b282-b4ecf187b98a None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:12.235634 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976edccf-1b20-487d-b282-b4ecf187b98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:12.253248 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-976edccf-1b20-487d-b282-b4ecf187b98a None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:12.254464 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-976edccf-1b20-487d-b282-b4ecf187b98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:12.322914 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1373/2750] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:12.334418 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effbfe2-d73f-4ca0-90e9-c99966ab1454 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:12.337265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2effbfe2-d73f-4ca0-90e9-c99966ab1454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:12.406613 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effbfe2-d73f-4ca0-90e9-c99966ab1454 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:12.410869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629856e9-172f-4cf1-b058-1c40e1d3c76e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:12.411525 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629856e9-172f-4cf1-b058-1c40e1d3c76e service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:12.411806 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629856e9-172f-4cf1-b058-1c40e1d3c76e service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:12.412077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629856e9-172f-4cf1-b058-1c40e1d3c76e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:12.422578 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629856e9-172f-4cf1-b058-1c40e1d3c76e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:12.424034 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629856e9-172f-4cf1-b058-1c40e1d3c76e service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:12.434831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1378/2751] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:06:12.767372 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976edccf-1b20-487d-b282-b4ecf187b98a None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:12.769094 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-976edccf-1b20-487d-b282-b4ecf187b98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:12.783373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976edccf-1b20-487d-b282-b4ecf187b98a None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:12.791871 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a2c35-476a-4276-94ff-b1d6514bac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:12.792850 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a2c35-476a-4276-94ff-b1d6514bac9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:12.793129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a2c35-476a-4276-94ff-b1d6514bac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:12.793371 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a2c35-476a-4276-94ff-b1d6514bac9c admin admin] PATH_INFO: `/v3/projects/3e5f710887d34a449168d236fdf362b4` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:12.794664 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a2c35-476a-4276-94ff-b1d6514bac9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e5f710887d34a449168d236fdf362b4)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:12.796780 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a2c35-476a-4276-94ff-b1d6514bac9c admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:12.852935 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5c6a2c35-476a-4276-94ff-b1d6514bac9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e5f710887d34a449168d236fdf362b4', 'request_id': 'req-5c6a2c35-476a-4276-94ff-b1d6514bac9c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:12.863980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5c6a2c35-476a-4276-94ff-b1d6514bac9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e5f710887d34a449168d236fdf362b4', 'request_id': 'req-5c6a2c35-476a-4276-94ff-b1d6514bac9c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:12.870029 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5c6a2c35-476a-4276-94ff-b1d6514bac9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e5f710887d34a449168d236fdf362b4', 'request_id': 'req-5c6a2c35-476a-4276-94ff-b1d6514bac9c'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:12.882105 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5c6a2c35-476a-4276-94ff-b1d6514bac9c admin admin] The token cache is being invalidate because project 3e5f710887d34a449168d236fdf362b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:06:12.882393 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5c6a2c35-476a-4276-94ff-b1d6514bac9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:12.883061 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-5c6a2c35-476a-4276-94ff-b1d6514bac9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:12.885443 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1374/2752] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:06:12 2022] DELETE /identity/v3/projects/3e5f710887d34a449168d236fdf362b4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:12.891623 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4a33a-0541-45cd-8109-39fdbe29e480 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:12.892064 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4a33a-0541-45cd-8109-39fdbe29e480 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:12.892395 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4a33a-0541-45cd-8109-39fdbe29e480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:12.917933 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-49e4a33a-0541-45cd-8109-39fdbe29e480 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:12.919708 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-49e4a33a-0541-45cd-8109-39fdbe29e480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:12.990690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1379/2753] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:06:12.998498 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da44ce-43c5-4abb-89c5-d1794006bf5c None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:12.998796 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da44ce-43c5-4abb-89c5-d1794006bf5c None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:13.000490 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da44ce-43c5-4abb-89c5-d1794006bf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:13.019667 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-10da44ce-43c5-4abb-89c5-d1794006bf5c None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:13.020895 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-10da44ce-43c5-4abb-89c5-d1794006bf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:13.030175 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1375/2754] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:13.034737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4a33a-0541-45cd-8109-39fdbe29e480 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:13.045228 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4a33a-0541-45cd-8109-39fdbe29e480 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:13.050040 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25991a46-3d68-4038-935e-50b9504247a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:13.050714 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991a46-3d68-4038-935e-50b9504247a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:13.050986 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991a46-3d68-4038-935e-50b9504247a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:13.051255 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991a46-3d68-4038-935e-50b9504247a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:13.051977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25991a46-3d68-4038-935e-50b9504247a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:06:13.052315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25991a46-3d68-4038-935e-50b9504247a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:13.053941 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25991a46-3d68-4038-935e-50b9504247a3 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:13.066080 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1380/2755] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:06:13.070823 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da44ce-43c5-4abb-89c5-d1794006bf5c None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:13.080735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da44ce-43c5-4abb-89c5-d1794006bf5c None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:13.085891 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c972ae3-ae48-4027-83f9-3e5598c55ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:13.086737 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972ae3-ae48-4027-83f9-3e5598c55ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:13.087013 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972ae3-ae48-4027-83f9-3e5598c55ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:13.087280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972ae3-ae48-4027-83f9-3e5598c55ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:13.088044 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c972ae3-ae48-4027-83f9-3e5598c55ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:13.090012 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c972ae3-ae48-4027-83f9-3e5598c55ae4 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:13.124677 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1376/2756] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:06:13 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:06:13.129162 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25991a46-3d68-4038-935e-50b9504247a3 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:13.139776 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25991a46-3d68-4038-935e-50b9504247a3 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:13.195213 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1746f-422a-4ff8-8363-d73e0f9ed59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:13.195807 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1746f-422a-4ff8-8363-d73e0f9ed59f admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:13.196087 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1746f-422a-4ff8-8363-d73e0f9ed59f admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:13.196391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1746f-422a-4ff8-8363-d73e0f9ed59f admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:13.197093 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1746f-422a-4ff8-8363-d73e0f9ed59f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:13.199103 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1746f-422a-4ff8-8363-d73e0f9ed59f admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:13.224873 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1381/2757] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:06:13 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:06:13.229430 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c972ae3-ae48-4027-83f9-3e5598c55ae4 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:13.241642 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c972ae3-ae48-4027-83f9-3e5598c55ae4 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:13.246481 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302d17d-5523-4606-9f0e-ce0b03312c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:13.247139 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302d17d-5523-4606-9f0e-ce0b03312c0e admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:13.247516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302d17d-5523-4606-9f0e-ce0b03312c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:13.247853 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302d17d-5523-4606-9f0e-ce0b03312c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:13.248559 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302d17d-5523-4606-9f0e-ce0b03312c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:13.250194 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302d17d-5523-4606-9f0e-ce0b03312c0e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:13.260792 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1377/2758] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:06:13.265400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1746f-422a-4ff8-8363-d73e0f9ed59f admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:13.275643 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1746f-422a-4ff8-8363-d73e0f9ed59f admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:13.280389 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652004fd-09f5-476b-a7dc-1e24b82d1ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:13.281053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652004fd-09f5-476b-a7dc-1e24b82d1ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:13.281333 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652004fd-09f5-476b-a7dc-1e24b82d1ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:13.281608 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652004fd-09f5-476b-a7dc-1e24b82d1ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:13.282352 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652004fd-09f5-476b-a7dc-1e24b82d1ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:13.283945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652004fd-09f5-476b-a7dc-1e24b82d1ed1 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:13.294076 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1382/2759] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:06:13.298624 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302d17d-5523-4606-9f0e-ce0b03312c0e admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:13.308879 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302d17d-5523-4606-9f0e-ce0b03312c0e admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:13.314580 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107350c-8d9d-4eb8-908b-7d344391a7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:13.315473 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107350c-8d9d-4eb8-908b-7d344391a7f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:13.315718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107350c-8d9d-4eb8-908b-7d344391a7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:13.316012 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107350c-8d9d-4eb8-908b-7d344391a7f6 admin admin] PATH_INFO: `/v3/projects/19b4f4b27672464aa7c3becdc0e7bee3/users/413182964540418c9c75ca9ec989959b/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:13.332485 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107350c-8d9d-4eb8-908b-7d344391a7f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b4f4b27672464aa7c3becdc0e7bee3, user_id=413182964540418c9c75ca9ec989959b, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:13.335133 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107350c-8d9d-4eb8-908b-7d344391a7f6 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:13.352367 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1378/2760] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:06:13 2022] PUT /identity/v3/projects/19b4f4b27672464aa7c3becdc0e7bee3/users/413182964540418c9c75ca9ec989959b/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:13.367120 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e4bed-4663-47c2-b5ca-e0f6342a6a8a None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:13.367561 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e4bed-4663-47c2-b5ca-e0f6342a6a8a None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:13.368143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e4bed-4663-47c2-b5ca-e0f6342a6a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:13.398167 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-3b8e4bed-4663-47c2-b5ca-e0f6342a6a8a None None] MFA Rules not processed for user `413182964540418c9c75ca9ec989959b`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:13.399408 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-3b8e4bed-4663-47c2-b5ca-e0f6342a6a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:13.468354 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1383/2761] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:06:13.483031 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107350c-8d9d-4eb8-908b-7d344391a7f6 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:13.484990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-3107350c-8d9d-4eb8-908b-7d344391a7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:13.545707 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107350c-8d9d-4eb8-908b-7d344391a7f6 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:13.549643 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3dd7e-b438-4d6f-900f-768e6dc1c80f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:13.550301 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3dd7e-b438-4d6f-900f-768e6dc1c80f service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:13.550581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3dd7e-b438-4d6f-900f-768e6dc1c80f service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:13.550855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3dd7e-b438-4d6f-900f-768e6dc1c80f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:13.559525 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3dd7e-b438-4d6f-900f-768e6dc1c80f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:13.560916 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3dd7e-b438-4d6f-900f-768e6dc1c80f service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:13.569596 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1379/2762] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:06:16.129497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e4bed-4663-47c2-b5ca-e0f6342a6a8a None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:16.131046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-3b8e4bed-4663-47c2-b5ca-e0f6342a6a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:16.189981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e4bed-4663-47c2-b5ca-e0f6342a6a8a None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:16.193602 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df1c6f-8e8f-4161-b0e6-cc9f83a3c282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:16.194263 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df1c6f-8e8f-4161-b0e6-cc9f83a3c282 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:16.194536 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df1c6f-8e8f-4161-b0e6-cc9f83a3c282 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:16.194806 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df1c6f-8e8f-4161-b0e6-cc9f83a3c282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:16.196617 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b6df1c6f-8e8f-4161-b0e6-cc9f83a3c282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:16.266190 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df1c6f-8e8f-4161-b0e6-cc9f83a3c282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:16.267761 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df1c6f-8e8f-4161-b0e6-cc9f83a3c282 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:16.278097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1384/2763] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:06:22.902026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3dd7e-b438-4d6f-900f-768e6dc1c80f service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:22.903741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-dbb3dd7e-b438-4d6f-900f-768e6dc1c80f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:22.924758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3dd7e-b438-4d6f-900f-768e6dc1c80f service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:22.930415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11714009-05f2-4012-9ab2-f57733a2385e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:22.931408 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11714009-05f2-4012-9ab2-f57733a2385e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:22.931675 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11714009-05f2-4012-9ab2-f57733a2385e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:22.931949 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11714009-05f2-4012-9ab2-f57733a2385e admin admin] PATH_INFO: `/v3/users/8c01ed6e76ef4ee4ba5356c526e113e4` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:22.934049 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11714009-05f2-4012-9ab2-f57733a2385e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c01ed6e76ef4ee4ba5356c526e113e4)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:22.936041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11714009-05f2-4012-9ab2-f57733a2385e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:22.984906 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-11714009-05f2-4012-9ab2-f57733a2385e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c01ed6e76ef4ee4ba5356c526e113e4'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:22.985686 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-11714009-05f2-4012-9ab2-f57733a2385e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c01ed6e76ef4ee4ba5356c526e113e4'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:22.999683 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-11714009-05f2-4012-9ab2-f57733a2385e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c01ed6e76ef4ee4ba5356c526e113e4'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.000623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-11714009-05f2-4012-9ab2-f57733a2385e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c01ed6e76ef4ee4ba5356c526e113e4'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.009844 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-11714009-05f2-4012-9ab2-f57733a2385e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c01ed6e76ef4ee4ba5356c526e113e4'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.026752 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1380/2764] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:06:22 2022] DELETE /identity/v3/users/8c01ed6e76ef4ee4ba5356c526e113e4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:23.228144 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df1c6f-8e8f-4161-b0e6-cc9f83a3c282 service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:23.245834 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df1c6f-8e8f-4161-b0e6-cc9f83a3c282 service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:23.246848 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11714009-05f2-4012-9ab2-f57733a2385e admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:23.248960 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-11714009-05f2-4012-9ab2-f57733a2385e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:23.316780 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:23.317602 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:23.317875 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:23.318204 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c admin admin] PATH_INFO: `/v3/projects/1ffa8215f4d6479babed8b59e14b7e39` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:23.319479 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ffa8215f4d6479babed8b59e14b7e39)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:23.321565 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:23.323265 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11714009-05f2-4012-9ab2-f57733a2385e admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:23.328130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c366c4-95f8-4192-8937-1d3e6779b5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:23.329114 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c366c4-95f8-4192-8937-1d3e6779b5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:23.329415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c366c4-95f8-4192-8937-1d3e6779b5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:23.329690 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c366c4-95f8-4192-8937-1d3e6779b5b9 admin admin] PATH_INFO: `/v3/users/413182964540418c9c75ca9ec989959b` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:23.330936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c366c4-95f8-4192-8937-1d3e6779b5b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=413182964540418c9c75ca9ec989959b)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:23.332951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c366c4-95f8-4192-8937-1d3e6779b5b9 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:23.369897 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ffa8215f4d6479babed8b59e14b7e39', 'request_id': 'req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.378646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ffa8215f4d6479babed8b59e14b7e39', 'request_id': 'req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.379957 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-12c366c4-95f8-4192-8937-1d3e6779b5b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '413182964540418c9c75ca9ec989959b'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.380719 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-12c366c4-95f8-4192-8937-1d3e6779b5b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '413182964540418c9c75ca9ec989959b'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.385698 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ffa8215f4d6479babed8b59e14b7e39', 'request_id': 'req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.393473 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-12c366c4-95f8-4192-8937-1d3e6779b5b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '413182964540418c9c75ca9ec989959b'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.394254 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-12c366c4-95f8-4192-8937-1d3e6779b5b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '413182964540418c9c75ca9ec989959b'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.396450 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c admin admin] The token cache is being invalidate because project 1ffa8215f4d6479babed8b59e14b7e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:06:23.396738 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.397442 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.399261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1385/2765] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:06:23 2022] DELETE /identity/v3/projects/1ffa8215f4d6479babed8b59e14b7e39 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:23.402229 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-12c366c4-95f8-4192-8937-1d3e6779b5b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '413182964540418c9c75ca9ec989959b'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.404437 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:23.405892 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:23.415808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1381/2766] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:06:23 2022] DELETE /identity/v3/users/413182964540418c9c75ca9ec989959b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:23.420744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c6d6f-503e-4667-8d25-de5cd60df9a8 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:23.421031 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c6d6f-503e-4667-8d25-de5cd60df9a8 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:23.421306 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c6d6f-503e-4667-8d25-de5cd60df9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:23.438914 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-1e4c6d6f-503e-4667-8d25-de5cd60df9a8 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:23.440433 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1e4c6d6f-503e-4667-8d25-de5cd60df9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:23.470655 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db614c3b-e96d-4cda-acaa-6ec5ee9ef68c admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:23.502528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1382/2767] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:23.513427 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c6d6f-503e-4667-8d25-de5cd60df9a8 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:23.514819 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1e4c6d6f-503e-4667-8d25-de5cd60df9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:23.529136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44a499-dfb5-4621-b4f5-01e32f3ea66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:23.530056 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44a499-dfb5-4621-b4f5-01e32f3ea66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:23.530335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44a499-dfb5-4621-b4f5-01e32f3ea66d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:23.530613 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44a499-dfb5-4621-b4f5-01e32f3ea66d admin admin] PATH_INFO: `/v3/users/1c9db6fb132840a68b762e73132313ae` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:23.548736 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44a499-dfb5-4621-b4f5-01e32f3ea66d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9db6fb132840a68b762e73132313ae)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:23.550718 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44a499-dfb5-4621-b4f5-01e32f3ea66d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:23.585682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c6d6f-503e-4667-8d25-de5cd60df9a8 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:23.590789 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d46a5-d284-4e4a-8ef3-84375a992e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:23.591587 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d46a5-d284-4e4a-8ef3-84375a992e22 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:23.591929 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d46a5-d284-4e4a-8ef3-84375a992e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:23.592239 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d46a5-d284-4e4a-8ef3-84375a992e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:23.600774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4e44a499-dfb5-4621-b4f5-01e32f3ea66d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9db6fb132840a68b762e73132313ae'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.601429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4e44a499-dfb5-4621-b4f5-01e32f3ea66d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9db6fb132840a68b762e73132313ae'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.601650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d46a5-d284-4e4a-8ef3-84375a992e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:23.603233 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d46a5-d284-4e4a-8ef3-84375a992e22 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:23.613963 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4e44a499-dfb5-4621-b4f5-01e32f3ea66d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9db6fb132840a68b762e73132313ae'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.614649 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4e44a499-dfb5-4621-b4f5-01e32f3ea66d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9db6fb132840a68b762e73132313ae'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.616359 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1383/2768] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:06:23.623293 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-4e44a499-dfb5-4621-b4f5-01e32f3ea66d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9db6fb132840a68b762e73132313ae'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:23.639059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1386/2769] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:06:23 2022] DELETE /identity/v3/users/1c9db6fb132840a68b762e73132313ae => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:23.947037 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d46a5-d284-4e4a-8ef3-84375a992e22 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:23.958984 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d46a5-d284-4e4a-8ef3-84375a992e22 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:24.033728 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf9246-a6b5-475d-a52f-60b79e6b4ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:24.034626 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf9246-a6b5-475d-a52f-60b79e6b4ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:24.035749 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf9246-a6b5-475d-a52f-60b79e6b4ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:24.035749 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf9246-a6b5-475d-a52f-60b79e6b4ce3 admin admin] PATH_INFO: `/v3/projects/ad803df8780d4fc8acfbb929b9fd4ca4` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:24.042893 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44a499-dfb5-4621-b4f5-01e32f3ea66d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:24.046091 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4e44a499-dfb5-4621-b4f5-01e32f3ea66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:24.050396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf9246-a6b5-475d-a52f-60b79e6b4ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad803df8780d4fc8acfbb929b9fd4ca4)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:24.052608 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf9246-a6b5-475d-a52f-60b79e6b4ce3 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:24.064487 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44a499-dfb5-4621-b4f5-01e32f3ea66d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:24.071693 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e6a27-d004-4810-92b8-65558496bd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:24.072795 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e6a27-d004-4810-92b8-65558496bd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:24.073212 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e6a27-d004-4810-92b8-65558496bd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:24.073713 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e6a27-d004-4810-92b8-65558496bd9c admin admin] PATH_INFO: `/v3/projects/19b4f4b27672464aa7c3becdc0e7bee3` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:24.075238 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e6a27-d004-4810-92b8-65558496bd9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b4f4b27672464aa7c3becdc0e7bee3)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:24.078625 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e6a27-d004-4810-92b8-65558496bd9c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:24.120470 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c4cf9246-a6b5-475d-a52f-60b79e6b4ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad803df8780d4fc8acfbb929b9fd4ca4', 'request_id': 'req-c4cf9246-a6b5-475d-a52f-60b79e6b4ce3'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:24.130456 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c4cf9246-a6b5-475d-a52f-60b79e6b4ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad803df8780d4fc8acfbb929b9fd4ca4', 'request_id': 'req-c4cf9246-a6b5-475d-a52f-60b79e6b4ce3'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:24.137538 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c4cf9246-a6b5-475d-a52f-60b79e6b4ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad803df8780d4fc8acfbb929b9fd4ca4', 'request_id': 'req-c4cf9246-a6b5-475d-a52f-60b79e6b4ce3'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:24.143980 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e88e6a27-d004-4810-92b8-65558496bd9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b4f4b27672464aa7c3becdc0e7bee3', 'request_id': 'req-e88e6a27-d004-4810-92b8-65558496bd9c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:24.151601 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c4cf9246-a6b5-475d-a52f-60b79e6b4ce3 admin admin] The token cache is being invalidate because project ad803df8780d4fc8acfbb929b9fd4ca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:06:24.151977 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c4cf9246-a6b5-475d-a52f-60b79e6b4ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:24.152833 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-c4cf9246-a6b5-475d-a52f-60b79e6b4ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:24.153479 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e88e6a27-d004-4810-92b8-65558496bd9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b4f4b27672464aa7c3becdc0e7bee3', 'request_id': 'req-e88e6a27-d004-4810-92b8-65558496bd9c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:24.154746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1384/2770] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:06:23 2022] DELETE /identity/v3/projects/ad803df8780d4fc8acfbb929b9fd4ca4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:24.161343 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e88e6a27-d004-4810-92b8-65558496bd9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b4f4b27672464aa7c3becdc0e7bee3', 'request_id': 'req-e88e6a27-d004-4810-92b8-65558496bd9c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:24.174557 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e88e6a27-d004-4810-92b8-65558496bd9c admin admin] The token cache is being invalidate because project 19b4f4b27672464aa7c3becdc0e7bee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:06:24.174853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e88e6a27-d004-4810-92b8-65558496bd9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:24.175559 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-e88e6a27-d004-4810-92b8-65558496bd9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:24.177688 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1387/2771] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:06:24 2022] DELETE /identity/v3/projects/19b4f4b27672464aa7c3becdc0e7bee3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:06:24.183217 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3b9ec-7a76-4737-a9c2-757e9f977965 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:24.183505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3b9ec-7a76-4737-a9c2-757e9f977965 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:24.183834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3b9ec-7a76-4737-a9c2-757e9f977965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:24.204790 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-26e3b9ec-7a76-4737-a9c2-757e9f977965 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:24.206438 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-26e3b9ec-7a76-4737-a9c2-757e9f977965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:24.296118 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1385/2772] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:24.305282 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288581e3-20e8-47a5-8af1-859d8bd7f7cd None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:24.305950 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288581e3-20e8-47a5-8af1-859d8bd7f7cd None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:24.305950 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288581e3-20e8-47a5-8af1-859d8bd7f7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:24.330411 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-288581e3-20e8-47a5-8af1-859d8bd7f7cd None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:24.332112 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-288581e3-20e8-47a5-8af1-859d8bd7f7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:24.342513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1388/2773] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:24.347348 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3b9ec-7a76-4737-a9c2-757e9f977965 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:24.360084 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3b9ec-7a76-4737-a9c2-757e9f977965 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:24.366605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed1a2-e1b6-4ced-ac9f-76946e22cc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:24.367303 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed1a2-e1b6-4ced-ac9f-76946e22cc59 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:24.367608 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed1a2-e1b6-4ced-ac9f-76946e22cc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:24.367884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed1a2-e1b6-4ced-ac9f-76946e22cc59 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:24.368804 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eed1a2-e1b6-4ced-ac9f-76946e22cc59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:06:24.369080 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eed1a2-e1b6-4ced-ac9f-76946e22cc59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:24.370956 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eed1a2-e1b6-4ced-ac9f-76946e22cc59 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:24.386061 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1386/2774] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:06:24.390974 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288581e3-20e8-47a5-8af1-859d8bd7f7cd None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:24.401713 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288581e3-20e8-47a5-8af1-859d8bd7f7cd None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:24.407308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b508787-fe81-4acb-8b11-1ca33f352057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:24.408039 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b508787-fe81-4acb-8b11-1ca33f352057 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:24.408357 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b508787-fe81-4acb-8b11-1ca33f352057 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:24.408629 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b508787-fe81-4acb-8b11-1ca33f352057 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:24.409367 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b508787-fe81-4acb-8b11-1ca33f352057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:24.411298 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b508787-fe81-4acb-8b11-1ca33f352057 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:24.443676 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1389/2775] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:06:24 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:06:24.453174 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed1a2-e1b6-4ced-ac9f-76946e22cc59 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:24.466408 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed1a2-e1b6-4ced-ac9f-76946e22cc59 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:24.530315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3cf81-e282-49c4-bb14-9a262e95d253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:24.531021 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3cf81-e282-49c4-bb14-9a262e95d253 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:24.531300 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3cf81-e282-49c4-bb14-9a262e95d253 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:24.531568 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3cf81-e282-49c4-bb14-9a262e95d253 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:24.532397 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3cf81-e282-49c4-bb14-9a262e95d253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:24.534319 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3cf81-e282-49c4-bb14-9a262e95d253 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:24.555618 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1387/2776] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:06:24 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:06:24.561237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b508787-fe81-4acb-8b11-1ca33f352057 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:24.575759 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b508787-fe81-4acb-8b11-1ca33f352057 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:24.583800 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c697ff8-5033-4d48-82b1-5508038731a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:24.584862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c697ff8-5033-4d48-82b1-5508038731a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:24.585309 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c697ff8-5033-4d48-82b1-5508038731a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:24.585758 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c697ff8-5033-4d48-82b1-5508038731a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:24.586764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c697ff8-5033-4d48-82b1-5508038731a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:24.588623 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c697ff8-5033-4d48-82b1-5508038731a8 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:24.600467 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1390/2777] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:06:24.605193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3cf81-e282-49c4-bb14-9a262e95d253 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:24.618287 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3cf81-e282-49c4-bb14-9a262e95d253 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:24.625952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd8dbe-4baf-441c-8aa7-09536fd5dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:24.627000 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd8dbe-4baf-441c-8aa7-09536fd5dd3d admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:24.627475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd8dbe-4baf-441c-8aa7-09536fd5dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:24.627925 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd8dbe-4baf-441c-8aa7-09536fd5dd3d admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:24.629275 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd8dbe-4baf-441c-8aa7-09536fd5dd3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:24.631877 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd8dbe-4baf-441c-8aa7-09536fd5dd3d admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:24.644073 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1388/2778] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:06:24.649279 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c697ff8-5033-4d48-82b1-5508038731a8 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:24.660894 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c697ff8-5033-4d48-82b1-5508038731a8 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:24.666839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df02a6e-5376-4b63-85fb-f078791faab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:24.667766 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df02a6e-5376-4b63-85fb-f078791faab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:24.668140 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df02a6e-5376-4b63-85fb-f078791faab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:24.668455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df02a6e-5376-4b63-85fb-f078791faab0 admin admin] PATH_INFO: `/v3/projects/6d23456b3c7840b2a0dc28a2ff6e5dfd/users/947854e0aa8a4217a2165a039b940a9c/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:24.685308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df02a6e-5376-4b63-85fb-f078791faab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d23456b3c7840b2a0dc28a2ff6e5dfd, user_id=947854e0aa8a4217a2165a039b940a9c, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:24.687996 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df02a6e-5376-4b63-85fb-f078791faab0 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:24.703493 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1391/2779] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:06:24 2022] PUT /identity/v3/projects/6d23456b3c7840b2a0dc28a2ff6e5dfd/users/947854e0aa8a4217a2165a039b940a9c/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:24.714545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0302a9-43f9-42a4-bd31-ce1629e22642 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:24.714855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0302a9-43f9-42a4-bd31-ce1629e22642 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:24.715129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0302a9-43f9-42a4-bd31-ce1629e22642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:24.744474 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-7c0302a9-43f9-42a4-bd31-ce1629e22642 None None] MFA Rules not processed for user `947854e0aa8a4217a2165a039b940a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:24.745766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7c0302a9-43f9-42a4-bd31-ce1629e22642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:24.815161 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1389/2780] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:24.826912 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df02a6e-5376-4b63-85fb-f078791faab0 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:24.829594 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1df02a6e-5376-4b63-85fb-f078791faab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:24.897221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df02a6e-5376-4b63-85fb-f078791faab0 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:24.901580 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88d510-8bd4-4bb5-8900-5d6b7592b644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:24.902261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88d510-8bd4-4bb5-8900-5d6b7592b644 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:24.902542 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88d510-8bd4-4bb5-8900-5d6b7592b644 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:24.902813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88d510-8bd4-4bb5-8900-5d6b7592b644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:24.912745 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88d510-8bd4-4bb5-8900-5d6b7592b644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:24.914624 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88d510-8bd4-4bb5-8900-5d6b7592b644 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:24.924745 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1392/2781] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:06:26.355102 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b32b41-780a-46e9-a4ad-fe502dbab130 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:26.355855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b32b41-780a-46e9-a4ad-fe502dbab130 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:26.355855 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b32b41-780a-46e9-a4ad-fe502dbab130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:26.377592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-f2b32b41-780a-46e9-a4ad-fe502dbab130 None None] MFA Rules not processed for user `947854e0aa8a4217a2165a039b940a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:26.378806 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f2b32b41-780a-46e9-a4ad-fe502dbab130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:26.387198 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1390/2782] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:42.801358 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec52ee2-491d-4ad3-be02-c6958fbe032c None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:42.801844 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec52ee2-491d-4ad3-be02-c6958fbe032c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:42.801971 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec52ee2-491d-4ad3-be02-c6958fbe032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:42.881149 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-4ec52ee2-491d-4ad3-be02-c6958fbe032c None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:42.882395 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4ec52ee2-491d-4ad3-be02-c6958fbe032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:42.951850 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1393/2783] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Nov 2 13:06:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:43.013210 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b32b41-780a-46e9-a4ad-fe502dbab130 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:43.014652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f2b32b41-780a-46e9-a4ad-fe502dbab130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:43.111125 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b32b41-780a-46e9-a4ad-fe502dbab130 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:43.116491 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269e18b-db37-45d2-b921-ab1bd49c672f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:43.117176 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269e18b-db37-45d2-b921-ab1bd49c672f service swift] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:43.117453 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269e18b-db37-45d2-b921-ab1bd49c672f service swift] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:43.117722 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269e18b-db37-45d2-b921-ab1bd49c672f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:43.126125 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269e18b-db37-45d2-b921-ab1bd49c672f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:43.127836 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269e18b-db37-45d2-b921-ab1bd49c672f service swift] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:43.136548 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1391/2784] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 13:06:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 13:06:43.698783 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc3fb0-96ec-4d01-b91a-673a428d2da0 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:43.699057 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc3fb0-96ec-4d01-b91a-673a428d2da0 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:43.699341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc3fb0-96ec-4d01-b91a-673a428d2da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:43.717726 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-5edc3fb0-96ec-4d01-b91a-673a428d2da0 None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:43.718936 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5edc3fb0-96ec-4d01-b91a-673a428d2da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:43.730444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1394/2785] 10.222.0.90 () {58 vars in 967 bytes} [Wed Nov 2 13:06:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:43.746001 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269e18b-db37-45d2-b921-ab1bd49c672f service swift] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:43.757563 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269e18b-db37-45d2-b921-ab1bd49c672f service swift] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:43.763522 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f1f54-611c-4257-b42d-0f42d8ec50d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:43.764190 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f1f54-611c-4257-b42d-0f42d8ec50d5 service swift] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:43.764493 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f1f54-611c-4257-b42d-0f42d8ec50d5 service swift] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:43.764764 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f1f54-611c-4257-b42d-0f42d8ec50d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:43.773743 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f1f54-611c-4257-b42d-0f42d8ec50d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:43.775369 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f1f54-611c-4257-b42d-0f42d8ec50d5 service swift] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:43.784352 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1392/2786] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 13:06:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:06:43.990400 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2f61-e57c-4df8-b9df-071162172a2f None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:43.991088 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2f61-e57c-4df8-b9df-071162172a2f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:43.991088 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2f61-e57c-4df8-b9df-071162172a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:44.010843 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-91fa2f61-e57c-4df8-b9df-071162172a2f None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:44.012013 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-91fa2f61-e57c-4df8-b9df-071162172a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:44.019718 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1395/2787] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Nov 2 13:06:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:44.035314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f1f54-611c-4257-b42d-0f42d8ec50d5 service swift] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:44.047156 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f1f54-611c-4257-b42d-0f42d8ec50d5 service swift] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:44.052755 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66767516-7635-42c8-a828-5aea8045f0b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:44.053503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66767516-7635-42c8-a828-5aea8045f0b5 service swift] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:44.053782 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66767516-7635-42c8-a828-5aea8045f0b5 service swift] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:44.054055 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66767516-7635-42c8-a828-5aea8045f0b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:44.063087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66767516-7635-42c8-a828-5aea8045f0b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:44.064712 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66767516-7635-42c8-a828-5aea8045f0b5 service swift] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:44.073145 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1393/2788] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 13:06:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:06:44.437396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ac5cf-6198-4002-8c35-a8b731f60f6c None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:44.437678 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ac5cf-6198-4002-8c35-a8b731f60f6c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:44.437947 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ac5cf-6198-4002-8c35-a8b731f60f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:44.457954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-846ac5cf-6198-4002-8c35-a8b731f60f6c None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:44.459324 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-846ac5cf-6198-4002-8c35-a8b731f60f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:44.467128 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1396/2789] 10.222.0.90 () {58 vars in 967 bytes} [Wed Nov 2 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:44.481269 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66767516-7635-42c8-a828-5aea8045f0b5 service swift] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:44.492143 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66767516-7635-42c8-a828-5aea8045f0b5 service swift] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:44.498483 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce5c54-e0cb-45e4-b944-035424779ec5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:44.499082 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce5c54-e0cb-45e4-b944-035424779ec5 service swift] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:44.499362 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce5c54-e0cb-45e4-b944-035424779ec5 service swift] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:44.499636 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce5c54-e0cb-45e4-b944-035424779ec5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:44.509414 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce5c54-e0cb-45e4-b944-035424779ec5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:44.511229 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce5c54-e0cb-45e4-b944-035424779ec5 service swift] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:44.519805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1394/2790] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 13:06:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:06:46.744816 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ac5cf-6198-4002-8c35-a8b731f60f6c None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:46.826430 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ac5cf-6198-4002-8c35-a8b731f60f6c None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:46.831935 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48de89-d22c-4835-8514-151dba38cbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:46.833289 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48de89-d22c-4835-8514-151dba38cbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:46.833765 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48de89-d22c-4835-8514-151dba38cbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:46.834246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48de89-d22c-4835-8514-151dba38cbb4 admin admin] PATH_INFO: `/v3/users/947854e0aa8a4217a2165a039b940a9c` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:46.835668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48de89-d22c-4835-8514-151dba38cbb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=947854e0aa8a4217a2165a039b940a9c)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:46.838171 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48de89-d22c-4835-8514-151dba38cbb4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:46.907052 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8f48de89-d22c-4835-8514-151dba38cbb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947854e0aa8a4217a2165a039b940a9c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:46.907962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8f48de89-d22c-4835-8514-151dba38cbb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947854e0aa8a4217a2165a039b940a9c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:46.925492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8f48de89-d22c-4835-8514-151dba38cbb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947854e0aa8a4217a2165a039b940a9c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:46.926248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8f48de89-d22c-4835-8514-151dba38cbb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947854e0aa8a4217a2165a039b940a9c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:46.950406 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8f48de89-d22c-4835-8514-151dba38cbb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947854e0aa8a4217a2165a039b940a9c'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:46.964931 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1397/2791] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:06:46 2022] DELETE /identity/v3/users/947854e0aa8a4217a2165a039b940a9c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:46.970007 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34355c6-ffb7-4c76-a0b4-2eaaa8494669 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:46.970537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34355c6-ffb7-4c76-a0b4-2eaaa8494669 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:46.970943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34355c6-ffb7-4c76-a0b4-2eaaa8494669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:46.992379 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-f34355c6-ffb7-4c76-a0b4-2eaaa8494669 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:46.993846 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f34355c6-ffb7-4c76-a0b4-2eaaa8494669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:47.067364 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1395/2792] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:47.078607 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48de89-d22c-4835-8514-151dba38cbb4 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:47.080558 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8f48de89-d22c-4835-8514-151dba38cbb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:47.150995 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48de89-d22c-4835-8514-151dba38cbb4 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:47.157569 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e9e99-bfc8-488c-875f-4cd0b3d50641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:47.158338 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e9e99-bfc8-488c-875f-4cd0b3d50641 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:47.158686 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e9e99-bfc8-488c-875f-4cd0b3d50641 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:47.159165 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e9e99-bfc8-488c-875f-4cd0b3d50641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:47.171662 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e9e99-bfc8-488c-875f-4cd0b3d50641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:47.173937 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e9e99-bfc8-488c-875f-4cd0b3d50641 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:47.186583 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1398/2793] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:06:47.359735 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34355c6-ffb7-4c76-a0b4-2eaaa8494669 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:47.361225 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f34355c6-ffb7-4c76-a0b4-2eaaa8494669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:47.374124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34355c6-ffb7-4c76-a0b4-2eaaa8494669 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:47.378950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ccb49-072e-4381-8651-6a47fac51713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:47.379951 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ccb49-072e-4381-8651-6a47fac51713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:47.380774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ccb49-072e-4381-8651-6a47fac51713 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:47.381339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ccb49-072e-4381-8651-6a47fac51713 admin admin] PATH_INFO: `/v3/projects/6d23456b3c7840b2a0dc28a2ff6e5dfd` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:47.382957 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ccb49-072e-4381-8651-6a47fac51713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d23456b3c7840b2a0dc28a2ff6e5dfd)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:47.385466 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ccb49-072e-4381-8651-6a47fac51713 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:47.439259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-577ccb49-072e-4381-8651-6a47fac51713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'request_id': 'req-577ccb49-072e-4381-8651-6a47fac51713'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:47.447166 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-577ccb49-072e-4381-8651-6a47fac51713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'request_id': 'req-577ccb49-072e-4381-8651-6a47fac51713'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:47.452906 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-577ccb49-072e-4381-8651-6a47fac51713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'request_id': 'req-577ccb49-072e-4381-8651-6a47fac51713'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:47.469317 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-577ccb49-072e-4381-8651-6a47fac51713 admin admin] The token cache is being invalidate because project 6d23456b3c7840b2a0dc28a2ff6e5dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:06:47.469685 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-577ccb49-072e-4381-8651-6a47fac51713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:47.470411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-577ccb49-072e-4381-8651-6a47fac51713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:47.472443 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1396/2794] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:06:47 2022] DELETE /identity/v3/projects/6d23456b3c7840b2a0dc28a2ff6e5dfd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:47.477335 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d86302-2ff9-42c0-a8e0-ec28f4457642 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:47.477619 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d86302-2ff9-42c0-a8e0-ec28f4457642 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:47.477891 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d86302-2ff9-42c0-a8e0-ec28f4457642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:47.496337 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-44d86302-2ff9-42c0-a8e0-ec28f4457642 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:47.497634 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-44d86302-2ff9-42c0-a8e0-ec28f4457642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:47.557786 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1399/2795] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:47.566002 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f73f29-769d-4e54-9c66-6ab817eb3f15 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:47.566314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f73f29-769d-4e54-9c66-6ab817eb3f15 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:47.566594 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f73f29-769d-4e54-9c66-6ab817eb3f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:47.586766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e2f73f29-769d-4e54-9c66-6ab817eb3f15 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:47.588091 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e2f73f29-769d-4e54-9c66-6ab817eb3f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:47.596019 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1397/2796] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:47.600609 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d86302-2ff9-42c0-a8e0-ec28f4457642 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:47.610895 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d86302-2ff9-42c0-a8e0-ec28f4457642 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:47.616690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae80225-e1a7-410d-a842-7cff79257207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:47.617396 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae80225-e1a7-410d-a842-7cff79257207 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:47.617751 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae80225-e1a7-410d-a842-7cff79257207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:47.618472 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae80225-e1a7-410d-a842-7cff79257207 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:47.618703 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae80225-e1a7-410d-a842-7cff79257207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:06:47.619079 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae80225-e1a7-410d-a842-7cff79257207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:47.621136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae80225-e1a7-410d-a842-7cff79257207 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:47.637735 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1400/2797] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:06:47.638762 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f73f29-769d-4e54-9c66-6ab817eb3f15 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:47.648264 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f73f29-769d-4e54-9c66-6ab817eb3f15 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:47.653185 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639bbc6-f8c9-4729-b70d-9a093a33e73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:47.653862 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639bbc6-f8c9-4729-b70d-9a093a33e73f admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:47.654128 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639bbc6-f8c9-4729-b70d-9a093a33e73f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:47.654404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639bbc6-f8c9-4729-b70d-9a093a33e73f admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:47.655104 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639bbc6-f8c9-4729-b70d-9a093a33e73f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:47.657050 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639bbc6-f8c9-4729-b70d-9a093a33e73f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:47.685291 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1398/2798] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:06:47 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:06:47.689545 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae80225-e1a7-410d-a842-7cff79257207 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:47.700086 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae80225-e1a7-410d-a842-7cff79257207 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:47.758242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d81574-bc84-4ec0-8fc2-b82cdb5b08d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:47.759465 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d81574-bc84-4ec0-8fc2-b82cdb5b08d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:47.759747 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d81574-bc84-4ec0-8fc2-b82cdb5b08d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:47.760018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d81574-bc84-4ec0-8fc2-b82cdb5b08d4 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:47.760997 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d81574-bc84-4ec0-8fc2-b82cdb5b08d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:47.763011 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d81574-bc84-4ec0-8fc2-b82cdb5b08d4 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:47.786711 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1401/2799] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:06:47 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:06:47.790884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639bbc6-f8c9-4729-b70d-9a093a33e73f admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:47.802312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639bbc6-f8c9-4729-b70d-9a093a33e73f admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:47.807010 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52415f-0381-4288-b9eb-7bddfd9ff2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:47.807769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52415f-0381-4288-b9eb-7bddfd9ff2af admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:47.808044 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52415f-0381-4288-b9eb-7bddfd9ff2af admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:47.808347 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52415f-0381-4288-b9eb-7bddfd9ff2af admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:47.809089 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52415f-0381-4288-b9eb-7bddfd9ff2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:47.810787 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52415f-0381-4288-b9eb-7bddfd9ff2af admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:47.826368 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1399/2800] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:06:47.830809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d81574-bc84-4ec0-8fc2-b82cdb5b08d4 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:47.841641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d81574-bc84-4ec0-8fc2-b82cdb5b08d4 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:47.846505 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f32d3-3576-488f-9280-cd00e0d60268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:47.847124 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f32d3-3576-488f-9280-cd00e0d60268 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:47.847382 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f32d3-3576-488f-9280-cd00e0d60268 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:47.847651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f32d3-3576-488f-9280-cd00e0d60268 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:47.848447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f32d3-3576-488f-9280-cd00e0d60268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:47.850050 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f32d3-3576-488f-9280-cd00e0d60268 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:47.865940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1402/2801] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:06:47.867028 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52415f-0381-4288-b9eb-7bddfd9ff2af admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:47.877109 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52415f-0381-4288-b9eb-7bddfd9ff2af admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:47.882569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92ea51-1386-41b3-b092-46a621167de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:47.883811 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92ea51-1386-41b3-b092-46a621167de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:47.884087 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92ea51-1386-41b3-b092-46a621167de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:47.884384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92ea51-1386-41b3-b092-46a621167de6 admin admin] PATH_INFO: `/v3/projects/22ac1778be064017858e588e9567fd27/users/39f0c145873843fa9cb970bba426cbdf/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:47.900228 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92ea51-1386-41b3-b092-46a621167de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ac1778be064017858e588e9567fd27, user_id=39f0c145873843fa9cb970bba426cbdf, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:47.902961 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92ea51-1386-41b3-b092-46a621167de6 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:47.916364 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1400/2802] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:06:47 2022] PUT /identity/v3/projects/22ac1778be064017858e588e9567fd27/users/39f0c145873843fa9cb970bba426cbdf/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:47.921806 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370545c-478c-4da4-9ead-11d13de9740c None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:47.922150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370545c-478c-4da4-9ead-11d13de9740c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:47.922429 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370545c-478c-4da4-9ead-11d13de9740c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:47.940421 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-3370545c-478c-4da4-9ead-11d13de9740c None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:47.941642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-3370545c-478c-4da4-9ead-11d13de9740c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:48.015224 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1403/2803] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:48.026852 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92ea51-1386-41b3-b092-46a621167de6 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:48.028586 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-fb92ea51-1386-41b3-b092-46a621167de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:48.086668 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92ea51-1386-41b3-b092-46a621167de6 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:48.090761 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654cbac-1853-4b22-9b39-95144d2c749f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:48.091463 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654cbac-1853-4b22-9b39-95144d2c749f service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:48.091897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654cbac-1853-4b22-9b39-95144d2c749f service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:48.092268 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654cbac-1853-4b22-9b39-95144d2c749f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:48.102487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654cbac-1853-4b22-9b39-95144d2c749f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:48.103875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654cbac-1853-4b22-9b39-95144d2c749f service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:48.113825 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1401/2804] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:06:52.174715 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776a618-b1a7-4f0d-bc86-804e3370cb7f None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:52.175311 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776a618-b1a7-4f0d-bc86-804e3370cb7f None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:52.175311 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776a618-b1a7-4f0d-bc86-804e3370cb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:52.202850 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-b776a618-b1a7-4f0d-bc86-804e3370cb7f None None] MFA Rules not processed for user `39f0c145873843fa9cb970bba426cbdf`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:52.204028 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b776a618-b1a7-4f0d-bc86-804e3370cb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:52.285149 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1404/2805] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:52.286146 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654cbac-1853-4b22-9b39-95144d2c749f service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:52.308113 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654cbac-1853-4b22-9b39-95144d2c749f service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:52.313178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf08dc-8845-4448-acb5-9c3c1e61dec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:52.313950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf08dc-8845-4448-acb5-9c3c1e61dec1 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:52.314236 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf08dc-8845-4448-acb5-9c3c1e61dec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:52.314535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf08dc-8845-4448-acb5-9c3c1e61dec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:52.315446 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf08dc-8845-4448-acb5-9c3c1e61dec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:52.317707 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf08dc-8845-4448-acb5-9c3c1e61dec1 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:52.346650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1402/2806] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:06:52 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:06:52.350866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776a618-b1a7-4f0d-bc86-804e3370cb7f None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:52.362180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776a618-b1a7-4f0d-bc86-804e3370cb7f None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:52.422808 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43352d42-6cfb-433f-88c8-5e389996096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:52.423532 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352d42-6cfb-433f-88c8-5e389996096a admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:52.423814 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352d42-6cfb-433f-88c8-5e389996096a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:52.424082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352d42-6cfb-433f-88c8-5e389996096a admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:52.424965 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43352d42-6cfb-433f-88c8-5e389996096a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:52.426919 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43352d42-6cfb-433f-88c8-5e389996096a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:52.451076 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1405/2807] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:06:52 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:06:52.455259 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf08dc-8845-4448-acb5-9c3c1e61dec1 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:52.466965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf08dc-8845-4448-acb5-9c3c1e61dec1 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:52.471973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cadc07-5a90-43d9-b14c-55a2fd0e5e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:52.473055 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cadc07-5a90-43d9-b14c-55a2fd0e5e08 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:52.473340 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cadc07-5a90-43d9-b14c-55a2fd0e5e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:52.473622 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cadc07-5a90-43d9-b14c-55a2fd0e5e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:52.474419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cadc07-5a90-43d9-b14c-55a2fd0e5e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:52.476054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cadc07-5a90-43d9-b14c-55a2fd0e5e08 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:52.492111 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1403/2808] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:06:52.493475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43352d42-6cfb-433f-88c8-5e389996096a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:52.503945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43352d42-6cfb-433f-88c8-5e389996096a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:52.509662 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334186c-1341-4cc2-b6ac-4596dac59334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:52.510772 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334186c-1341-4cc2-b6ac-4596dac59334 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:52.511051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334186c-1341-4cc2-b6ac-4596dac59334 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:52.511321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334186c-1341-4cc2-b6ac-4596dac59334 admin admin] PATH_INFO: `/v3/projects/297c21f1e672477391af8b74b9cb5ba7/users/73852b44f9454d9ea44bb65e79e3eabb/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:52.527234 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334186c-1341-4cc2-b6ac-4596dac59334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=297c21f1e672477391af8b74b9cb5ba7, user_id=73852b44f9454d9ea44bb65e79e3eabb, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:52.530120 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334186c-1341-4cc2-b6ac-4596dac59334 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:52.545716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1406/2809] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:06:52 2022] PUT /identity/v3/projects/297c21f1e672477391af8b74b9cb5ba7/users/73852b44f9454d9ea44bb65e79e3eabb/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:52.550008 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cadc07-5a90-43d9-b14c-55a2fd0e5e08 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:52.561734 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cadc07-5a90-43d9-b14c-55a2fd0e5e08 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:52.640164 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a302f-ae97-445e-a100-2e593704621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:52.640939 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a302f-ae97-445e-a100-2e593704621f admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:52.641219 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a302f-ae97-445e-a100-2e593704621f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:52.641500 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a302f-ae97-445e-a100-2e593704621f admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:52.642234 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a302f-ae97-445e-a100-2e593704621f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:52.643872 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a302f-ae97-445e-a100-2e593704621f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:52.659350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1404/2810] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:06:52.660265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334186c-1341-4cc2-b6ac-4596dac59334 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:52.674205 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334186c-1341-4cc2-b6ac-4596dac59334 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:52.681269 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e0733-4bc3-4ab7-aa19-65ba2cc81981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:52.682218 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e0733-4bc3-4ab7-aa19-65ba2cc81981 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:52.682508 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e0733-4bc3-4ab7-aa19-65ba2cc81981 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:52.682774 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e0733-4bc3-4ab7-aa19-65ba2cc81981 admin admin] PATH_INFO: `/v3/projects/297c21f1e672477391af8b74b9cb5ba7/users/73852b44f9454d9ea44bb65e79e3eabb/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:52.691021 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e0733-4bc3-4ab7-aa19-65ba2cc81981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=297c21f1e672477391af8b74b9cb5ba7, user_id=73852b44f9454d9ea44bb65e79e3eabb, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:52.694082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e0733-4bc3-4ab7-aa19-65ba2cc81981 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:52.708248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1407/2811] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:06:52 2022] PUT /identity/v3/projects/297c21f1e672477391af8b74b9cb5ba7/users/73852b44f9454d9ea44bb65e79e3eabb/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:06:55.666834 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d212e85-52df-4206-aebb-6900d4f439e2 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:55.667387 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d212e85-52df-4206-aebb-6900d4f439e2 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:55.667823 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d212e85-52df-4206-aebb-6900d4f439e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:55.695472 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-5d212e85-52df-4206-aebb-6900d4f439e2 None None] MFA Rules not processed for user `6c571f8eb3fc4943b2316de141d624c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:55.696771 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5d212e85-52df-4206-aebb-6900d4f439e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:55.814396 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1405/2812] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:56.429545 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e0733-4bc3-4ab7-aa19-65ba2cc81981 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:56.433975 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-602e0733-4bc3-4ab7-aa19-65ba2cc81981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:56.539266 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e0733-4bc3-4ab7-aa19-65ba2cc81981 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:56.546385 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf5ddb-d15c-45e5-b78e-eea0e084a29b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:56.547118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5ddb-d15c-45e5-b78e-eea0e084a29b service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:56.547405 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5ddb-d15c-45e5-b78e-eea0e084a29b service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:56.548498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5ddb-d15c-45e5-b78e-eea0e084a29b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:56.550902 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1ccf5ddb-d15c-45e5-b78e-eea0e084a29b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:56.565377 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf5ddb-d15c-45e5-b78e-eea0e084a29b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:56.567101 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf5ddb-d15c-45e5-b78e-eea0e084a29b service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:56.577689 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1408/2813] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:06:58.868550 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951af7d-4d8c-4f29-8ebc-c4eb30e99847 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:58.869031 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951af7d-4d8c-4f29-8ebc-c4eb30e99847 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:58.869130 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951af7d-4d8c-4f29-8ebc-c4eb30e99847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:58.916595 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-4951af7d-4d8c-4f29-8ebc-c4eb30e99847 None None] MFA Rules not processed for user `73852b44f9454d9ea44bb65e79e3eabb`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:58.918009 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4951af7d-4d8c-4f29-8ebc-c4eb30e99847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:59.043124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1406/2814] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:06:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:06:59.058972 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf5ddb-d15c-45e5-b78e-eea0e084a29b service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:59.061315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1ccf5ddb-d15c-45e5-b78e-eea0e084a29b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:59.198811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf5ddb-d15c-45e5-b78e-eea0e084a29b service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:59.209670 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69271e0-6cab-4a5f-a419-bc94604f4507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:59.210014 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69271e0-6cab-4a5f-a419-bc94604f4507 service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:59.210944 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69271e0-6cab-4a5f-a419-bc94604f4507 service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:59.211298 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69271e0-6cab-4a5f-a419-bc94604f4507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:59.318081 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69271e0-6cab-4a5f-a419-bc94604f4507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:59.321034 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69271e0-6cab-4a5f-a419-bc94604f4507 service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:59.334385 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1409/2815] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:07:00.691783 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94503-b01e-4623-8c62-fed752bb134e None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:07:00.692275 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94503-b01e-4623-8c62-fed752bb134e None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:07:00.692380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94503-b01e-4623-8c62-fed752bb134e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:07:00.715617 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-e8d94503-b01e-4623-8c62-fed752bb134e None None] MFA Rules not processed for user `39f0c145873843fa9cb970bba426cbdf`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:07:00.717321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e8d94503-b01e-4623-8c62-fed752bb134e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:07:00.726733 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1407/2816] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:07:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:07:00.998860 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da49c3-ae14-47a6-8438-99a16ee68aca None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:07:00.999770 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da49c3-ae14-47a6-8438-99a16ee68aca None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:07:01.000350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da49c3-ae14-47a6-8438-99a16ee68aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:07:01.022787 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-31da49c3-ae14-47a6-8438-99a16ee68aca None None] MFA Rules not processed for user `fef95ce95d4447a58063233a549adfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:07:01.024530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-31da49c3-ae14-47a6-8438-99a16ee68aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:07:01.111072 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1410/2817] 10.222.0.90 () {58 vars in 967 bytes} [Wed Nov 2 13:07:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:07:01.124723 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d94503-b01e-4623-8c62-fed752bb134e None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:07:01.126273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e8d94503-b01e-4623-8c62-fed752bb134e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:07:01.218683 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d94503-b01e-4623-8c62-fed752bb134e None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:07:01.225939 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ffb77-c599-440d-b82f-0cbde6e2c656 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baece5d60fe6407989b460fc6b747f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:07:01.226943 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ffb77-c599-440d-b82f-0cbde6e2c656 service swift] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:07:01.227487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ffb77-c599-440d-b82f-0cbde6e2c656 service swift] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:07:01.227839 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ffb77-c599-440d-b82f-0cbde6e2c656 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:07:01.239080 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ffb77-c599-440d-b82f-0cbde6e2c656 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:07:01.241029 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ffb77-c599-440d-b82f-0cbde6e2c656 service swift] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:07:01.251295 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1408/2818] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Nov 2 13:07:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:07:08.786823 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da49c3-ae14-47a6-8438-99a16ee68aca None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:07:08.789158 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-31da49c3-ae14-47a6-8438-99a16ee68aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:07:08.906023 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da49c3-ae14-47a6-8438-99a16ee68aca None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:07:08.911170 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cabd5-5523-4643-aedd-e451359a1422 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:07:08.911917 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cabd5-5523-4643-aedd-e451359a1422 service placement] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:07:08.912292 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cabd5-5523-4643-aedd-e451359a1422 service placement] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:07:08.912637 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cabd5-5523-4643-aedd-e451359a1422 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:07:08.914596 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-0e7cabd5-5523-4643-aedd-e451359a1422 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:07:08.928165 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cabd5-5523-4643-aedd-e451359a1422 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:07:08.929981 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cabd5-5523-4643-aedd-e451359a1422 service placement] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:07:08.941362 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1411/2819] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:07:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:07:09.070537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ffb77-c599-440d-b82f-0cbde6e2c656 service swift] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:07:09.073141 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-577ffb77-c599-440d-b82f-0cbde6e2c656 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:07:09.146575 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ffb77-c599-440d-b82f-0cbde6e2c656 service swift] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:07:09.151859 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f60559-b877-44d6-9f2c-f08c1d8cc11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:07:09.152790 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f60559-b877-44d6-9f2c-f08c1d8cc11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:07:09.153073 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f60559-b877-44d6-9f2c-f08c1d8cc11a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:07:09.153345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f60559-b877-44d6-9f2c-f08c1d8cc11a admin admin] PATH_INFO: `/v3/users/68c52946945e41e8910c7179b03af2b6` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:07:09.154569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f60559-b877-44d6-9f2c-f08c1d8cc11a admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c52946945e41e8910c7179b03af2b6)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:07:09.156540 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f60559-b877-44d6-9f2c-f08c1d8cc11a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:07:09.206802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e4f60559-b877-44d6-9f2c-f08c1d8cc11a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c52946945e41e8910c7179b03af2b6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:09.207493 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e4f60559-b877-44d6-9f2c-f08c1d8cc11a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c52946945e41e8910c7179b03af2b6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:09.221792 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e4f60559-b877-44d6-9f2c-f08c1d8cc11a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c52946945e41e8910c7179b03af2b6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:09.222625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e4f60559-b877-44d6-9f2c-f08c1d8cc11a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c52946945e41e8910c7179b03af2b6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:09.231183 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-e4f60559-b877-44d6-9f2c-f08c1d8cc11a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c52946945e41e8910c7179b03af2b6'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:09.245153 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1409/2820] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:07:09 2022] DELETE /identity/v3/users/68c52946945e41e8910c7179b03af2b6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:07:09.428173 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cabd5-5523-4643-aedd-e451359a1422 service placement] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:07:09.441552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cabd5-5523-4643-aedd-e451359a1422 service placement] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:07:09.506716 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:07:09.507584 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:07:09.507859 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:07:09.508473 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2 admin admin] PATH_INFO: `/v3/projects/5716ca4d4fc14873bdb6a99cecc9ed64` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:07:09.509732 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5716ca4d4fc14873bdb6a99cecc9ed64)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:07:09.511776 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:07:09.567543 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5716ca4d4fc14873bdb6a99cecc9ed64', 'request_id': 'req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:09.576054 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5716ca4d4fc14873bdb6a99cecc9ed64', 'request_id': 'req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:09.583908 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5716ca4d4fc14873bdb6a99cecc9ed64', 'request_id': 'req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:09.595560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2 admin admin] The token cache is being invalidate because project 5716ca4d4fc14873bdb6a99cecc9ed64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:07:09.595847 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:09.596577 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:09.598047 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1412/2821] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:07:09 2022] DELETE /identity/v3/projects/5716ca4d4fc14873bdb6a99cecc9ed64 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:07:09.602181 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f60559-b877-44d6-9f2c-f08c1d8cc11a admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:07:09.603699 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e4f60559-b877-44d6-9f2c-f08c1d8cc11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:07:09.617782 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f60559-b877-44d6-9f2c-f08c1d8cc11a admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:07:09.680798 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79b915-b9fe-4e95-8590-1380904e0fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:07:09.681690 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79b915-b9fe-4e95-8590-1380904e0fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:07:09.682017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79b915-b9fe-4e95-8590-1380904e0fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:07:09.682231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79b915-b9fe-4e95-8590-1380904e0fcf admin admin] PATH_INFO: `/v3/users/8f6ea06b452d4f85829008d7fc3ea858` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:07:09.683521 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79b915-b9fe-4e95-8590-1380904e0fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6ea06b452d4f85829008d7fc3ea858)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:07:09.685487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79b915-b9fe-4e95-8590-1380904e0fcf admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:07:09.734896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1e79b915-b9fe-4e95-8590-1380904e0fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6ea06b452d4f85829008d7fc3ea858'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:09.735654 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1e79b915-b9fe-4e95-8590-1380904e0fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6ea06b452d4f85829008d7fc3ea858'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:09.747202 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1e79b915-b9fe-4e95-8590-1380904e0fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6ea06b452d4f85829008d7fc3ea858'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:09.747849 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1e79b915-b9fe-4e95-8590-1380904e0fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6ea06b452d4f85829008d7fc3ea858'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:09.756045 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-1e79b915-b9fe-4e95-8590-1380904e0fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6ea06b452d4f85829008d7fc3ea858'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:09.768224 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1410/2822] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:07:09 2022] DELETE /identity/v3/users/8f6ea06b452d4f85829008d7fc3ea858 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:07:09.963778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:07:09.965292 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:07:09.979437 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30c7a6-d77b-47f9-8db6-2c82895dfcc2 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:07:10.050828 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736339db-e20e-43b9-9ef2-a4e9b7761147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:07:10.051930 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736339db-e20e-43b9-9ef2-a4e9b7761147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:07:10.052221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736339db-e20e-43b9-9ef2-a4e9b7761147 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:07:10.052519 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736339db-e20e-43b9-9ef2-a4e9b7761147 admin admin] PATH_INFO: `/v3/projects/f43c077d00bf496ba3a6d9df1400e35e` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:07:10.054069 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736339db-e20e-43b9-9ef2-a4e9b7761147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43c077d00bf496ba3a6d9df1400e35e)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:07:10.056632 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736339db-e20e-43b9-9ef2-a4e9b7761147 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:07:10.110506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-736339db-e20e-43b9-9ef2-a4e9b7761147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43c077d00bf496ba3a6d9df1400e35e', 'request_id': 'req-736339db-e20e-43b9-9ef2-a4e9b7761147'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:10.119446 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-736339db-e20e-43b9-9ef2-a4e9b7761147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43c077d00bf496ba3a6d9df1400e35e', 'request_id': 'req-736339db-e20e-43b9-9ef2-a4e9b7761147'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:10.126308 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-736339db-e20e-43b9-9ef2-a4e9b7761147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43c077d00bf496ba3a6d9df1400e35e', 'request_id': 'req-736339db-e20e-43b9-9ef2-a4e9b7761147'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:10.140999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-736339db-e20e-43b9-9ef2-a4e9b7761147 admin admin] The token cache is being invalidate because project f43c077d00bf496ba3a6d9df1400e35e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:07:10.140999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-736339db-e20e-43b9-9ef2-a4e9b7761147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:10.142825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-736339db-e20e-43b9-9ef2-a4e9b7761147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:07:10.144651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1413/2823] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:07:09 2022] DELETE /identity/v3/projects/f43c077d00bf496ba3a6d9df1400e35e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:07:42.910664 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79b915-b9fe-4e95-8590-1380904e0fcf admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:07:42.912754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-1e79b915-b9fe-4e95-8590-1380904e0fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:07:42.971260 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79b915-b9fe-4e95-8590-1380904e0fcf admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:07:43.028125 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9290e43-22b0-4357-9200-04e1843cd8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:07:43.029128 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9290e43-22b0-4357-9200-04e1843cd8ad service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:07:43.029571 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9290e43-22b0-4357-9200-04e1843cd8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:07:43.030015 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9290e43-22b0-4357-9200-04e1843cd8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:07:43.033304 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a9290e43-22b0-4357-9200-04e1843cd8ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:07:43.117577 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9290e43-22b0-4357-9200-04e1843cd8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:07:43.118922 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9290e43-22b0-4357-9200-04e1843cd8ad service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:07:43.129808 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1411/2824] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:07:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:08:39.477038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736339db-e20e-43b9-9ef2-a4e9b7761147 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:39.479347 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-736339db-e20e-43b9-9ef2-a4e9b7761147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:39.558072 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736339db-e20e-43b9-9ef2-a4e9b7761147 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:39.565138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c0fed-2b85-44c4-8fec-b11276555b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:39.565813 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c0fed-2b85-44c4-8fec-b11276555b50 service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:39.566260 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c0fed-2b85-44c4-8fec-b11276555b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:39.566567 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c0fed-2b85-44c4-8fec-b11276555b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:39.569297 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-3e2c0fed-2b85-44c4-8fec-b11276555b50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:39.662590 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c0fed-2b85-44c4-8fec-b11276555b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:39.663945 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c0fed-2b85-44c4-8fec-b11276555b50 service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:39.685316 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1414/2825] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:08:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:08:41.109905 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9290e43-22b0-4357-9200-04e1843cd8ad service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:41.111535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a9290e43-22b0-4357-9200-04e1843cd8ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:41.122667 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9290e43-22b0-4357-9200-04e1843cd8ad service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:41.126569 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03424ab3-83ea-4fab-92de-5af11657cd52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:41.127222 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03424ab3-83ea-4fab-92de-5af11657cd52 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:41.127506 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03424ab3-83ea-4fab-92de-5af11657cd52 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:41.127773 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03424ab3-83ea-4fab-92de-5af11657cd52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:41.129746 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-03424ab3-83ea-4fab-92de-5af11657cd52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:41.143749 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03424ab3-83ea-4fab-92de-5af11657cd52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:41.145286 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03424ab3-83ea-4fab-92de-5af11657cd52 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:41.156177 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1412/2826] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:08:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:08:42.803492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c0fed-2b85-44c4-8fec-b11276555b50 service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:42.805094 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-3e2c0fed-2b85-44c4-8fec-b11276555b50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:42.820294 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c0fed-2b85-44c4-8fec-b11276555b50 service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:42.827438 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dd647-cb3d-46b5-ade9-c753358c39a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:42.828500 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dd647-cb3d-46b5-ade9-c753358c39a9 service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:42.828952 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dd647-cb3d-46b5-ade9-c753358c39a9 service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:42.829534 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dd647-cb3d-46b5-ade9-c753358c39a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:42.831757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-503dd647-cb3d-46b5-ade9-c753358c39a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:42.848856 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503dd647-cb3d-46b5-ade9-c753358c39a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:42.850510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503dd647-cb3d-46b5-ade9-c753358c39a9 service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:42.862147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1415/2827] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:08:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:08:52.730683 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a426a-3490-4226-8760-64972b1a32bf None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:52.731314 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a426a-3490-4226-8760-64972b1a32bf None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:52.731604 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a426a-3490-4226-8760-64972b1a32bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:52.750218 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-fb7a426a-3490-4226-8760-64972b1a32bf None None] MFA Rules not processed for user `6c571f8eb3fc4943b2316de141d624c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:08:52.751441 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-fb7a426a-3490-4226-8760-64972b1a32bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:52.815367 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1413/2828] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:08:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:08:55.394557 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dd647-cb3d-46b5-ade9-c753358c39a9 service nova] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:55.405368 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dd647-cb3d-46b5-ade9-c753358c39a9 service nova] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:55.409480 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cd394-10b3-4f94-af5c-bfabcc917018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:55.410135 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cd394-10b3-4f94-af5c-bfabcc917018 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:55.410447 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cd394-10b3-4f94-af5c-bfabcc917018 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:55.410682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cd394-10b3-4f94-af5c-bfabcc917018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:55.412812 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e62cd394-10b3-4f94-af5c-bfabcc917018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:55.423940 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cd394-10b3-4f94-af5c-bfabcc917018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:55.425514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cd394-10b3-4f94-af5c-bfabcc917018 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:55.434494 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1416/2829] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:08:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:09:02.554041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a426a-3490-4226-8760-64972b1a32bf None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:09:02.555554 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-fb7a426a-3490-4226-8760-64972b1a32bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:09:02.577281 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a426a-3490-4226-8760-64972b1a32bf None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:09:02.583941 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce7026-3c38-4d47-8e81-c5a39cfd6196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:09:02.584657 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce7026-3c38-4d47-8e81-c5a39cfd6196 service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:09:02.584935 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce7026-3c38-4d47-8e81-c5a39cfd6196 service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:09:02.585219 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce7026-3c38-4d47-8e81-c5a39cfd6196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:09:02.587170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-d2ce7026-3c38-4d47-8e81-c5a39cfd6196 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:09:02.601276 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce7026-3c38-4d47-8e81-c5a39cfd6196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:09:02.603040 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce7026-3c38-4d47-8e81-c5a39cfd6196 service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:09:02.617362 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1414/2830] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:09:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:10:21.947839 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cd394-10b3-4f94-af5c-bfabcc917018 service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:10:21.962918 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cd394-10b3-4f94-af5c-bfabcc917018 service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:10:21.969907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdd0ec-ea08-4d5a-aacc-4fe9b887a82d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:10:21.970574 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd0ec-ea08-4d5a-aacc-4fe9b887a82d service nova] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:10:21.970860 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd0ec-ea08-4d5a-aacc-4fe9b887a82d service nova] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:10:21.971127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd0ec-ea08-4d5a-aacc-4fe9b887a82d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:10:21.973163 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ddfdd0ec-ea08-4d5a-aacc-4fe9b887a82d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:10:21.984552 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdd0ec-ea08-4d5a-aacc-4fe9b887a82d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:10:21.986310 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdd0ec-ea08-4d5a-aacc-4fe9b887a82d service nova] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:10:21.996593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1417/2831] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:10:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:10:25.649205 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce7026-3c38-4d47-8e81-c5a39cfd6196 service nova] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:10:25.665809 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce7026-3c38-4d47-8e81-c5a39cfd6196 service nova] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:10:25.670724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808c30e-9211-45d7-891b-b6e09293e378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:10:25.671464 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808c30e-9211-45d7-891b-b6e09293e378 service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:10:25.671937 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808c30e-9211-45d7-891b-b6e09293e378 service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:10:25.672454 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808c30e-9211-45d7-891b-b6e09293e378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:10:25.675325 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e808c30e-9211-45d7-891b-b6e09293e378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:10:25.687884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808c30e-9211-45d7-891b-b6e09293e378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:10:25.689637 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808c30e-9211-45d7-891b-b6e09293e378 service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:10:25.698967 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1415/2832] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:10:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:10:25.804437 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdd0ec-ea08-4d5a-aacc-4fe9b887a82d service nova] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:10:25.805727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-ddfdd0ec-ea08-4d5a-aacc-4fe9b887a82d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:10:25.819585 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdd0ec-ea08-4d5a-aacc-4fe9b887a82d service nova] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:10:25.823191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281d0cf-8dc8-460c-bded-a04e4450ba4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:10:25.823863 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281d0cf-8dc8-460c-bded-a04e4450ba4e service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:10:25.824140 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281d0cf-8dc8-460c-bded-a04e4450ba4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:10:25.824434 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281d0cf-8dc8-460c-bded-a04e4450ba4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:10:25.826344 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4281d0cf-8dc8-460c-bded-a04e4450ba4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:10:25.845073 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281d0cf-8dc8-460c-bded-a04e4450ba4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:10:25.846524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281d0cf-8dc8-460c-bded-a04e4450ba4e service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:10:25.858727 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1418/2833] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:10:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:10:25.927299 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808c30e-9211-45d7-891b-b6e09293e378 service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:10:25.928938 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-e808c30e-9211-45d7-891b-b6e09293e378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:10:26.005965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808c30e-9211-45d7-891b-b6e09293e378 service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:10:26.014562 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e06c4-7cc2-45dd-8015-5654be3802d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:10:26.015306 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e06c4-7cc2-45dd-8015-5654be3802d6 service placement] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:10:26.015656 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e06c4-7cc2-45dd-8015-5654be3802d6 service placement] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:10:26.015996 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e06c4-7cc2-45dd-8015-5654be3802d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:10:26.018158 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-548e06c4-7cc2-45dd-8015-5654be3802d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:10:26.032918 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e06c4-7cc2-45dd-8015-5654be3802d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:10:26.034129 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e06c4-7cc2-45dd-8015-5654be3802d6 service placement] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:10:26.045705 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1416/2834] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:10:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:10:35.727437 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91408b-f485-4109-ac12-9d9e8f876696 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:10:35.728111 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91408b-f485-4109-ac12-9d9e8f876696 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:10:35.728111 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91408b-f485-4109-ac12-9d9e8f876696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:10:35.752497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-2a91408b-f485-4109-ac12-9d9e8f876696 None None] MFA Rules not processed for user `6c571f8eb3fc4943b2316de141d624c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:10:35.754246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-2a91408b-f485-4109-ac12-9d9e8f876696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:10:35.763141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1419/2835] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:10:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:11:27.210034 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e06c4-7cc2-45dd-8015-5654be3802d6 service placement] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:27.211649 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-548e06c4-7cc2-45dd-8015-5654be3802d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:27.225443 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e06c4-7cc2-45dd-8015-5654be3802d6 service placement] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:27.232056 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83afe66-cd0f-4860-ae47-1188e05e9a08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:27.232710 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83afe66-cd0f-4860-ae47-1188e05e9a08 service placement] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:27.233014 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83afe66-cd0f-4860-ae47-1188e05e9a08 service placement] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:27.233280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83afe66-cd0f-4860-ae47-1188e05e9a08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:27.235187 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-d83afe66-cd0f-4860-ae47-1188e05e9a08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:27.247561 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83afe66-cd0f-4860-ae47-1188e05e9a08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:27.249192 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83afe66-cd0f-4860-ae47-1188e05e9a08 service placement] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:27.260091 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1417/2836] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:11:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:21.613381 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91408b-f485-4109-ac12-9d9e8f876696 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:21.626519 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91408b-f485-4109-ac12-9d9e8f876696 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:21.631082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d32b0a-6ee0-4858-b04e-2d9f60826200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:21.631760 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d32b0a-6ee0-4858-b04e-2d9f60826200 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:21.632068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d32b0a-6ee0-4858-b04e-2d9f60826200 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:21.632381 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d32b0a-6ee0-4858-b04e-2d9f60826200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:21.634245 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-30d32b0a-6ee0-4858-b04e-2d9f60826200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:21.697701 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d32b0a-6ee0-4858-b04e-2d9f60826200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:21.699295 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d32b0a-6ee0-4858-b04e-2d9f60826200 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:21.708658 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1420/2837] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:23.146048 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83afe66-cd0f-4860-ae47-1188e05e9a08 service placement] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:23.160004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83afe66-cd0f-4860-ae47-1188e05e9a08 service placement] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:23.169588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97fbee-2551-4699-a8e0-ed39a7ed150d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcda58f298444eebf4f08ce01deffc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:23.170872 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97fbee-2551-4699-a8e0-ed39a7ed150d service nova] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:23.171369 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97fbee-2551-4699-a8e0-ed39a7ed150d service nova] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:23.171844 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97fbee-2551-4699-a8e0-ed39a7ed150d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:23.174509 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-af97fbee-2551-4699-a8e0-ed39a7ed150d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:23.188770 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97fbee-2551-4699-a8e0-ed39a7ed150d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:23.190311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97fbee-2551-4699-a8e0-ed39a7ed150d service nova] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:23.203022 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1418/2838] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:26.689896 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d32b0a-6ee0-4858-b04e-2d9f60826200 service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:26.699042 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d32b0a-6ee0-4858-b04e-2d9f60826200 service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:26.704375 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919b07f-dfe2-40bb-93f2-79c8fdadc9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:26.705122 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919b07f-dfe2-40bb-93f2-79c8fdadc9bc service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:26.705470 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919b07f-dfe2-40bb-93f2-79c8fdadc9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:26.705874 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919b07f-dfe2-40bb-93f2-79c8fdadc9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:26.707853 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b919b07f-dfe2-40bb-93f2-79c8fdadc9bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:26.776960 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919b07f-dfe2-40bb-93f2-79c8fdadc9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:26.778419 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919b07f-dfe2-40bb-93f2-79c8fdadc9bc service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:26.789919 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1421/2839] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:27.269112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97fbee-2551-4699-a8e0-ed39a7ed150d service nova] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:27.279440 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97fbee-2551-4699-a8e0-ed39a7ed150d service nova] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:27.283258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddedcf2-fd3d-40c8-93d5-9eafd28c7eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:27.283904 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddedcf2-fd3d-40c8-93d5-9eafd28c7eeb service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:27.284161 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddedcf2-fd3d-40c8-93d5-9eafd28c7eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:27.284487 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddedcf2-fd3d-40c8-93d5-9eafd28c7eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:27.286315 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-8ddedcf2-fd3d-40c8-93d5-9eafd28c7eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:27.298467 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddedcf2-fd3d-40c8-93d5-9eafd28c7eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:27.299933 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddedcf2-fd3d-40c8-93d5-9eafd28c7eeb service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:27.310029 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1419/2840] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:30.546686 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919b07f-dfe2-40bb-93f2-79c8fdadc9bc service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:30.558729 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919b07f-dfe2-40bb-93f2-79c8fdadc9bc service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:30.565571 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2adb2e-017e-4fdd-8737-cb80df42d1be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:30.566486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2adb2e-017e-4fdd-8737-cb80df42d1be service placement] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:30.567164 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2adb2e-017e-4fdd-8737-cb80df42d1be service placement] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:30.568124 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2adb2e-017e-4fdd-8737-cb80df42d1be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:30.570469 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-4c2adb2e-017e-4fdd-8737-cb80df42d1be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:30.584870 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2adb2e-017e-4fdd-8737-cb80df42d1be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:30.586845 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2adb2e-017e-4fdd-8737-cb80df42d1be service placement] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:30.604931 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1422/2841] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:30.627339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddedcf2-fd3d-40c8-93d5-9eafd28c7eeb service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:30.629227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-8ddedcf2-fd3d-40c8-93d5-9eafd28c7eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:30.665693 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddedcf2-fd3d-40c8-93d5-9eafd28c7eeb service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:30.670465 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6dd71-1671-4540-8665-9f1233bb868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:30.671455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6dd71-1671-4540-8665-9f1233bb868e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:30.671825 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6dd71-1671-4540-8665-9f1233bb868e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:30.672166 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6dd71-1671-4540-8665-9f1233bb868e admin admin] PATH_INFO: `/v3/users/6c571f8eb3fc4943b2316de141d624c8` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:30.673466 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6dd71-1671-4540-8665-9f1233bb868e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c571f8eb3fc4943b2316de141d624c8)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:30.675494 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6dd71-1671-4540-8665-9f1233bb868e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:30.761000 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-abb6dd71-1671-4540-8665-9f1233bb868e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c571f8eb3fc4943b2316de141d624c8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:30.762297 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-abb6dd71-1671-4540-8665-9f1233bb868e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c571f8eb3fc4943b2316de141d624c8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:30.802151 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-abb6dd71-1671-4540-8665-9f1233bb868e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c571f8eb3fc4943b2316de141d624c8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:30.804441 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-abb6dd71-1671-4540-8665-9f1233bb868e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c571f8eb3fc4943b2316de141d624c8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:30.814192 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-abb6dd71-1671-4540-8665-9f1233bb868e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c571f8eb3fc4943b2316de141d624c8'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:30.831305 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1420/2842] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:12:30 2022] DELETE /identity/v3/users/6c571f8eb3fc4943b2316de141d624c8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:31.121355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2adb2e-017e-4fdd-8737-cb80df42d1be service placement] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:31.158506 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2adb2e-017e-4fdd-8737-cb80df42d1be service placement] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:31.210917 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6dd71-1671-4540-8665-9f1233bb868e admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:31.212508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-abb6dd71-1671-4540-8665-9f1233bb868e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:31.288783 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2a355-1371-4c79-9491-5818b76d8204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:31.289983 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2a355-1371-4c79-9491-5818b76d8204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:31.290440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2a355-1371-4c79-9491-5818b76d8204 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:31.290850 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2a355-1371-4c79-9491-5818b76d8204 admin admin] PATH_INFO: `/v3/projects/19aa22fb93224586a50c7447a5310ecd` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:31.292371 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2a355-1371-4c79-9491-5818b76d8204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19aa22fb93224586a50c7447a5310ecd)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:31.294694 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2a355-1371-4c79-9491-5818b76d8204 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:31.341418 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6dd71-1671-4540-8665-9f1233bb868e admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:31.347642 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc9622-c1cf-43e3-a35b-a733537e9d2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:31.348715 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc9622-c1cf-43e3-a35b-a733537e9d2c service placement] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:31.349538 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc9622-c1cf-43e3-a35b-a733537e9d2c service placement] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:31.350031 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc9622-c1cf-43e3-a35b-a733537e9d2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:31.352043 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-79cc9622-c1cf-43e3-a35b-a733537e9d2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:31.367434 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc9622-c1cf-43e3-a35b-a733537e9d2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:31.369274 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc9622-c1cf-43e3-a35b-a733537e9d2c service placement] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:31.381373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1421/2843] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:12:31.386820 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-75a2a355-1371-4c79-9491-5818b76d8204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19aa22fb93224586a50c7447a5310ecd', 'request_id': 'req-75a2a355-1371-4c79-9491-5818b76d8204'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:31.398257 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-75a2a355-1371-4c79-9491-5818b76d8204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19aa22fb93224586a50c7447a5310ecd', 'request_id': 'req-75a2a355-1371-4c79-9491-5818b76d8204'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:31.405361 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-75a2a355-1371-4c79-9491-5818b76d8204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19aa22fb93224586a50c7447a5310ecd', 'request_id': 'req-75a2a355-1371-4c79-9491-5818b76d8204'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:31.416113 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-75a2a355-1371-4c79-9491-5818b76d8204 admin admin] The token cache is being invalidate because project 19aa22fb93224586a50c7447a5310ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:12:31.416632 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-75a2a355-1371-4c79-9491-5818b76d8204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:31.417285 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-75a2a355-1371-4c79-9491-5818b76d8204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:31.419094 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1423/2844] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:12:31 2022] DELETE /identity/v3/projects/19aa22fb93224586a50c7447a5310ecd => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:31.424121 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2d6eb-77a6-41f7-9095-40cb2b8d447b None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:31.424647 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2d6eb-77a6-41f7-9095-40cb2b8d447b None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:31.424947 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2d6eb-77a6-41f7-9095-40cb2b8d447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:31.449054 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-43d2d6eb-77a6-41f7-9095-40cb2b8d447b None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:31.450256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-43d2d6eb-77a6-41f7-9095-40cb2b8d447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:31.514413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1422/2845] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:12:31.522549 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307fe0f-2617-49a1-89e8-444ef6e43777 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:31.522836 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307fe0f-2617-49a1-89e8-444ef6e43777 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:31.523141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307fe0f-2617-49a1-89e8-444ef6e43777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:31.541668 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-d307fe0f-2617-49a1-89e8-444ef6e43777 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:31.542977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-d307fe0f-2617-49a1-89e8-444ef6e43777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:31.551670 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1424/2846] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:31.556685 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2d6eb-77a6-41f7-9095-40cb2b8d447b None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:31.566682 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2d6eb-77a6-41f7-9095-40cb2b8d447b None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:31.571754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56734d-c87f-46a2-af7f-eb0972357921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:31.572456 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56734d-c87f-46a2-af7f-eb0972357921 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:31.572744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56734d-c87f-46a2-af7f-eb0972357921 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:31.573003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56734d-c87f-46a2-af7f-eb0972357921 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:31.573725 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56734d-c87f-46a2-af7f-eb0972357921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:12:31.574026 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56734d-c87f-46a2-af7f-eb0972357921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:31.575619 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56734d-c87f-46a2-af7f-eb0972357921 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:31.587802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1423/2847] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:12:31.592718 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307fe0f-2617-49a1-89e8-444ef6e43777 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:31.602687 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307fe0f-2617-49a1-89e8-444ef6e43777 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:31.607741 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c2310-b310-4bae-a4c1-44f8feadb207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:31.608464 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2310-b310-4bae-a4c1-44f8feadb207 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:31.608742 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2310-b310-4bae-a4c1-44f8feadb207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:31.609010 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2310-b310-4bae-a4c1-44f8feadb207 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:31.609717 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c2310-b310-4bae-a4c1-44f8feadb207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:31.611654 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c2310-b310-4bae-a4c1-44f8feadb207 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:31.648503 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1425/2848] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:12:31 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:12:31.652525 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56734d-c87f-46a2-af7f-eb0972357921 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:31.662917 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56734d-c87f-46a2-af7f-eb0972357921 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:31.720648 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07188e00-8201-444d-9d53-28097d1acc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:31.721330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07188e00-8201-444d-9d53-28097d1acc18 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:31.721608 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07188e00-8201-444d-9d53-28097d1acc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:31.721876 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07188e00-8201-444d-9d53-28097d1acc18 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:31.722583 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07188e00-8201-444d-9d53-28097d1acc18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:31.724540 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07188e00-8201-444d-9d53-28097d1acc18 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:31.749385 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1424/2849] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:12:31 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:12:31.750684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c2310-b310-4bae-a4c1-44f8feadb207 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:31.761809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c2310-b310-4bae-a4c1-44f8feadb207 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:31.767143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345aacd-6e7b-45ab-a1fc-47c1c30f8011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:31.767819 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345aacd-6e7b-45ab-a1fc-47c1c30f8011 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:31.768097 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345aacd-6e7b-45ab-a1fc-47c1c30f8011 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:31.768411 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345aacd-6e7b-45ab-a1fc-47c1c30f8011 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:31.769147 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345aacd-6e7b-45ab-a1fc-47c1c30f8011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:31.770779 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345aacd-6e7b-45ab-a1fc-47c1c30f8011 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:31.781503 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1426/2850] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:12:31.785638 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07188e00-8201-444d-9d53-28097d1acc18 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:31.796419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07188e00-8201-444d-9d53-28097d1acc18 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:31.801408 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f055ad-30c7-4c99-b0cf-0e45b9e8b625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:31.802131 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f055ad-30c7-4c99-b0cf-0e45b9e8b625 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:31.802420 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f055ad-30c7-4c99-b0cf-0e45b9e8b625 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:31.802658 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f055ad-30c7-4c99-b0cf-0e45b9e8b625 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:31.803382 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f055ad-30c7-4c99-b0cf-0e45b9e8b625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:31.805004 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f055ad-30c7-4c99-b0cf-0e45b9e8b625 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:31.815760 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1425/2851] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:12:31.820052 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345aacd-6e7b-45ab-a1fc-47c1c30f8011 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:31.830370 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345aacd-6e7b-45ab-a1fc-47c1c30f8011 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:31.835721 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3090b6a-de5e-4af6-b653-2922439dfdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:31.836651 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3090b6a-de5e-4af6-b653-2922439dfdd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:31.837176 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3090b6a-de5e-4af6-b653-2922439dfdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:31.837176 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3090b6a-de5e-4af6-b653-2922439dfdd8 admin admin] PATH_INFO: `/v3/projects/f000b8cc9f0344869c62509fde438ed4/users/02172519e08a4f7eb298e65df86069f9/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:31.853053 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3090b6a-de5e-4af6-b653-2922439dfdd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f000b8cc9f0344869c62509fde438ed4, user_id=02172519e08a4f7eb298e65df86069f9, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:31.855686 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3090b6a-de5e-4af6-b653-2922439dfdd8 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:31.869965 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1427/2852] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:12:31 2022] PUT /identity/v3/projects/f000b8cc9f0344869c62509fde438ed4/users/02172519e08a4f7eb298e65df86069f9/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:12:31.881817 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af1405-335e-4097-ac28-ebe088443908 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:31.882081 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af1405-335e-4097-ac28-ebe088443908 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:31.882388 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af1405-335e-4097-ac28-ebe088443908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:31.908455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-19af1405-335e-4097-ac28-ebe088443908 None None] MFA Rules not processed for user `02172519e08a4f7eb298e65df86069f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:31.909597 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-19af1405-335e-4097-ac28-ebe088443908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:31.976331 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1426/2853] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:12:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:31.981139 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3090b6a-de5e-4af6-b653-2922439dfdd8 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:32.043448 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3090b6a-de5e-4af6-b653-2922439dfdd8 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:32.048139 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496dd8d-c400-410a-ae61-0d568f7af99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:32.048824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496dd8d-c400-410a-ae61-0d568f7af99c admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:32.049102 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496dd8d-c400-410a-ae61-0d568f7af99c admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:32.049367 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496dd8d-c400-410a-ae61-0d568f7af99c admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:32.050068 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496dd8d-c400-410a-ae61-0d568f7af99c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:32.051998 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496dd8d-c400-410a-ae61-0d568f7af99c admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:32.078117 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1428/2854] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:12:31 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:12:32.082239 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af1405-335e-4097-ac28-ebe088443908 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:32.093083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af1405-335e-4097-ac28-ebe088443908 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:32.150052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972a001-f6b1-455b-b688-a9505724dee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:32.150718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972a001-f6b1-455b-b688-a9505724dee8 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:32.151017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972a001-f6b1-455b-b688-a9505724dee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:32.151273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972a001-f6b1-455b-b688-a9505724dee8 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:32.151980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972a001-f6b1-455b-b688-a9505724dee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:32.153965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972a001-f6b1-455b-b688-a9505724dee8 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:32.179470 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1427/2855] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:12:32 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:12:32.180755 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496dd8d-c400-410a-ae61-0d568f7af99c admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:32.192192 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496dd8d-c400-410a-ae61-0d568f7af99c admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:32.197388 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9ddea-0013-4e8d-93a4-95afa2a7ca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:32.198060 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9ddea-0013-4e8d-93a4-95afa2a7ca38 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:32.198780 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9ddea-0013-4e8d-93a4-95afa2a7ca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:32.199051 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9ddea-0013-4e8d-93a4-95afa2a7ca38 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:32.199794 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9ddea-0013-4e8d-93a4-95afa2a7ca38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:32.201419 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9ddea-0013-4e8d-93a4-95afa2a7ca38 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:32.212538 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1429/2856] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:12:32.216953 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972a001-f6b1-455b-b688-a9505724dee8 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:32.228695 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972a001-f6b1-455b-b688-a9505724dee8 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:32.235150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd0547-642a-4bee-894f-99ae82db314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:32.236073 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd0547-642a-4bee-894f-99ae82db314e admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:32.236531 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd0547-642a-4bee-894f-99ae82db314e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:32.236804 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd0547-642a-4bee-894f-99ae82db314e admin admin] PATH_INFO: `/v3/projects/1754aa3c86f04357bd40cf5099e01d17/users/772f8bb8f0ed4630b556f961dfca3751/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:32.253978 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd0547-642a-4bee-894f-99ae82db314e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1754aa3c86f04357bd40cf5099e01d17, user_id=772f8bb8f0ed4630b556f961dfca3751, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:32.256751 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd0547-642a-4bee-894f-99ae82db314e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:32.272818 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1428/2857] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:12:32 2022] PUT /identity/v3/projects/1754aa3c86f04357bd40cf5099e01d17/users/772f8bb8f0ed4630b556f961dfca3751/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:32.277015 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9ddea-0013-4e8d-93a4-95afa2a7ca38 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:32.288325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9ddea-0013-4e8d-93a4-95afa2a7ca38 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:32.352670 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6e510-fbe7-4be0-af82-036998ceb847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:32.353416 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6e510-fbe7-4be0-af82-036998ceb847 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:32.353702 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6e510-fbe7-4be0-af82-036998ceb847 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:32.353977 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6e510-fbe7-4be0-af82-036998ceb847 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:32.354745 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6e510-fbe7-4be0-af82-036998ceb847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:32.356744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6e510-fbe7-4be0-af82-036998ceb847 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:32.368251 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1430/2858] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:12:32.372588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd0547-642a-4bee-894f-99ae82db314e admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:32.385574 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd0547-642a-4bee-894f-99ae82db314e admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:32.398952 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20dcea-ad61-4ac1-b324-ff12bbd2999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:32.399988 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20dcea-ad61-4ac1-b324-ff12bbd2999d admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:32.400388 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20dcea-ad61-4ac1-b324-ff12bbd2999d admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:32.400766 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20dcea-ad61-4ac1-b324-ff12bbd2999d admin admin] PATH_INFO: `/v3/projects/1754aa3c86f04357bd40cf5099e01d17/users/772f8bb8f0ed4630b556f961dfca3751/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:32.403109 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20dcea-ad61-4ac1-b324-ff12bbd2999d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1754aa3c86f04357bd40cf5099e01d17, user_id=772f8bb8f0ed4630b556f961dfca3751, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:32.406472 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20dcea-ad61-4ac1-b324-ff12bbd2999d admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:32.418722 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1429/2859] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:12:32 2022] PUT /identity/v3/projects/1754aa3c86f04357bd40cf5099e01d17/users/772f8bb8f0ed4630b556f961dfca3751/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:12:32.429856 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6443d-a335-4e54-be45-1aff31addc10 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:32.430059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6443d-a335-4e54-be45-1aff31addc10 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:32.430309 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6443d-a335-4e54-be45-1aff31addc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:32.460893 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-deb6443d-a335-4e54-be45-1aff31addc10 None None] MFA Rules not processed for user `772f8bb8f0ed4630b556f961dfca3751`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:32.462114 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-deb6443d-a335-4e54-be45-1aff31addc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:32.530848 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1431/2860] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:12:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:32.542337 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20dcea-ad61-4ac1-b324-ff12bbd2999d admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:32.544111 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4a20dcea-ad61-4ac1-b324-ff12bbd2999d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:32.604350 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20dcea-ad61-4ac1-b324-ff12bbd2999d admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:32.608467 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdaf7f-b5be-40fa-a5de-fb0517b93da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:32.609125 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdaf7f-b5be-40fa-a5de-fb0517b93da9 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:32.609404 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdaf7f-b5be-40fa-a5de-fb0517b93da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:32.609679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdaf7f-b5be-40fa-a5de-fb0517b93da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:32.619209 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdaf7f-b5be-40fa-a5de-fb0517b93da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:32.620703 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdaf7f-b5be-40fa-a5de-fb0517b93da9 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:32.630796 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1430/2861] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:32.710210 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6443d-a335-4e54-be45-1aff31addc10 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:32.728486 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6443d-a335-4e54-be45-1aff31addc10 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:32.732925 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948d575-2e56-49e4-8c1c-7531735e4e8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:32.733682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948d575-2e56-49e4-8c1c-7531735e4e8e service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:32.733994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948d575-2e56-49e4-8c1c-7531735e4e8e service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:32.734265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948d575-2e56-49e4-8c1c-7531735e4e8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:32.795782 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948d575-2e56-49e4-8c1c-7531735e4e8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:32.797354 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948d575-2e56-49e4-8c1c-7531735e4e8e service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:32.807129 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1432/2862] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:34.660135 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdaf7f-b5be-40fa-a5de-fb0517b93da9 service cinder] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:34.661991 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-6abdaf7f-b5be-40fa-a5de-fb0517b93da9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:34.731753 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdaf7f-b5be-40fa-a5de-fb0517b93da9 service cinder] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:34.737289 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a73ba3-d227-426e-8e2a-5a8f2330f633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:34.738178 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a73ba3-d227-426e-8e2a-5a8f2330f633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:34.738458 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a73ba3-d227-426e-8e2a-5a8f2330f633 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:34.738809 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a73ba3-d227-426e-8e2a-5a8f2330f633 admin admin] PATH_INFO: `/v3/users/39f0c145873843fa9cb970bba426cbdf` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:34.740377 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a73ba3-d227-426e-8e2a-5a8f2330f633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f0c145873843fa9cb970bba426cbdf)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:34.742330 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a73ba3-d227-426e-8e2a-5a8f2330f633 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:34.794720 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-00a73ba3-d227-426e-8e2a-5a8f2330f633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f0c145873843fa9cb970bba426cbdf'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:34.795441 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-00a73ba3-d227-426e-8e2a-5a8f2330f633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f0c145873843fa9cb970bba426cbdf'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:34.809724 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-00a73ba3-d227-426e-8e2a-5a8f2330f633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f0c145873843fa9cb970bba426cbdf'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:34.810427 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-00a73ba3-d227-426e-8e2a-5a8f2330f633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f0c145873843fa9cb970bba426cbdf'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:34.819965 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-00a73ba3-d227-426e-8e2a-5a8f2330f633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f0c145873843fa9cb970bba426cbdf'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:34.833278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1431/2863] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:12:34 2022] DELETE /identity/v3/users/39f0c145873843fa9cb970bba426cbdf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:35.025589 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948d575-2e56-49e4-8c1c-7531735e4e8e service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:35.037907 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948d575-2e56-49e4-8c1c-7531735e4e8e service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:35.094557 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:35.095341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:35.095619 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:35.095922 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d admin admin] PATH_INFO: `/v3/projects/22ac1778be064017858e588e9567fd27` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:35.097153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ac1778be064017858e588e9567fd27)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:35.099321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:35.161524 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ac1778be064017858e588e9567fd27', 'request_id': 'req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:35.171272 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ac1778be064017858e588e9567fd27', 'request_id': 'req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:35.178172 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ac1778be064017858e588e9567fd27', 'request_id': 'req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:35.188577 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d admin admin] The token cache is being invalidate because project 22ac1778be064017858e588e9567fd27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:12:35.188857 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:35.189595 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:35.191265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1433/2864] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:12:35 2022] DELETE /identity/v3/projects/22ac1778be064017858e588e9567fd27 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:35.195905 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a73ba3-d227-426e-8e2a-5a8f2330f633 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:35.197460 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-00a73ba3-d227-426e-8e2a-5a8f2330f633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:35.211496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a73ba3-d227-426e-8e2a-5a8f2330f633 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:35.274454 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b8ed7-15d4-423d-8966-e60f972cef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:35.275341 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b8ed7-15d4-423d-8966-e60f972cef56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:35.275592 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b8ed7-15d4-423d-8966-e60f972cef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:35.275877 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b8ed7-15d4-423d-8966-e60f972cef56 admin admin] PATH_INFO: `/v3/users/73852b44f9454d9ea44bb65e79e3eabb` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:35.277214 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b8ed7-15d4-423d-8966-e60f972cef56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73852b44f9454d9ea44bb65e79e3eabb)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:35.279137 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b8ed7-15d4-423d-8966-e60f972cef56 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:35.333256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a74b8ed7-15d4-423d-8966-e60f972cef56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73852b44f9454d9ea44bb65e79e3eabb'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:35.333897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a74b8ed7-15d4-423d-8966-e60f972cef56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73852b44f9454d9ea44bb65e79e3eabb'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:35.348546 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a74b8ed7-15d4-423d-8966-e60f972cef56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73852b44f9454d9ea44bb65e79e3eabb'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:35.349267 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a74b8ed7-15d4-423d-8966-e60f972cef56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73852b44f9454d9ea44bb65e79e3eabb'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:35.359701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a74b8ed7-15d4-423d-8966-e60f972cef56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73852b44f9454d9ea44bb65e79e3eabb'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:35.372829 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1432/2865] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:12:35 2022] DELETE /identity/v3/users/73852b44f9454d9ea44bb65e79e3eabb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:35.561156 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:35.562180 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:35.575969 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf722483-e6fe-40d5-9bd8-c38a7bfc579d admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:35.643475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1b8ef-50d9-4f58-ad67-cb169af218aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:35.644406 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1b8ef-50d9-4f58-ad67-cb169af218aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:35.644682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1b8ef-50d9-4f58-ad67-cb169af218aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:35.644953 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1b8ef-50d9-4f58-ad67-cb169af218aa admin admin] PATH_INFO: `/v3/projects/297c21f1e672477391af8b74b9cb5ba7` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:35.646254 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1b8ef-50d9-4f58-ad67-cb169af218aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=297c21f1e672477391af8b74b9cb5ba7)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:35.648318 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1b8ef-50d9-4f58-ad67-cb169af218aa admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:35.697498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8cf1b8ef-50d9-4f58-ad67-cb169af218aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297c21f1e672477391af8b74b9cb5ba7', 'request_id': 'req-8cf1b8ef-50d9-4f58-ad67-cb169af218aa'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:35.706209 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8cf1b8ef-50d9-4f58-ad67-cb169af218aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297c21f1e672477391af8b74b9cb5ba7', 'request_id': 'req-8cf1b8ef-50d9-4f58-ad67-cb169af218aa'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:35.712954 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8cf1b8ef-50d9-4f58-ad67-cb169af218aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297c21f1e672477391af8b74b9cb5ba7', 'request_id': 'req-8cf1b8ef-50d9-4f58-ad67-cb169af218aa'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:35.723763 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8cf1b8ef-50d9-4f58-ad67-cb169af218aa admin admin] The token cache is being invalidate because project 297c21f1e672477391af8b74b9cb5ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:12:35.724164 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8cf1b8ef-50d9-4f58-ad67-cb169af218aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:35.724831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8cf1b8ef-50d9-4f58-ad67-cb169af218aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:35.726462 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1434/2866] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:12:35 2022] DELETE /identity/v3/projects/297c21f1e672477391af8b74b9cb5ba7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:43.963068 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b8ed7-15d4-423d-8966-e60f972cef56 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:43.964805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-a74b8ed7-15d4-423d-8966-e60f972cef56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:43.978515 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b8ed7-15d4-423d-8966-e60f972cef56 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:44.038890 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6210c-7752-4dff-b076-655e72678cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:44.039694 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6210c-7752-4dff-b076-655e72678cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:44.039973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6210c-7752-4dff-b076-655e72678cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:44.040231 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6210c-7752-4dff-b076-655e72678cb4 admin admin] PATH_INFO: `/v3/users/02172519e08a4f7eb298e65df86069f9` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:44.041624 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6210c-7752-4dff-b076-655e72678cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02172519e08a4f7eb298e65df86069f9)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:44.043572 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6210c-7752-4dff-b076-655e72678cb4 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:44.096701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-63f6210c-7752-4dff-b076-655e72678cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02172519e08a4f7eb298e65df86069f9'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:44.097517 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-63f6210c-7752-4dff-b076-655e72678cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02172519e08a4f7eb298e65df86069f9'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:44.109348 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-63f6210c-7752-4dff-b076-655e72678cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02172519e08a4f7eb298e65df86069f9'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:44.110085 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-63f6210c-7752-4dff-b076-655e72678cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02172519e08a4f7eb298e65df86069f9'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:44.120192 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-63f6210c-7752-4dff-b076-655e72678cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02172519e08a4f7eb298e65df86069f9'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:44.133332 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1433/2867] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:12:43 2022] DELETE /identity/v3/users/02172519e08a4f7eb298e65df86069f9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:44.138046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e73f83-a77e-4965-ba87-faa496b46109 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:44.138539 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e73f83-a77e-4965-ba87-faa496b46109 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:44.138639 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e73f83-a77e-4965-ba87-faa496b46109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:44.157832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-61e73f83-a77e-4965-ba87-faa496b46109 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:44.159091 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-61e73f83-a77e-4965-ba87-faa496b46109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:44.234654 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1435/2868] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:44.245496 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6210c-7752-4dff-b076-655e72678cb4 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:44.247058 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-63f6210c-7752-4dff-b076-655e72678cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:44.317703 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6210c-7752-4dff-b076-655e72678cb4 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:44.321802 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f2c1e-6244-456b-91c0-6c5fced353ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:44.322482 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f2c1e-6244-456b-91c0-6c5fced353ee service neutron] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:44.322758 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f2c1e-6244-456b-91c0-6c5fced353ee service neutron] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:44.323032 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f2c1e-6244-456b-91c0-6c5fced353ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:44.333159 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f2c1e-6244-456b-91c0-6c5fced353ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:44.334650 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f2c1e-6244-456b-91c0-6c5fced353ee service neutron] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:44.344603 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1434/2869] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:44.625912 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e73f83-a77e-4965-ba87-faa496b46109 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:44.627760 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-61e73f83-a77e-4965-ba87-faa496b46109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:44.640265 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e73f83-a77e-4965-ba87-faa496b46109 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:44.645904 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:44.647409 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:44.647753 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:44.648168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7 admin admin] PATH_INFO: `/v3/projects/f000b8cc9f0344869c62509fde438ed4` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:44.650268 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f000b8cc9f0344869c62509fde438ed4)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:44.653172 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:44.711683 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f000b8cc9f0344869c62509fde438ed4', 'request_id': 'req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:44.721557 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f000b8cc9f0344869c62509fde438ed4', 'request_id': 'req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:44.728808 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f000b8cc9f0344869c62509fde438ed4', 'request_id': 'req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:44.740066 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7 admin admin] The token cache is being invalidate because project f000b8cc9f0344869c62509fde438ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:12:44.740379 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:44.741071 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:44.742685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1436/2870] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:12:44 2022] DELETE /identity/v3/projects/f000b8cc9f0344869c62509fde438ed4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:44.747011 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f2c1e-6244-456b-91c0-6c5fced353ee service neutron] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:44.757901 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f2c1e-6244-456b-91c0-6c5fced353ee service neutron] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:44.819036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8ce43-4cc8-443f-80a3-dd0c70345c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:44.819974 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8ce43-4cc8-443f-80a3-dd0c70345c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:44.820256 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8ce43-4cc8-443f-80a3-dd0c70345c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:44.820568 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8ce43-4cc8-443f-80a3-dd0c70345c17 admin admin] PATH_INFO: `/v3/users/772f8bb8f0ed4630b556f961dfca3751` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:44.821812 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8ce43-4cc8-443f-80a3-dd0c70345c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=772f8bb8f0ed4630b556f961dfca3751)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:44.823819 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8ce43-4cc8-443f-80a3-dd0c70345c17 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:44.878073 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a2d8ce43-4cc8-443f-80a3-dd0c70345c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '772f8bb8f0ed4630b556f961dfca3751'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:44.878713 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a2d8ce43-4cc8-443f-80a3-dd0c70345c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '772f8bb8f0ed4630b556f961dfca3751'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:44.892036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a2d8ce43-4cc8-443f-80a3-dd0c70345c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '772f8bb8f0ed4630b556f961dfca3751'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:44.893206 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a2d8ce43-4cc8-443f-80a3-dd0c70345c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '772f8bb8f0ed4630b556f961dfca3751'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:44.903110 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-a2d8ce43-4cc8-443f-80a3-dd0c70345c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '772f8bb8f0ed4630b556f961dfca3751'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:44.916729 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1435/2871] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:12:44 2022] DELETE /identity/v3/users/772f8bb8f0ed4630b556f961dfca3751 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:45.224131 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:45.226184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:45.240927 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1eaa4-9b7f-4feb-b7d0-98ac450f44f7 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:45.298962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834ff06-9eca-4434-b72e-f098f9f7e330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:45.299862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834ff06-9eca-4434-b72e-f098f9f7e330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:45.300138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834ff06-9eca-4434-b72e-f098f9f7e330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:45.300453 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834ff06-9eca-4434-b72e-f098f9f7e330 admin admin] PATH_INFO: `/v3/projects/1754aa3c86f04357bd40cf5099e01d17` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:45.301796 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834ff06-9eca-4434-b72e-f098f9f7e330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1754aa3c86f04357bd40cf5099e01d17)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:45.303710 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834ff06-9eca-4434-b72e-f098f9f7e330 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:45.352039 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5834ff06-9eca-4434-b72e-f098f9f7e330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1754aa3c86f04357bd40cf5099e01d17', 'request_id': 'req-5834ff06-9eca-4434-b72e-f098f9f7e330'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:45.358832 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5834ff06-9eca-4434-b72e-f098f9f7e330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1754aa3c86f04357bd40cf5099e01d17', 'request_id': 'req-5834ff06-9eca-4434-b72e-f098f9f7e330'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:45.365349 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5834ff06-9eca-4434-b72e-f098f9f7e330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1754aa3c86f04357bd40cf5099e01d17', 'request_id': 'req-5834ff06-9eca-4434-b72e-f098f9f7e330'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:45.375688 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5834ff06-9eca-4434-b72e-f098f9f7e330 admin admin] The token cache is being invalidate because project 1754aa3c86f04357bd40cf5099e01d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86737) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:12:45.375972 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5834ff06-9eca-4434-b72e-f098f9f7e330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:45.376625 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-5834ff06-9eca-4434-b72e-f098f9f7e330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:45.378600 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1437/2872] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:12:45 2022] DELETE /identity/v3/projects/1754aa3c86f04357bd40cf5099e01d17 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:45.385046 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4ced7-7538-4139-b020-601d039ef148 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:45.385580 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4ced7-7538-4139-b020-601d039ef148 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:45.385580 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4ced7-7538-4139-b020-601d039ef148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:45.404754 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-00f4ced7-7538-4139-b020-601d039ef148 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:45.405897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-00f4ced7-7538-4139-b020-601d039ef148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:45.483126 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1436/2873] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:45.492505 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d124f1-20a0-4369-bc5d-5598412319d5 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:45.492770 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d124f1-20a0-4369-bc5d-5598412319d5 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:45.493132 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d124f1-20a0-4369-bc5d-5598412319d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:45.520915 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-88d124f1-20a0-4369-bc5d-5598412319d5 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:45.522159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-88d124f1-20a0-4369-bc5d-5598412319d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:45.531432 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1438/2874] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:45.536124 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4ced7-7538-4139-b020-601d039ef148 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:45.546345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4ced7-7538-4139-b020-601d039ef148 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:45.551428 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfde6f-41df-4e13-9280-219813ba5417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:45.552068 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfde6f-41df-4e13-9280-219813ba5417 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:45.552537 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfde6f-41df-4e13-9280-219813ba5417 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:45.552718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfde6f-41df-4e13-9280-219813ba5417 admin admin] PATH_INFO: `/v3/domains` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:45.553465 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfde6f-41df-4e13-9280-219813ba5417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86736) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:12:45.553762 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfde6f-41df-4e13-9280-219813ba5417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:45.555384 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfde6f-41df-4e13-9280-219813ba5417 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:45.567588 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1437/2875] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:12:45.572340 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d124f1-20a0-4369-bc5d-5598412319d5 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:45.582087 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d124f1-20a0-4369-bc5d-5598412319d5 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:45.588240 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed9104-41c9-483e-9836-0981ab2f3929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:45.588902 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed9104-41c9-483e-9836-0981ab2f3929 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:45.589174 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed9104-41c9-483e-9836-0981ab2f3929 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:45.589440 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed9104-41c9-483e-9836-0981ab2f3929 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:45.590149 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed9104-41c9-483e-9836-0981ab2f3929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:45.592120 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed9104-41c9-483e-9836-0981ab2f3929 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:45.621801 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1439/2876] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:12:45 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:12:45.628610 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfde6f-41df-4e13-9280-219813ba5417 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:45.639747 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfde6f-41df-4e13-9280-219813ba5417 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:45.708984 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e03502-1c77-4643-959b-b5a6f25823f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:45.709645 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e03502-1c77-4643-959b-b5a6f25823f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:45.709927 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e03502-1c77-4643-959b-b5a6f25823f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:45.710204 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e03502-1c77-4643-959b-b5a6f25823f8 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:45.710900 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e03502-1c77-4643-959b-b5a6f25823f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:45.712884 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e03502-1c77-4643-959b-b5a6f25823f8 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:45.735847 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1438/2877] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:12:45 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:12:45.740214 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed9104-41c9-483e-9836-0981ab2f3929 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:45.750869 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed9104-41c9-483e-9836-0981ab2f3929 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:45.757123 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db278d9-3c6a-44a5-80cb-56991d38540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:45.757796 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db278d9-3c6a-44a5-80cb-56991d38540b admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:45.758074 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db278d9-3c6a-44a5-80cb-56991d38540b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:45.758371 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db278d9-3c6a-44a5-80cb-56991d38540b admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:45.759101 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db278d9-3c6a-44a5-80cb-56991d38540b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:45.760777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db278d9-3c6a-44a5-80cb-56991d38540b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:45.772088 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1440/2878] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:12:45.777461 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e03502-1c77-4643-959b-b5a6f25823f8 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:45.788146 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e03502-1c77-4643-959b-b5a6f25823f8 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:45.792975 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627439a-4bfe-41f5-9e23-597e252b2a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:45.793641 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627439a-4bfe-41f5-9e23-597e252b2a63 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:45.793919 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627439a-4bfe-41f5-9e23-597e252b2a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:45.794195 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627439a-4bfe-41f5-9e23-597e252b2a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:45.794923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627439a-4bfe-41f5-9e23-597e252b2a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:45.796593 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627439a-4bfe-41f5-9e23-597e252b2a63 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:45.807085 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1439/2879] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:12:45.811277 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db278d9-3c6a-44a5-80cb-56991d38540b admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:45.821418 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db278d9-3c6a-44a5-80cb-56991d38540b admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:45.827636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f1836-cba7-47a3-b0b5-2815708ca4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:45.828551 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f1836-cba7-47a3-b0b5-2815708ca4e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:45.828824 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f1836-cba7-47a3-b0b5-2815708ca4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:45.829123 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f1836-cba7-47a3-b0b5-2815708ca4e1 admin admin] PATH_INFO: `/v3/projects/3c12d9e2f5f2494f9e91e60aaab61289/users/b4119ec7847149b8a6eb5d04d6dbaf17/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:45.844084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f1836-cba7-47a3-b0b5-2815708ca4e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c12d9e2f5f2494f9e91e60aaab61289, user_id=b4119ec7847149b8a6eb5d04d6dbaf17, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:45.846823 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f1836-cba7-47a3-b0b5-2815708ca4e1 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:45.866072 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1441/2880] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:12:45 2022] PUT /identity/v3/projects/3c12d9e2f5f2494f9e91e60aaab61289/users/b4119ec7847149b8a6eb5d04d6dbaf17/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:45.885186 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb1fb3-db91-4b5f-9348-8772c713eaef None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:45.885597 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb1fb3-db91-4b5f-9348-8772c713eaef None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:45.886010 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb1fb3-db91-4b5f-9348-8772c713eaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:45.924474 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-5ccb1fb3-db91-4b5f-9348-8772c713eaef None None] MFA Rules not processed for user `b4119ec7847149b8a6eb5d04d6dbaf17`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:45.925936 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5ccb1fb3-db91-4b5f-9348-8772c713eaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:45.998529 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1440/2881] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:12:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:46.005737 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f1836-cba7-47a3-b0b5-2815708ca4e1 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:46.070517 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f1836-cba7-47a3-b0b5-2815708ca4e1 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:46.075825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd7152-c389-4461-8d1c-a92c815c1618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:46.076507 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd7152-c389-4461-8d1c-a92c815c1618 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:46.076778 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd7152-c389-4461-8d1c-a92c815c1618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:46.077045 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd7152-c389-4461-8d1c-a92c815c1618 admin admin] PATH_INFO: `/v3/projects` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:46.077735 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd7152-c389-4461-8d1c-a92c815c1618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:46.079629 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd7152-c389-4461-8d1c-a92c815c1618 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:46.109833 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1442/2882] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:12:46 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:12:46.114104 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb1fb3-db91-4b5f-9348-8772c713eaef None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:46.125932 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb1fb3-db91-4b5f-9348-8772c713eaef None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:46.193447 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567386ea-521d-4064-8667-1f5ad8d93480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:46.194036 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567386ea-521d-4064-8667-1f5ad8d93480 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:46.194312 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567386ea-521d-4064-8667-1f5ad8d93480 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:46.194581 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567386ea-521d-4064-8667-1f5ad8d93480 admin admin] PATH_INFO: `/v3/users` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:46.195280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567386ea-521d-4064-8667-1f5ad8d93480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:46.197325 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567386ea-521d-4064-8667-1f5ad8d93480 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:46.217979 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1441/2883] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:12:46 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:12:46.222313 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd7152-c389-4461-8d1c-a92c815c1618 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:46.232831 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd7152-c389-4461-8d1c-a92c815c1618 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:46.238462 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3e2e0-f124-4e0e-af96-2f1343d21e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:46.239231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3e2e0-f124-4e0e-af96-2f1343d21e1f admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:46.239467 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3e2e0-f124-4e0e-af96-2f1343d21e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:46.239744 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3e2e0-f124-4e0e-af96-2f1343d21e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:46.240498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3e2e0-f124-4e0e-af96-2f1343d21e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:46.242136 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3e2e0-f124-4e0e-af96-2f1343d21e1f admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:46.253577 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1443/2884] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:12:46.258205 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567386ea-521d-4064-8667-1f5ad8d93480 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:46.268225 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567386ea-521d-4064-8667-1f5ad8d93480 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:46.273193 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436de111-e381-4079-b119-02f6b1766844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:46.274083 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436de111-e381-4079-b119-02f6b1766844 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:46.274358 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436de111-e381-4079-b119-02f6b1766844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:46.274625 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436de111-e381-4079-b119-02f6b1766844 admin admin] PATH_INFO: `/v3/projects/3aed969a9b704145a4985b958acc7011/users/40489a661f944662ba62ce6e66cf4762/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:46.289175 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436de111-e381-4079-b119-02f6b1766844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aed969a9b704145a4985b958acc7011, user_id=40489a661f944662ba62ce6e66cf4762, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:46.291828 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436de111-e381-4079-b119-02f6b1766844 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:46.306749 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1442/2885] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:12:46 2022] PUT /identity/v3/projects/3aed969a9b704145a4985b958acc7011/users/40489a661f944662ba62ce6e66cf4762/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:46.311338 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3e2e0-f124-4e0e-af96-2f1343d21e1f admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:46.323248 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3e2e0-f124-4e0e-af96-2f1343d21e1f admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:46.385508 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2832da-a042-4c1b-9b83-fc819ec71be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:46.386184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2832da-a042-4c1b-9b83-fc819ec71be6 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:46.386471 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2832da-a042-4c1b-9b83-fc819ec71be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:46.386746 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2832da-a042-4c1b-9b83-fc819ec71be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:46.387474 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2832da-a042-4c1b-9b83-fc819ec71be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:46.389135 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2832da-a042-4c1b-9b83-fc819ec71be6 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:46.398708 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1444/2886] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:12:46.403146 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436de111-e381-4079-b119-02f6b1766844 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:46.414284 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436de111-e381-4079-b119-02f6b1766844 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:46.419058 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1dcc0-1771-49ce-be7d-7a7ac6f70aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:46.419957 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1dcc0-1771-49ce-be7d-7a7ac6f70aba admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:46.420243 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1dcc0-1771-49ce-be7d-7a7ac6f70aba admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:46.420520 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1dcc0-1771-49ce-be7d-7a7ac6f70aba admin admin] PATH_INFO: `/v3/projects/3aed969a9b704145a4985b958acc7011/users/40489a661f944662ba62ce6e66cf4762/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:46.422486 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1dcc0-1771-49ce-be7d-7a7ac6f70aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aed969a9b704145a4985b958acc7011, user_id=40489a661f944662ba62ce6e66cf4762, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:46.425329 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1dcc0-1771-49ce-be7d-7a7ac6f70aba admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:46.435833 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1443/2887] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:12:46 2022] PUT /identity/v3/projects/3aed969a9b704145a4985b958acc7011/users/40489a661f944662ba62ce6e66cf4762/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:46.447410 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aad881-092c-48f2-b438-660555171ef7 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:46.447625 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aad881-092c-48f2-b438-660555171ef7 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:46.448004 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aad881-092c-48f2-b438-660555171ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:46.482879 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-15aad881-092c-48f2-b438-660555171ef7 None None] MFA Rules not processed for user `40489a661f944662ba62ce6e66cf4762`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:46.484115 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-15aad881-092c-48f2-b438-660555171ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:46.556738 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1445/2888] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:12:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:46.569380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1dcc0-1771-49ce-be7d-7a7ac6f70aba admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:46.572254 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-68c1dcc0-1771-49ce-be7d-7a7ac6f70aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:46.641483 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1dcc0-1771-49ce-be7d-7a7ac6f70aba admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:46.645628 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411993d-9e38-404d-ac00-a3633fc0900b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:46.646280 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411993d-9e38-404d-ac00-a3633fc0900b service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:46.646556 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411993d-9e38-404d-ac00-a3633fc0900b service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:46.646811 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411993d-9e38-404d-ac00-a3633fc0900b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:46.657266 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411993d-9e38-404d-ac00-a3633fc0900b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:46.658797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411993d-9e38-404d-ac00-a3633fc0900b service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:46.668455 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1444/2889] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:47.083600 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aad881-092c-48f2-b438-660555171ef7 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:47.151879 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aad881-092c-48f2-b438-660555171ef7 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:47.157588 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad6bc2-f44f-40f8-8d5b-db777efa1c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:47.158494 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad6bc2-f44f-40f8-8d5b-db777efa1c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:47.158756 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad6bc2-f44f-40f8-8d5b-db777efa1c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:47.159038 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad6bc2-f44f-40f8-8d5b-db777efa1c1f admin admin] PATH_INFO: `/v3/users/b4119ec7847149b8a6eb5d04d6dbaf17` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:47.160278 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad6bc2-f44f-40f8-8d5b-db777efa1c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4119ec7847149b8a6eb5d04d6dbaf17)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:47.162215 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad6bc2-f44f-40f8-8d5b-db777efa1c1f admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:47.212578 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-65ad6bc2-f44f-40f8-8d5b-db777efa1c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4119ec7847149b8a6eb5d04d6dbaf17'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:47.213171 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-65ad6bc2-f44f-40f8-8d5b-db777efa1c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4119ec7847149b8a6eb5d04d6dbaf17'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:47.225390 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-65ad6bc2-f44f-40f8-8d5b-db777efa1c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4119ec7847149b8a6eb5d04d6dbaf17'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:47.226138 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-65ad6bc2-f44f-40f8-8d5b-db777efa1c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4119ec7847149b8a6eb5d04d6dbaf17'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:47.237353 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-65ad6bc2-f44f-40f8-8d5b-db777efa1c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4119ec7847149b8a6eb5d04d6dbaf17'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:47.250621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1446/2890] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:12:47 2022] DELETE /identity/v3/users/b4119ec7847149b8a6eb5d04d6dbaf17 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:47.256226 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2b348-8632-4ad5-9243-2a1098198b61 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:47.256528 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2b348-8632-4ad5-9243-2a1098198b61 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:47.256804 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2b348-8632-4ad5-9243-2a1098198b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:47.275797 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-82d2b348-8632-4ad5-9243-2a1098198b61 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:47.277028 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-82d2b348-8632-4ad5-9243-2a1098198b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:47.336643 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1445/2891] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:47.351980 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad6bc2-f44f-40f8-8d5b-db777efa1c1f admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:47.353629 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-65ad6bc2-f44f-40f8-8d5b-db777efa1c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:47.416621 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad6bc2-f44f-40f8-8d5b-db777efa1c1f admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:47.424246 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5ce50-73d1-4d66-920d-949656a8e02f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:47.425221 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5ce50-73d1-4d66-920d-949656a8e02f service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:47.425549 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5ce50-73d1-4d66-920d-949656a8e02f service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:47.426016 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5ce50-73d1-4d66-920d-949656a8e02f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:47.442141 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5ce50-73d1-4d66-920d-949656a8e02f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:47.443598 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5ce50-73d1-4d66-920d-949656a8e02f service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:47.454775 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1447/2892] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:47.769878 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2b348-8632-4ad5-9243-2a1098198b61 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:47.771585 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-82d2b348-8632-4ad5-9243-2a1098198b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:47.784794 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2b348-8632-4ad5-9243-2a1098198b61 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:47.790558 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc517c2-e56a-4e57-964f-ab2a45927498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:47.791466 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc517c2-e56a-4e57-964f-ab2a45927498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:47.791970 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc517c2-e56a-4e57-964f-ab2a45927498 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:47.792273 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc517c2-e56a-4e57-964f-ab2a45927498 admin admin] PATH_INFO: `/v3/projects/3c12d9e2f5f2494f9e91e60aaab61289` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:47.793579 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc517c2-e56a-4e57-964f-ab2a45927498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c12d9e2f5f2494f9e91e60aaab61289)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:47.795579 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc517c2-e56a-4e57-964f-ab2a45927498 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:47.847170 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8bc517c2-e56a-4e57-964f-ab2a45927498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c12d9e2f5f2494f9e91e60aaab61289', 'request_id': 'req-8bc517c2-e56a-4e57-964f-ab2a45927498'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:47.856448 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8bc517c2-e56a-4e57-964f-ab2a45927498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c12d9e2f5f2494f9e91e60aaab61289', 'request_id': 'req-8bc517c2-e56a-4e57-964f-ab2a45927498'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:47.862239 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8bc517c2-e56a-4e57-964f-ab2a45927498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c12d9e2f5f2494f9e91e60aaab61289', 'request_id': 'req-8bc517c2-e56a-4e57-964f-ab2a45927498'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:47.873174 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8bc517c2-e56a-4e57-964f-ab2a45927498 admin admin] The token cache is being invalidate because project 3c12d9e2f5f2494f9e91e60aaab61289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:12:47.873450 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8bc517c2-e56a-4e57-964f-ab2a45927498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:47.874072 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-8bc517c2-e56a-4e57-964f-ab2a45927498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:47.875620 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1446/2893] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:12:47 2022] DELETE /identity/v3/projects/3c12d9e2f5f2494f9e91e60aaab61289 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:47.880435 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5ce50-73d1-4d66-920d-949656a8e02f service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:47.890859 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5ce50-73d1-4d66-920d-949656a8e02f service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:47.961531 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8c758-3d18-47a3-a60f-6052089dc568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:47.962416 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8c758-3d18-47a3-a60f-6052089dc568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:47.962698 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8c758-3d18-47a3-a60f-6052089dc568 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:47.962970 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8c758-3d18-47a3-a60f-6052089dc568 admin admin] PATH_INFO: `/v3/users/40489a661f944662ba62ce6e66cf4762` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:47.964363 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8c758-3d18-47a3-a60f-6052089dc568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40489a661f944662ba62ce6e66cf4762)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:47.966325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8c758-3d18-47a3-a60f-6052089dc568 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:48.014231 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-afa8c758-3d18-47a3-a60f-6052089dc568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40489a661f944662ba62ce6e66cf4762'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:48.014767 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-afa8c758-3d18-47a3-a60f-6052089dc568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40489a661f944662ba62ce6e66cf4762'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:48.028008 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-afa8c758-3d18-47a3-a60f-6052089dc568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40489a661f944662ba62ce6e66cf4762'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:48.028757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-afa8c758-3d18-47a3-a60f-6052089dc568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40489a661f944662ba62ce6e66cf4762'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:48.038693 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-afa8c758-3d18-47a3-a60f-6052089dc568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40489a661f944662ba62ce6e66cf4762'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:48.053498 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1448/2894] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:12:47 2022] DELETE /identity/v3/users/40489a661f944662ba62ce6e66cf4762 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:48.337976 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc517c2-e56a-4e57-964f-ab2a45927498 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:48.339462 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-8bc517c2-e56a-4e57-964f-ab2a45927498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:48.353439 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc517c2-e56a-4e57-964f-ab2a45927498 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:48.420185 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413b93a-41d2-43d7-99c7-7b7e8078baed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:48.421431 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b93a-41d2-43d7-99c7-7b7e8078baed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:48.421882 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b93a-41d2-43d7-99c7-7b7e8078baed admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:48.422309 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b93a-41d2-43d7-99c7-7b7e8078baed admin admin] PATH_INFO: `/v3/projects/3aed969a9b704145a4985b958acc7011` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:48.424558 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413b93a-41d2-43d7-99c7-7b7e8078baed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aed969a9b704145a4985b958acc7011)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:48.426918 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413b93a-41d2-43d7-99c7-7b7e8078baed admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:48.483435 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0413b93a-41d2-43d7-99c7-7b7e8078baed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aed969a9b704145a4985b958acc7011', 'request_id': 'req-0413b93a-41d2-43d7-99c7-7b7e8078baed'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:48.491897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0413b93a-41d2-43d7-99c7-7b7e8078baed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aed969a9b704145a4985b958acc7011', 'request_id': 'req-0413b93a-41d2-43d7-99c7-7b7e8078baed'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:48.497490 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0413b93a-41d2-43d7-99c7-7b7e8078baed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aed969a9b704145a4985b958acc7011', 'request_id': 'req-0413b93a-41d2-43d7-99c7-7b7e8078baed'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:48.511373 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0413b93a-41d2-43d7-99c7-7b7e8078baed admin admin] The token cache is being invalidate because project 3aed969a9b704145a4985b958acc7011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:12:48.511718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0413b93a-41d2-43d7-99c7-7b7e8078baed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:48.512413 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-0413b93a-41d2-43d7-99c7-7b7e8078baed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:48.514779 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1447/2895] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:12:48 2022] DELETE /identity/v3/projects/3aed969a9b704145a4985b958acc7011 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:48.520078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20bcc0-b715-49a1-bca3-047361aeaf22 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:48.520587 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20bcc0-b715-49a1-bca3-047361aeaf22 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:48.520703 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20bcc0-b715-49a1-bca3-047361aeaf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:48.539652 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-7f20bcc0-b715-49a1-bca3-047361aeaf22 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:48.540809 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-7f20bcc0-b715-49a1-bca3-047361aeaf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:48.604713 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1449/2896] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:48.615150 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca8b6f-f04b-4e1d-ad1c-c28203dee5d6 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:48.615475 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca8b6f-f04b-4e1d-ad1c-c28203dee5d6 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:48.615751 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca8b6f-f04b-4e1d-ad1c-c28203dee5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:48.637415 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-0aca8b6f-f04b-4e1d-ad1c-c28203dee5d6 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:48.638645 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-0aca8b6f-f04b-4e1d-ad1c-c28203dee5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:48.647923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1448/2897] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:48.652442 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20bcc0-b715-49a1-bca3-047361aeaf22 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:48.663084 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20bcc0-b715-49a1-bca3-047361aeaf22 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:48.667953 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e2505-5c4a-4793-a78c-95e698fe022f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:48.668682 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e2505-5c4a-4793-a78c-95e698fe022f admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:48.668962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e2505-5c4a-4793-a78c-95e698fe022f admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:48.669232 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e2505-5c4a-4793-a78c-95e698fe022f admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:48.669946 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e2505-5c4a-4793-a78c-95e698fe022f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:12:48.670249 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e2505-5c4a-4793-a78c-95e698fe022f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:48.671877 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e2505-5c4a-4793-a78c-95e698fe022f admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:48.683717 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1450/2898] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:12:48.688298 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca8b6f-f04b-4e1d-ad1c-c28203dee5d6 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:48.698447 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca8b6f-f04b-4e1d-ad1c-c28203dee5d6 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:48.703589 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa730a-128f-4bf1-875a-4a546b33ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:48.704247 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa730a-128f-4bf1-875a-4a546b33ce2b admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:48.704560 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa730a-128f-4bf1-875a-4a546b33ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:48.704837 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa730a-128f-4bf1-875a-4a546b33ce2b admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:48.705541 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa730a-128f-4bf1-875a-4a546b33ce2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:48.707679 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa730a-128f-4bf1-875a-4a546b33ce2b admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:48.735761 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1449/2899] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:12:48 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:12:48.742343 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e2505-5c4a-4793-a78c-95e698fe022f admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:48.757096 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e2505-5c4a-4793-a78c-95e698fe022f admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:48.825876 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26691-34d5-4eb6-8675-34deb502bff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:48.826513 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26691-34d5-4eb6-8675-34deb502bff6 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:48.826792 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26691-34d5-4eb6-8675-34deb502bff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:48.827067 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26691-34d5-4eb6-8675-34deb502bff6 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:48.827781 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f26691-34d5-4eb6-8675-34deb502bff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:48.829764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f26691-34d5-4eb6-8675-34deb502bff6 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:48.855366 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1451/2900] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:12:48 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:12:48.857976 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa730a-128f-4bf1-875a-4a546b33ce2b admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:48.876963 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa730a-128f-4bf1-875a-4a546b33ce2b admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:48.882863 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3df52-ca32-4b63-a363-d8ba5c00e128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:48.883545 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3df52-ca32-4b63-a363-d8ba5c00e128 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:48.883873 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3df52-ca32-4b63-a363-d8ba5c00e128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:48.884146 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3df52-ca32-4b63-a363-d8ba5c00e128 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:48.884919 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3df52-ca32-4b63-a363-d8ba5c00e128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:48.886539 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3df52-ca32-4b63-a363-d8ba5c00e128 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:48.898156 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1450/2901] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:12:48.903369 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26691-34d5-4eb6-8675-34deb502bff6 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:48.914127 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26691-34d5-4eb6-8675-34deb502bff6 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:48.919711 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6245c15-fa86-40a9-8fc1-78b847130eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:48.920437 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6245c15-fa86-40a9-8fc1-78b847130eba admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:48.920718 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6245c15-fa86-40a9-8fc1-78b847130eba admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:48.920987 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6245c15-fa86-40a9-8fc1-78b847130eba admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:48.921735 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6245c15-fa86-40a9-8fc1-78b847130eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:48.923370 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6245c15-fa86-40a9-8fc1-78b847130eba admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:48.934142 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1452/2902] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:12:48.938775 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3df52-ca32-4b63-a363-d8ba5c00e128 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:48.950098 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3df52-ca32-4b63-a363-d8ba5c00e128 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:48.957597 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442db41-22d0-43d4-a6e8-5a229c130883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:48.958982 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442db41-22d0-43d4-a6e8-5a229c130883 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:48.959345 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442db41-22d0-43d4-a6e8-5a229c130883 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:48.959694 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442db41-22d0-43d4-a6e8-5a229c130883 admin admin] PATH_INFO: `/v3/projects/53e96966c9f9448b8cca7cf458bcf78a/users/c96514b5f88e492a81b3ddc18c79633e/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:48.981097 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442db41-22d0-43d4-a6e8-5a229c130883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e96966c9f9448b8cca7cf458bcf78a, user_id=c96514b5f88e492a81b3ddc18c79633e, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:48.983764 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442db41-22d0-43d4-a6e8-5a229c130883 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:49.000535 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1451/2903] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:12:48 2022] PUT /identity/v3/projects/53e96966c9f9448b8cca7cf458bcf78a/users/c96514b5f88e492a81b3ddc18c79633e/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:49.013777 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c12702-1d96-4d0d-b580-96df4d920b97 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:49.014158 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c12702-1d96-4d0d-b580-96df4d920b97 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:49.014508 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c12702-1d96-4d0d-b580-96df4d920b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:49.050491 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-f5c12702-1d96-4d0d-b580-96df4d920b97 None None] MFA Rules not processed for user `c96514b5f88e492a81b3ddc18c79633e`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:49.052077 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f5c12702-1d96-4d0d-b580-96df4d920b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:49.125666 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1453/2904] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:12:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:49.132050 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442db41-22d0-43d4-a6e8-5a229c130883 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:49.197495 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442db41-22d0-43d4-a6e8-5a229c130883 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:49.203443 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f240c2-dee6-451f-abc1-3db9e1ae5732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:49.204119 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f240c2-dee6-451f-abc1-3db9e1ae5732 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:49.204503 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f240c2-dee6-451f-abc1-3db9e1ae5732 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:49.204774 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f240c2-dee6-451f-abc1-3db9e1ae5732 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:49.205466 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f240c2-dee6-451f-abc1-3db9e1ae5732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:49.208006 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f240c2-dee6-451f-abc1-3db9e1ae5732 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:49.240258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1452/2905] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:12:49 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:12:49.241874 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c12702-1d96-4d0d-b580-96df4d920b97 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:49.253880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c12702-1d96-4d0d-b580-96df4d920b97 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:49.324251 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c7e38-2df6-4335-b281-1e28e1257ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:49.325240 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c7e38-2df6-4335-b281-1e28e1257ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:49.325712 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c7e38-2df6-4335-b281-1e28e1257ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:49.326159 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c7e38-2df6-4335-b281-1e28e1257ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:49.327291 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c7e38-2df6-4335-b281-1e28e1257ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:49.330571 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c7e38-2df6-4335-b281-1e28e1257ac8 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:49.353481 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1454/2906] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:12:49 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:12:49.357756 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f240c2-dee6-451f-abc1-3db9e1ae5732 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:49.368579 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f240c2-dee6-451f-abc1-3db9e1ae5732 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:49.373940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a63345-08af-4155-a985-1e4c81e3e68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:49.374615 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a63345-08af-4155-a985-1e4c81e3e68e admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:49.374894 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a63345-08af-4155-a985-1e4c81e3e68e admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:49.375195 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a63345-08af-4155-a985-1e4c81e3e68e admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:49.375973 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a63345-08af-4155-a985-1e4c81e3e68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:49.377923 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a63345-08af-4155-a985-1e4c81e3e68e admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:49.389241 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1453/2907] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:12:49.393757 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c7e38-2df6-4335-b281-1e28e1257ac8 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:49.404367 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c7e38-2df6-4335-b281-1e28e1257ac8 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:49.409350 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e0289-75b7-432d-a7c5-82f30a8a3e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:49.410242 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e0289-75b7-432d-a7c5-82f30a8a3e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:49.410576 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e0289-75b7-432d-a7c5-82f30a8a3e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:49.410912 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e0289-75b7-432d-a7c5-82f30a8a3e58 admin admin] PATH_INFO: `/v3/projects/0351e0b5204a44e7a06d72c47662c6ac/users/e0f3d09513bf44dd80616015b8b5288f/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:49.426264 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e0289-75b7-432d-a7c5-82f30a8a3e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0351e0b5204a44e7a06d72c47662c6ac, user_id=e0f3d09513bf44dd80616015b8b5288f, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:49.429008 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e0289-75b7-432d-a7c5-82f30a8a3e58 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:49.443129 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1455/2908] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:12:49 2022] PUT /identity/v3/projects/0351e0b5204a44e7a06d72c47662c6ac/users/e0f3d09513bf44dd80616015b8b5288f/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:49.447425 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a63345-08af-4155-a985-1e4c81e3e68e admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:49.458519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a63345-08af-4155-a985-1e4c81e3e68e admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:49.534290 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184d383-3f7b-4e07-a4af-3a1ed20411f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:49.535099 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184d383-3f7b-4e07-a4af-3a1ed20411f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:49.535414 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184d383-3f7b-4e07-a4af-3a1ed20411f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:49.535677 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184d383-3f7b-4e07-a4af-3a1ed20411f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:49.536509 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184d383-3f7b-4e07-a4af-3a1ed20411f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:49.538153 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184d383-3f7b-4e07-a4af-3a1ed20411f9 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:49.549077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1454/2909] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:12:49.554093 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e0289-75b7-432d-a7c5-82f30a8a3e58 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:49.568642 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e0289-75b7-432d-a7c5-82f30a8a3e58 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:49.574530 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4102-b79a-4e00-a7c0-f252f4c9076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:49.575475 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4102-b79a-4e00-a7c0-f252f4c9076a admin admin] REQUEST_METHOD: `PUT` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:49.575753 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4102-b79a-4e00-a7c0-f252f4c9076a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:49.576018 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4102-b79a-4e00-a7c0-f252f4c9076a admin admin] PATH_INFO: `/v3/projects/0351e0b5204a44e7a06d72c47662c6ac/users/e0f3d09513bf44dd80616015b8b5288f/roles/85136c55809b4d9db97c263a72392ad1` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:49.578341 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca4102-b79a-4e00-a7c0-f252f4c9076a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0351e0b5204a44e7a06d72c47662c6ac, user_id=e0f3d09513bf44dd80616015b8b5288f, role_id=85136c55809b4d9db97c263a72392ad1)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:49.581099 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca4102-b79a-4e00-a7c0-f252f4c9076a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:49.595514 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1456/2910] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:12:49 2022] PUT /identity/v3/projects/0351e0b5204a44e7a06d72c47662c6ac/users/e0f3d09513bf44dd80616015b8b5288f/roles/85136c55809b4d9db97c263a72392ad1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:12:49.607075 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d821b42-8405-473f-bad5-904eba71fa41 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:49.607505 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d821b42-8405-473f-bad5-904eba71fa41 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:49.607896 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d821b42-8405-473f-bad5-904eba71fa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:49.644551 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-7d821b42-8405-473f-bad5-904eba71fa41 None None] MFA Rules not processed for user `e0f3d09513bf44dd80616015b8b5288f`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:49.645687 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7d821b42-8405-473f-bad5-904eba71fa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:49.741605 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1455/2911] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:12:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:49.753424 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4102-b79a-4e00-a7c0-f252f4c9076a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:49.755685 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-c5ca4102-b79a-4e00-a7c0-f252f4c9076a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:49.823380 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4102-b79a-4e00-a7c0-f252f4c9076a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:49.827581 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78729991-7980-45f1-9103-a6d52e301cae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:49.828280 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78729991-7980-45f1-9103-a6d52e301cae service cinder] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:49.828555 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78729991-7980-45f1-9103-a6d52e301cae service cinder] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:49.828825 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78729991-7980-45f1-9103-a6d52e301cae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:49.898152 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78729991-7980-45f1-9103-a6d52e301cae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:49.899747 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78729991-7980-45f1-9103-a6d52e301cae service cinder] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:49.909442 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1457/2912] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:54.383741 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d821b42-8405-473f-bad5-904eba71fa41 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:54.385307 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-7d821b42-8405-473f-bad5-904eba71fa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:54.398644 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d821b42-8405-473f-bad5-904eba71fa41 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:54.403050 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee96387-9029-4827-8c62-9b1d23a80ec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:54.403693 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee96387-9029-4827-8c62-9b1d23a80ec5 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:54.403969 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee96387-9029-4827-8c62-9b1d23a80ec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:54.404417 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee96387-9029-4827-8c62-9b1d23a80ec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:54.414340 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee96387-9029-4827-8c62-9b1d23a80ec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:54.415811 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee96387-9029-4827-8c62-9b1d23a80ec5 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:54.425858 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1456/2913] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:59.355102 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78729991-7980-45f1-9103-a6d52e301cae service cinder] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:59.422560 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78729991-7980-45f1-9103-a6d52e301cae service cinder] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:59.428078 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d27b57-c6de-4c47-8204-32f9f03f475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:59.429212 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d27b57-c6de-4c47-8204-32f9f03f475b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:59.429544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d27b57-c6de-4c47-8204-32f9f03f475b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:59.429886 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d27b57-c6de-4c47-8204-32f9f03f475b admin admin] PATH_INFO: `/v3/users/c96514b5f88e492a81b3ddc18c79633e` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:59.431261 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d27b57-c6de-4c47-8204-32f9f03f475b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96514b5f88e492a81b3ddc18c79633e)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:59.433244 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d27b57-c6de-4c47-8204-32f9f03f475b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:59.484072 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c3d27b57-c6de-4c47-8204-32f9f03f475b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96514b5f88e492a81b3ddc18c79633e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:59.484749 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c3d27b57-c6de-4c47-8204-32f9f03f475b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96514b5f88e492a81b3ddc18c79633e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:59.497083 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c3d27b57-c6de-4c47-8204-32f9f03f475b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96514b5f88e492a81b3ddc18c79633e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:59.497811 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c3d27b57-c6de-4c47-8204-32f9f03f475b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96514b5f88e492a81b3ddc18c79633e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:59.508383 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-c3d27b57-c6de-4c47-8204-32f9f03f475b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96514b5f88e492a81b3ddc18c79633e'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:59.521299 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1458/2914] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:12:59 2022] DELETE /identity/v3/users/c96514b5f88e492a81b3ddc18c79633e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:59.526095 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024765c-eb7d-479e-a65d-0638956cd063 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:59.526611 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024765c-eb7d-479e-a65d-0638956cd063 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:59.526611 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024765c-eb7d-479e-a65d-0638956cd063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:59.545288 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-4024765c-eb7d-479e-a65d-0638956cd063 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:59.546469 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4024765c-eb7d-479e-a65d-0638956cd063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:59.615002 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1457/2915] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:59.631503 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d27b57-c6de-4c47-8204-32f9f03f475b admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:59.633271 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-c3d27b57-c6de-4c47-8204-32f9f03f475b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:59.695640 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d27b57-c6de-4c47-8204-32f9f03f475b admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:59.699664 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea551f91-4e07-4b75-88c3-0744d383f30c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:59.700354 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551f91-4e07-4b75-88c3-0744d383f30c service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:59.700636 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551f91-4e07-4b75-88c3-0744d383f30c service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:59.700910 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551f91-4e07-4b75-88c3-0744d383f30c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:59.710315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea551f91-4e07-4b75-88c3-0744d383f30c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:59.711764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea551f91-4e07-4b75-88c3-0744d383f30c service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:59.721462 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1459/2916] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:59.996678 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024765c-eb7d-479e-a65d-0638956cd063 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:59.998847 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-4024765c-eb7d-479e-a65d-0638956cd063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:00.015501 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024765c-eb7d-479e-a65d-0638956cd063 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:00.020966 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e05faa-b6dd-41dc-8690-58b33ba235dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:00.021982 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e05faa-b6dd-41dc-8690-58b33ba235dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:00.022324 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e05faa-b6dd-41dc-8690-58b33ba235dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:00.022660 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e05faa-b6dd-41dc-8690-58b33ba235dd admin admin] PATH_INFO: `/v3/projects/53e96966c9f9448b8cca7cf458bcf78a` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:00.024039 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e05faa-b6dd-41dc-8690-58b33ba235dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e96966c9f9448b8cca7cf458bcf78a)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:00.026394 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e05faa-b6dd-41dc-8690-58b33ba235dd admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:00.075112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f5e05faa-b6dd-41dc-8690-58b33ba235dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e96966c9f9448b8cca7cf458bcf78a', 'request_id': 'req-f5e05faa-b6dd-41dc-8690-58b33ba235dd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:00.084670 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f5e05faa-b6dd-41dc-8690-58b33ba235dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e96966c9f9448b8cca7cf458bcf78a', 'request_id': 'req-f5e05faa-b6dd-41dc-8690-58b33ba235dd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:00.090946 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f5e05faa-b6dd-41dc-8690-58b33ba235dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e96966c9f9448b8cca7cf458bcf78a', 'request_id': 'req-f5e05faa-b6dd-41dc-8690-58b33ba235dd'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:00.102328 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f5e05faa-b6dd-41dc-8690-58b33ba235dd admin admin] The token cache is being invalidate because project 53e96966c9f9448b8cca7cf458bcf78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:13:00.102616 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f5e05faa-b6dd-41dc-8690-58b33ba235dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:00.103252 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-f5e05faa-b6dd-41dc-8690-58b33ba235dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:00.104822 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1458/2917] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:12:59 2022] DELETE /identity/v3/projects/53e96966c9f9448b8cca7cf458bcf78a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:00.109151 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea551f91-4e07-4b75-88c3-0744d383f30c service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:00.119183 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea551f91-4e07-4b75-88c3-0744d383f30c service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:00.178724 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274abbd9-d7f2-4200-99f9-afc6baa16ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:00.179612 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274abbd9-d7f2-4200-99f9-afc6baa16ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:00.179888 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274abbd9-d7f2-4200-99f9-afc6baa16ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:00.180153 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274abbd9-d7f2-4200-99f9-afc6baa16ff1 admin admin] PATH_INFO: `/v3/users/e0f3d09513bf44dd80616015b8b5288f` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:00.181458 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274abbd9-d7f2-4200-99f9-afc6baa16ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f3d09513bf44dd80616015b8b5288f)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:00.183439 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274abbd9-d7f2-4200-99f9-afc6baa16ff1 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:00.234834 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-274abbd9-d7f2-4200-99f9-afc6baa16ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f3d09513bf44dd80616015b8b5288f'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:00.235497 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-274abbd9-d7f2-4200-99f9-afc6baa16ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f3d09513bf44dd80616015b8b5288f'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:00.249538 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-274abbd9-d7f2-4200-99f9-afc6baa16ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f3d09513bf44dd80616015b8b5288f'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:00.250428 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-274abbd9-d7f2-4200-99f9-afc6baa16ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f3d09513bf44dd80616015b8b5288f'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:00.265866 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-274abbd9-d7f2-4200-99f9-afc6baa16ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f3d09513bf44dd80616015b8b5288f'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:00.279401 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1460/2918] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:13:00 2022] DELETE /identity/v3/users/e0f3d09513bf44dd80616015b8b5288f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:00.559868 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e05faa-b6dd-41dc-8690-58b33ba235dd admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:00.561398 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-f5e05faa-b6dd-41dc-8690-58b33ba235dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:00.576084 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e05faa-b6dd-41dc-8690-58b33ba235dd admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:00.635875 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff62ab-86f1-4eb6-8d59-6e3a86e7a916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:00.636711 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff62ab-86f1-4eb6-8d59-6e3a86e7a916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:00.636990 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff62ab-86f1-4eb6-8d59-6e3a86e7a916 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:00.637263 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff62ab-86f1-4eb6-8d59-6e3a86e7a916 admin admin] PATH_INFO: `/v3/projects/0351e0b5204a44e7a06d72c47662c6ac` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:00.638976 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff62ab-86f1-4eb6-8d59-6e3a86e7a916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0351e0b5204a44e7a06d72c47662c6ac)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:00.640566 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff62ab-86f1-4eb6-8d59-6e3a86e7a916 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:00.690059 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-06ff62ab-86f1-4eb6-8d59-6e3a86e7a916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0351e0b5204a44e7a06d72c47662c6ac', 'request_id': 'req-06ff62ab-86f1-4eb6-8d59-6e3a86e7a916'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:00.697789 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-06ff62ab-86f1-4eb6-8d59-6e3a86e7a916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0351e0b5204a44e7a06d72c47662c6ac', 'request_id': 'req-06ff62ab-86f1-4eb6-8d59-6e3a86e7a916'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:00.703564 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-06ff62ab-86f1-4eb6-8d59-6e3a86e7a916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0351e0b5204a44e7a06d72c47662c6ac', 'request_id': 'req-06ff62ab-86f1-4eb6-8d59-6e3a86e7a916'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:00.715820 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-06ff62ab-86f1-4eb6-8d59-6e3a86e7a916 admin admin] The token cache is being invalidate because project 0351e0b5204a44e7a06d72c47662c6ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:13:00.716103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-06ff62ab-86f1-4eb6-8d59-6e3a86e7a916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:00.716895 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-06ff62ab-86f1-4eb6-8d59-6e3a86e7a916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:00.718609 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1459/2919] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:13:00 2022] DELETE /identity/v3/projects/0351e0b5204a44e7a06d72c47662c6ac => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:00.726647 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7353099-1df8-40c8-b965-c7e9c71e0161 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:00.727185 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7353099-1df8-40c8-b965-c7e9c71e0161 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:00.727301 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7353099-1df8-40c8-b965-c7e9c71e0161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:00.748466 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-f7353099-1df8-40c8-b965-c7e9c71e0161 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:00.749806 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-f7353099-1df8-40c8-b965-c7e9c71e0161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:00.816376 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1461/2920] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:00.885519 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e7668-eab2-4923-bd52-7134ded122d6 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:00.885821 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e7668-eab2-4923-bd52-7134ded122d6 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:00.886104 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e7668-eab2-4923-bd52-7134ded122d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:00.913786 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-5a0e7668-eab2-4923-bd52-7134ded122d6 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:00.915003 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5a0e7668-eab2-4923-bd52-7134ded122d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:00.923791 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1460/2921] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:00.928775 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7353099-1df8-40c8-b965-c7e9c71e0161 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:00.941880 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7353099-1df8-40c8-b965-c7e9c71e0161 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:00.948168 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f40cf9-276f-44a9-af38-61b3b95e2129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:00.948885 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f40cf9-276f-44a9-af38-61b3b95e2129 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:00.949174 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f40cf9-276f-44a9-af38-61b3b95e2129 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:00.949437 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f40cf9-276f-44a9-af38-61b3b95e2129 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:00.950175 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f40cf9-276f-44a9-af38-61b3b95e2129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:13:00.950511 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f40cf9-276f-44a9-af38-61b3b95e2129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:00.952183 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f40cf9-276f-44a9-af38-61b3b95e2129 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:00.966455 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1462/2922] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:13:00.971296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e7668-eab2-4923-bd52-7134ded122d6 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:00.981052 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e7668-eab2-4923-bd52-7134ded122d6 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:00.985664 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf1930-63b4-43b3-a581-fce0aadae5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:00.986371 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf1930-63b4-43b3-a581-fce0aadae5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:00.986648 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf1930-63b4-43b3-a581-fce0aadae5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:00.986917 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf1930-63b4-43b3-a581-fce0aadae5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:00.987623 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf1930-63b4-43b3-a581-fce0aadae5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:00.989918 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf1930-63b4-43b3-a581-fce0aadae5e6 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:01.016414 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1461/2923] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:13:00 2022] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:13:01.020968 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f40cf9-276f-44a9-af38-61b3b95e2129 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:01.032044 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f40cf9-276f-44a9-af38-61b3b95e2129 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:01.094287 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47e22c-0a15-48e9-9d86-fd6e458bb11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:01.094962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47e22c-0a15-48e9-9d86-fd6e458bb11a admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:01.095239 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47e22c-0a15-48e9-9d86-fd6e458bb11a admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:01.095501 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47e22c-0a15-48e9-9d86-fd6e458bb11a admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:01.096184 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47e22c-0a15-48e9-9d86-fd6e458bb11a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:01.098194 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47e22c-0a15-48e9-9d86-fd6e458bb11a admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:01.119157 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1463/2924] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:13:01 2022] POST /identity/v3/users => generated 280 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:13:01.124504 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf1930-63b4-43b3-a581-fce0aadae5e6 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:01.137227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf1930-63b4-43b3-a581-fce0aadae5e6 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:01.142813 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88612a-0d4c-47a0-95d6-8a60818a97ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:01.143508 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88612a-0d4c-47a0-95d6-8a60818a97ed admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:01.143782 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88612a-0d4c-47a0-95d6-8a60818a97ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:01.144112 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88612a-0d4c-47a0-95d6-8a60818a97ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:01.144950 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88612a-0d4c-47a0-95d6-8a60818a97ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:01.146805 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88612a-0d4c-47a0-95d6-8a60818a97ed admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:01.158103 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1462/2925] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:13:01.162433 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47e22c-0a15-48e9-9d86-fd6e458bb11a admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:01.173641 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47e22c-0a15-48e9-9d86-fd6e458bb11a admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:01.180339 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd303d-5284-4c38-81cd-ad0037bfb0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:01.180999 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd303d-5284-4c38-81cd-ad0037bfb0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:01.181271 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd303d-5284-4c38-81cd-ad0037bfb0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:01.181536 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd303d-5284-4c38-81cd-ad0037bfb0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:01.182258 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd303d-5284-4c38-81cd-ad0037bfb0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:01.183862 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd303d-5284-4c38-81cd-ad0037bfb0c8 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:01.195046 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1464/2926] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:13:01.199701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88612a-0d4c-47a0-95d6-8a60818a97ed admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:01.212171 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88612a-0d4c-47a0-95d6-8a60818a97ed admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:01.218339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72cc70-b25a-4693-a50d-be2112123c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:01.219380 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72cc70-b25a-4693-a50d-be2112123c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:01.219671 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72cc70-b25a-4693-a50d-be2112123c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:01.219940 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72cc70-b25a-4693-a50d-be2112123c71 admin admin] PATH_INFO: `/v3/projects/5f80ef8d920e4dc69d31673e277ec87c/users/3b07c55e98bc4009a09e6ceb324417d8/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:01.239390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72cc70-b25a-4693-a50d-be2112123c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f80ef8d920e4dc69d31673e277ec87c, user_id=3b07c55e98bc4009a09e6ceb324417d8, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:01.242227 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72cc70-b25a-4693-a50d-be2112123c71 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:01.257769 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1463/2927] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:13:01 2022] PUT /identity/v3/projects/5f80ef8d920e4dc69d31673e277ec87c/users/3b07c55e98bc4009a09e6ceb324417d8/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:01.270364 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1810b6e-de98-4672-ada4-cb01b73b9da9 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:01.270819 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1810b6e-de98-4672-ada4-cb01b73b9da9 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:01.271208 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1810b6e-de98-4672-ada4-cb01b73b9da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:01.299302 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-a1810b6e-de98-4672-ada4-cb01b73b9da9 None None] MFA Rules not processed for user `3b07c55e98bc4009a09e6ceb324417d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:01.300576 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-a1810b6e-de98-4672-ada4-cb01b73b9da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:01.364683 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1465/2928] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:13:01 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:01.403326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72cc70-b25a-4693-a50d-be2112123c71 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:01.405365 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-ad72cc70-b25a-4693-a50d-be2112123c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:01.469278 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72cc70-b25a-4693-a50d-be2112123c71 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:01.474329 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9aa34-71b7-44f3-9e5b-8da879a7f582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:01.474976 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9aa34-71b7-44f3-9e5b-8da879a7f582 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:01.475293 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9aa34-71b7-44f3-9e5b-8da879a7f582 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:01.475523 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9aa34-71b7-44f3-9e5b-8da879a7f582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:01.485621 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9aa34-71b7-44f3-9e5b-8da879a7f582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:01.487321 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9aa34-71b7-44f3-9e5b-8da879a7f582 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:01.498039 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1464/2929] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:13:01 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:13:01.515143 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1810b6e-de98-4672-ada4-cb01b73b9da9 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:01.579370 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1810b6e-de98-4672-ada4-cb01b73b9da9 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:01.585191 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7440c5-d685-4457-8b8e-ff89301e00e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:01.586082 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7440c5-d685-4457-8b8e-ff89301e00e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:01.586355 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7440c5-d685-4457-8b8e-ff89301e00e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:01.586647 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7440c5-d685-4457-8b8e-ff89301e00e3 admin admin] PATH_INFO: `/v3/users/3b07c55e98bc4009a09e6ceb324417d8` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:01.587916 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7440c5-d685-4457-8b8e-ff89301e00e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b07c55e98bc4009a09e6ceb324417d8)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:01.590003 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7440c5-d685-4457-8b8e-ff89301e00e3 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:01.644492 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8a7440c5-d685-4457-8b8e-ff89301e00e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b07c55e98bc4009a09e6ceb324417d8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:01.645052 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8a7440c5-d685-4457-8b8e-ff89301e00e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b07c55e98bc4009a09e6ceb324417d8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:01.657764 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8a7440c5-d685-4457-8b8e-ff89301e00e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b07c55e98bc4009a09e6ceb324417d8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:01.658657 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8a7440c5-d685-4457-8b8e-ff89301e00e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b07c55e98bc4009a09e6ceb324417d8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:01.668352 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-8a7440c5-d685-4457-8b8e-ff89301e00e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b07c55e98bc4009a09e6ceb324417d8'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:01.681988 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1466/2930] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:13:01 2022] DELETE /identity/v3/users/3b07c55e98bc4009a09e6ceb324417d8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:01.686898 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f50e2-587e-4e9c-b26e-285f82a82b30 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:01.687409 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f50e2-587e-4e9c-b26e-285f82a82b30 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:01.687527 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f50e2-587e-4e9c-b26e-285f82a82b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:01.705322 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-cd7f50e2-587e-4e9c-b26e-285f82a82b30 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:01.706516 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-cd7f50e2-587e-4e9c-b26e-285f82a82b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:01.769656 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1465/2931] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:01.779773 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7440c5-d685-4457-8b8e-ff89301e00e3 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:01.781444 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8a7440c5-d685-4457-8b8e-ff89301e00e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:01.845150 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7440c5-d685-4457-8b8e-ff89301e00e3 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:01.849943 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaf199-e072-4035-995b-933a1d5d34e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:01.850667 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaf199-e072-4035-995b-933a1d5d34e1 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:01.850931 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaf199-e072-4035-995b-933a1d5d34e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:01.851202 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaf199-e072-4035-995b-933a1d5d34e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:01.863076 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfaf199-e072-4035-995b-933a1d5d34e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:01.864667 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfaf199-e072-4035-995b-933a1d5d34e1 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:01.875237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1467/2932] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:13:02.152258 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f50e2-587e-4e9c-b26e-285f82a82b30 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:02.153818 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-cd7f50e2-587e-4e9c-b26e-285f82a82b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:02.167085 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f50e2-587e-4e9c-b26e-285f82a82b30 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:02.176306 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e82cb-9f8e-4fde-91a5-edce80abd64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:02.176900 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e82cb-9f8e-4fde-91a5-edce80abd64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:02.177077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e82cb-9f8e-4fde-91a5-edce80abd64a admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:02.177421 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e82cb-9f8e-4fde-91a5-edce80abd64a admin admin] PATH_INFO: `/v3/projects/5f80ef8d920e4dc69d31673e277ec87c` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:02.180887 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e82cb-9f8e-4fde-91a5-edce80abd64a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f80ef8d920e4dc69d31673e277ec87c)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:02.183968 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e82cb-9f8e-4fde-91a5-edce80abd64a admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:02.234538 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fc2e82cb-9f8e-4fde-91a5-edce80abd64a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f80ef8d920e4dc69d31673e277ec87c', 'request_id': 'req-fc2e82cb-9f8e-4fde-91a5-edce80abd64a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:02.243835 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fc2e82cb-9f8e-4fde-91a5-edce80abd64a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f80ef8d920e4dc69d31673e277ec87c', 'request_id': 'req-fc2e82cb-9f8e-4fde-91a5-edce80abd64a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:02.250493 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fc2e82cb-9f8e-4fde-91a5-edce80abd64a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f80ef8d920e4dc69d31673e277ec87c', 'request_id': 'req-fc2e82cb-9f8e-4fde-91a5-edce80abd64a'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:02.266659 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fc2e82cb-9f8e-4fde-91a5-edce80abd64a admin admin] The token cache is being invalidate because project 5f80ef8d920e4dc69d31673e277ec87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:13:02.267077 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fc2e82cb-9f8e-4fde-91a5-edce80abd64a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:02.267680 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-fc2e82cb-9f8e-4fde-91a5-edce80abd64a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:02.269598 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1466/2933] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:13:02 2022] DELETE /identity/v3/projects/5f80ef8d920e4dc69d31673e277ec87c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:02.275353 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd68d8c-dfaa-4ee8-bce0-0a28d0925c99 None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:02.275645 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd68d8c-dfaa-4ee8-bce0-0a28d0925c99 None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:02.275890 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd68d8c-dfaa-4ee8-bce0-0a28d0925c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:02.294874 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-8fd68d8c-dfaa-4ee8-bce0-0a28d0925c99 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:02.296118 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-8fd68d8c-dfaa-4ee8-bce0-0a28d0925c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:02.360806 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1468/2934] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:02.372024 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49e948-348f-4a5c-b80f-742b6b982881 None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:02.372667 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49e948-348f-4a5c-b80f-742b6b982881 None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:02.373266 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49e948-348f-4a5c-b80f-742b6b982881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:02.405823 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-5a49e948-348f-4a5c-b80f-742b6b982881 None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:02.407044 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-5a49e948-348f-4a5c-b80f-742b6b982881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:02.417811 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1467/2935] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:02.424373 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd68d8c-dfaa-4ee8-bce0-0a28d0925c99 None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:02.436152 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd68d8c-dfaa-4ee8-bce0-0a28d0925c99 None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:02.441975 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47113b61-0f6d-4453-873c-43e9189262a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:02.443059 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47113b61-0f6d-4453-873c-43e9189262a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:02.443328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47113b61-0f6d-4453-873c-43e9189262a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:02.443593 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47113b61-0f6d-4453-873c-43e9189262a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:02.444373 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47113b61-0f6d-4453-873c-43e9189262a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86737) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:13:02.444671 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47113b61-0f6d-4453-873c-43e9189262a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:02.446353 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47113b61-0f6d-4453-873c-43e9189262a1 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:02.458334 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1469/2936] 10.222.0.90 () {58 vars in 1153 bytes} [Wed Nov 2 13:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 13:13:02.463326 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49e948-348f-4a5c-b80f-742b6b982881 None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:02.473171 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49e948-348f-4a5c-b80f-742b6b982881 None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:02.479477 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7ddff-218c-466e-be1c-8ac351c8400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:02.480175 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ddff-218c-466e-be1c-8ac351c8400f admin admin] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:02.480504 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ddff-218c-466e-be1c-8ac351c8400f admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:02.480779 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ddff-218c-466e-be1c-8ac351c8400f admin admin] PATH_INFO: `/v3/projects` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:02.481502 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7ddff-218c-466e-be1c-8ac351c8400f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:02.483442 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7ddff-218c-466e-be1c-8ac351c8400f admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:02.513485 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1468/2937] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Nov 2 13:13:02 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:13:02.518100 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47113b61-0f6d-4453-873c-43e9189262a1 admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:02.530427 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47113b61-0f6d-4453-873c-43e9189262a1 admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:02.591394 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58b979-3f7f-4f06-b165-6e8d79992b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:02.592090 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58b979-3f7f-4f06-b165-6e8d79992b0b admin admin] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:02.592413 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58b979-3f7f-4f06-b165-6e8d79992b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:02.592684 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58b979-3f7f-4f06-b165-6e8d79992b0b admin admin] PATH_INFO: `/v3/users` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:02.593387 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58b979-3f7f-4f06-b165-6e8d79992b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:02.595328 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58b979-3f7f-4f06-b165-6e8d79992b0b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:02.621325 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1470/2938] 10.222.0.90 () {60 vars in 1144 bytes} [Wed Nov 2 13:13:02 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:13:02.626093 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7ddff-218c-466e-be1c-8ac351c8400f admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:02.637718 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7ddff-218c-466e-be1c-8ac351c8400f admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:02.644392 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94e68d-d354-49d7-9e47-de72062703f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:02.645096 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94e68d-d354-49d7-9e47-de72062703f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:02.645419 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94e68d-d354-49d7-9e47-de72062703f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:02.645701 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94e68d-d354-49d7-9e47-de72062703f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:02.646444 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94e68d-d354-49d7-9e47-de72062703f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:02.648060 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94e68d-d354-49d7-9e47-de72062703f7 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:02.659015 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1469/2939] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:13:02.665165 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58b979-3f7f-4f06-b165-6e8d79992b0b admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:02.675660 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58b979-3f7f-4f06-b165-6e8d79992b0b admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:02.680321 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692adc97-1a6c-4efd-9660-9bc9f07d2316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:02.680994 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692adc97-1a6c-4efd-9660-9bc9f07d2316 admin admin] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:02.681274 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692adc97-1a6c-4efd-9660-9bc9f07d2316 admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:02.681544 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692adc97-1a6c-4efd-9660-9bc9f07d2316 admin admin] PATH_INFO: `/v3/roles` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:02.682282 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692adc97-1a6c-4efd-9660-9bc9f07d2316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:02.683901 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692adc97-1a6c-4efd-9660-9bc9f07d2316 admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:02.694504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1471/2940] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Nov 2 13:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:13:02.698962 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94e68d-d354-49d7-9e47-de72062703f7 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:02.709635 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94e68d-d354-49d7-9e47-de72062703f7 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:02.715462 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dd8f3-5c59-401c-8b4d-80fd329d3cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:02.716411 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dd8f3-5c59-401c-8b4d-80fd329d3cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:02.716695 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dd8f3-5c59-401c-8b4d-80fd329d3cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:02.716971 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dd8f3-5c59-401c-8b4d-80fd329d3cb4 admin admin] PATH_INFO: `/v3/projects/9bdcdc896a20479c9576d334677d059f/users/14b8c5fae2094c27b6cb4d6ed789fc80/roles/ab7ac47ce77b490b8868c79a13a2a0aa` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:02.732784 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3dd8f3-5c59-401c-8b4d-80fd329d3cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bdcdc896a20479c9576d334677d059f, user_id=14b8c5fae2094c27b6cb4d6ed789fc80, role_id=ab7ac47ce77b490b8868c79a13a2a0aa)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:02.735582 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3dd8f3-5c59-401c-8b4d-80fd329d3cb4 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:02.750484 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1470/2941] 10.222.0.90 () {60 vars in 1483 bytes} [Wed Nov 2 13:13:02 2022] PUT /identity/v3/projects/9bdcdc896a20479c9576d334677d059f/users/14b8c5fae2094c27b6cb4d6ed789fc80/roles/ab7ac47ce77b490b8868c79a13a2a0aa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:02.762551 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac0a22-6cdd-4645-8539-018bb94e8d5c None None] REQUEST_METHOD: `POST` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:02.762842 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac0a22-6cdd-4645-8539-018bb94e8d5c None None] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:02.763121 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac0a22-6cdd-4645-8539-018bb94e8d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:02.797826 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.auth.core [None req-e3ac0a22-6cdd-4645-8539-018bb94e8d5c None None] MFA Rules not processed for user `14b8c5fae2094c27b6cb4d6ed789fc80`. Rule list: `[]` (Enabled: `True`). {{(pid=86737) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:02.798962 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-e3ac0a22-6cdd-4645-8539-018bb94e8d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:02.869162 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1472/2942] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:02.883613 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dd8f3-5c59-401c-8b4d-80fd329d3cb4 admin admin] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:02.886041 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-6e3dd8f3-5c59-401c-8b4d-80fd329d3cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:02.950375 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dd8f3-5c59-401c-8b4d-80fd329d3cb4 admin admin] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:02.954390 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae33a2-d7b4-400d-a6c1-155c18446961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6d1ff8ac3b408f87c4a9b8d7363e86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:02.955037 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae33a2-d7b4-400d-a6c1-155c18446961 service cinder] REQUEST_METHOD: `GET` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:02.955311 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae33a2-d7b4-400d-a6c1-155c18446961 service cinder] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:02.955575 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae33a2-d7b4-400d-a6c1-155c18446961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:02.964294 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae33a2-d7b4-400d-a6c1-155c18446961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:02.965744 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae33a2-d7b4-400d-a6c1-155c18446961 service cinder] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:02.974565 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1471/2943] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:13:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:13:24.957381 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac0a22-6cdd-4645-8539-018bb94e8d5c None None] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:25.036402 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac0a22-6cdd-4645-8539-018bb94e8d5c None None] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:25.040973 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe5952-f2a9-44ad-9090-dcb3bc543e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:25.041852 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe5952-f2a9-44ad-9090-dcb3bc543e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:25.042126 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe5952-f2a9-44ad-9090-dcb3bc543e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:25.042391 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe5952-f2a9-44ad-9090-dcb3bc543e9b admin admin] PATH_INFO: `/v3/users/14b8c5fae2094c27b6cb4d6ed789fc80` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:25.043566 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe5952-f2a9-44ad-9090-dcb3bc543e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b8c5fae2094c27b6cb4d6ed789fc80)` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:25.045504 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe5952-f2a9-44ad-9090-dcb3bc543e9b admin admin] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:25.095953 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-60fe5952-f2a9-44ad-9090-dcb3bc543e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b8c5fae2094c27b6cb4d6ed789fc80'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:25.096567 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-60fe5952-f2a9-44ad-9090-dcb3bc543e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b8c5fae2094c27b6cb4d6ed789fc80'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:25.108646 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-60fe5952-f2a9-44ad-9090-dcb3bc543e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b8c5fae2094c27b6cb4d6ed789fc80'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:25.109403 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-60fe5952-f2a9-44ad-9090-dcb3bc543e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b8c5fae2094c27b6cb4d6ed789fc80'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:25.117315 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.notifications [None req-60fe5952-f2a9-44ad-9090-dcb3bc543e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b8c5fae2094c27b6cb4d6ed789fc80'} {{(pid=86737) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:25.132637 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1473/2944] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Nov 2 13:13:24 2022] DELETE /identity/v3/users/14b8c5fae2094c27b6cb4d6ed789fc80 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:25.137325 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fb282-368f-4b2f-96ae-4eeb11fb353d None None] REQUEST_METHOD: `POST` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:25.137879 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fb282-368f-4b2f-96ae-4eeb11fb353d None None] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:25.137879 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fb282-368f-4b2f-96ae-4eeb11fb353d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:25.157296 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.auth.core [None req-913fb282-368f-4b2f-96ae-4eeb11fb353d None None] MFA Rules not processed for user `278e685f13c54040af7579fa7ad454a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86736) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:25.158618 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-913fb282-368f-4b2f-96ae-4eeb11fb353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:25.228474 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1472/2945] 10.222.0.90 () {58 vars in 958 bytes} [Wed Nov 2 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:25.240468 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe5952-f2a9-44ad-9090-dcb3bc543e9b admin admin] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:25.242348 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-60fe5952-f2a9-44ad-9090-dcb3bc543e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:25.309237 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe5952-f2a9-44ad-9090-dcb3bc543e9b admin admin] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:25.313556 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8abaf0-ed32-48e0-a521-9ea7be4f9cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89a11da83d84467ca9ae04b9693beede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:25.314351 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8abaf0-ed32-48e0-a521-9ea7be4f9cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:25.314929 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8abaf0-ed32-48e0-a521-9ea7be4f9cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:25.315386 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8abaf0-ed32-48e0-a521-9ea7be4f9cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:25.325784 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8abaf0-ed32-48e0-a521-9ea7be4f9cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:25.327230 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8abaf0-ed32-48e0-a521-9ea7be4f9cf5 service neutron] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:25.338185 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1474/2946] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:13:25.617652 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fb282-368f-4b2f-96ae-4eeb11fb353d None None] Authenticating user token {{(pid=86736) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:25.619142 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.fernet_utils [None req-913fb282-368f-4b2f-96ae-4eeb11fb353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86736) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:25.632391 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fb282-368f-4b2f-96ae-4eeb11fb353d None None] Validating token access rules against request {{(pid=86736) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:25.637944 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ed14b-61df-47bc-8656-7d31ad1d69a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '278e685f13c54040af7579fa7ad454a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b31a529f322f43dfa78c0719df9a66db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86736) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:25.638870 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ed14b-61df-47bc-8656-7d31ad1d69a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:25.639029 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ed14b-61df-47bc-8656-7d31ad1d69a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:25.639339 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ed14b-61df-47bc-8656-7d31ad1d69a9 admin admin] PATH_INFO: `/v3/projects/9bdcdc896a20479c9576d334677d059f` {{(pid=86736) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:25.641521 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ed14b-61df-47bc-8656-7d31ad1d69a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bdcdc896a20479c9576d334677d059f)` {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:25.648763 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ed14b-61df-47bc-8656-7d31ad1d69a9 admin admin] RBAC: Authorization granted {{(pid=86736) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:25.703897 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-077ed14b-61df-47bc-8656-7d31ad1d69a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bdcdc896a20479c9576d334677d059f', 'request_id': 'req-077ed14b-61df-47bc-8656-7d31ad1d69a9'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:25.712772 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-077ed14b-61df-47bc-8656-7d31ad1d69a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bdcdc896a20479c9576d334677d059f', 'request_id': 'req-077ed14b-61df-47bc-8656-7d31ad1d69a9'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:25.718980 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-077ed14b-61df-47bc-8656-7d31ad1d69a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bdcdc896a20479c9576d334677d059f', 'request_id': 'req-077ed14b-61df-47bc-8656-7d31ad1d69a9'} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:25.731282 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-077ed14b-61df-47bc-8656-7d31ad1d69a9 admin admin] The token cache is being invalidate because project 9bdcdc896a20479c9576d334677d059f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86736) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:13:25.731591 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-077ed14b-61df-47bc-8656-7d31ad1d69a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:25.732361 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: DEBUG keystone.notifications [None req-077ed14b-61df-47bc-8656-7d31ad1d69a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86736) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:25.734017 dv-cinder-863278-1-iscsi devstack@keystone.service[86736]: [pid: 86736|app: 0|req: 1473/2947] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Nov 2 13:13:25 2022] DELETE /identity/v3/projects/9bdcdc896a20479c9576d334677d059f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:16:31.156311 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8abaf0-ed32-48e0-a521-9ea7be4f9cf5 service neutron] Authenticating user token {{(pid=86737) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:31.158065 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-5a8abaf0-ed32-48e0-a521-9ea7be4f9cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:16:31.335510 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8abaf0-ed32-48e0-a521-9ea7be4f9cf5 service neutron] Validating token access rules against request {{(pid=86737) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:31.413690 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3046a6-deb8-4ddc-8534-87cbdca027a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e89359a42b4b0592db48f5a5a6e465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a08ee6d287714297a10248ad8e4522bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86737) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:31.414687 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3046a6-deb8-4ddc-8534-87cbdca027a3 service placement] REQUEST_METHOD: `GET` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:31.415171 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3046a6-deb8-4ddc-8534-87cbdca027a3 service placement] SCRIPT_NAME: `/identity` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:31.415442 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3046a6-deb8-4ddc-8534-87cbdca027a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86737) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:31.417578 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.fernet_utils [None req-6b3046a6-deb8-4ddc-8534-87cbdca027a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86737) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:16:31.429865 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3046a6-deb8-4ddc-8534-87cbdca027a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:31.431489 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3046a6-deb8-4ddc-8534-87cbdca027a3 service placement] RBAC: Authorization granted {{(pid=86737) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:31.441925 dv-cinder-863278-1-iscsi devstack@keystone.service[86737]: [pid: 86737|app: 0|req: 1475/2948] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Nov 2 13:16:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)